Showing 1–50 of 86 results for author: Müller, A

Feature Characterization for Profile Surface Texture

Authors: Alexander Müller, Matthias Eifler, Arsalan Jawaid, Jörg Seewig

Abstract: Conventional field parameters for surface measurement use all data points, while feature characterization focuses on subsets extracted by watershed segmentation. This approach enables the extraction of specific features that are potentially responsible for the function of the surface or are a direct reflection of the manufacturing process, allowing for a more accurate assessment of both aspects. F… ▽ More Conventional field parameters for surface measurement use all data points, while feature characterization focuses on subsets extracted by watershed segmentation. This approach enables the extraction of specific features that are potentially responsible for the function of the surface or are a direct reflection of the manufacturing process, allowing for a more accurate assessment of both aspects. Feature characterization with the underlying watershed segmentation for areal surface topographies has been standardized for over a decade and is well established in industry and research. In contrast, feature characterization for surface profiles has been standardized recently, and the corresponding standard for watershed segmentation is planned to be published in the near future. Since the standards do not provide guidelines for implementation, this paper presents an unambiguous algorithm of the watershed segmentation and the feature characterization for surface profiles. This framework provides the basis for future work, mainly investigating the relationship between feature parameters based on feature characterization and the function of the surface or manufacturing process. For this purpose, recommendations for the configuration and extensions of the toolbox can also be developed, which could find their way into the ISO standards. △ Less

Submitted 24 June, 2024; v1 submitted 10 June, 2024; originally announced June 2024.

An input-output continuous-time version of Willems' lemma

Authors: Victor G. Lopez, Matthias A. Müller, Paolo Rapisarda

Abstract: We illustrate a novel version of Willems' lemma for data-based representation of continuous-time systems. The main novelties compared to previous works are two. First, the proposed framework relies only on measured input-output trajectories from the system and no internal (state) information is required. Second, our system representation makes use of exact system trajectories, without resorting to… ▽ More We illustrate a novel version of Willems' lemma for data-based representation of continuous-time systems. The main novelties compared to previous works are two. First, the proposed framework relies only on measured input-output trajectories from the system and no internal (state) information is required. Second, our system representation makes use of exact system trajectories, without resorting to orthogonal bases representations and consequent approximations. We first establish sufficient and necessary conditions for data-based generation of system trajectories in terms of suitable latent variables. Subsequently, we reformulate these conditions using measured input-output data and show how to span the full behavior of the system. Furthermore, we show how to use the developed framework to solve the data-based continuous-time simulation problem. △ Less

Submitted 24 May, 2024; originally announced May 2024.

Comments: 6 pages

On discount functions for economic model predictive control without terminal conditions

Authors: Lukas Schwenkel, Daniel Briem, Matthias A. Müller, Frank Allgöwer

Abstract: In this paper, we investigate discounted economic model predictive control (E-MPC) schemes without terminal conditions in scenarios where the optimal operating behavior is a periodic orbit. For such a setting, it is known that a linearly discounted stage cost guarantees asymptotic stability of any arbitrarily small neighborhood of the optimal orbit if the prediction horizon is sufficiently long. H… ▽ More In this paper, we investigate discounted economic model predictive control (E-MPC) schemes without terminal conditions in scenarios where the optimal operating behavior is a periodic orbit. For such a setting, it is known that a linearly discounted stage cost guarantees asymptotic stability of any arbitrarily small neighborhood of the optimal orbit if the prediction horizon is sufficiently long. However, in some examples very long prediction horizons are needed to achieve the desired performance. In this work, we extend these results by providing the same qualitative stability guarantees for a large class of discount functions. Numerical examples illustrate the influence of the discount function and show that with suitable discounting we can achieve significantly better performance than the linearly discounted E-MPC, even for short prediction horizons. △ Less

Submitted 23 May, 2024; originally announced May 2024.

Data-Based System Representation and Synchronization for Multiagent Systems

Authors: Victor G. Lopez, Matthias A. Müller

Abstract: This paper presents novel solutions of the data-based synchronization problem for continuous-time multiagent systems. We consider the cases of homogeneous and heterogeneous systems. First, a data-based representation of the synchronization error dynamics is obtained for homogeneous systems, using input-state data collected from the agents. Then, we show how to extend existing data-based stabilizat… ▽ More This paper presents novel solutions of the data-based synchronization problem for continuous-time multiagent systems. We consider the cases of homogeneous and heterogeneous systems. First, a data-based representation of the synchronization error dynamics is obtained for homogeneous systems, using input-state data collected from the agents. Then, we show how to extend existing data-based stabilization results to the multiagent case to stabilize the obtained synchronization errors. The proposed method relies on the solution of a set of linear matrix inequalities that are shown to be feasible. Then, we solve the synchronization problem for heterogeneous systems by means of dynamic controllers. Different from existing results, we do not require model knowledge for the followers and the leader. The theoretical results are finally validated using numerical simulations. △ Less

Submitted 22 April, 2024; originally announced April 2024.

Comments: 8 pages

Disturbance feedback-based model predictive control in uncertain dynamic environments

Authors: Philipp Buschermöhle, Taouba Jouini, Torsten Lilge, Matthias A. Müller

Abstract: This paper presents a robust MPC scheme for linear systems subject to time-varying, uncertain constraints that arise from uncertain environments. The predicted input sequence is parameterized over future environment states to guarantee constraint satisfaction despite an imprecise environment prediction and unknown evolution of the future constraints. We provide theoretical guarantees for recursive… ▽ More This paper presents a robust MPC scheme for linear systems subject to time-varying, uncertain constraints that arise from uncertain environments. The predicted input sequence is parameterized over future environment states to guarantee constraint satisfaction despite an imprecise environment prediction and unknown evolution of the future constraints. We provide theoretical guarantees for recursive feasibility and asymptotic convergence. Finally, a brief simulation example showcases our results. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Comments: 7 pages, 2 figures, Accepted for publication at 8th IFAC Conference on Nonlinear Model Predictive Control 2024

Moving horizon estimation for nonlinear systems with time-varying parameters

Authors: Julian D. Schiller, Matthias A. Müller

Abstract: We propose a moving horizon estimation scheme for estimating the states and time-varying parameters of nonlinear systems. We consider the case where observability of the parameters depends on the excitation of the system and may be absent during operation, with the parameter dynamics fulfilling a weak incremental bounded-energy bounded-state property to ensure boundedness of the estimation error (… ▽ More We propose a moving horizon estimation scheme for estimating the states and time-varying parameters of nonlinear systems. We consider the case where observability of the parameters depends on the excitation of the system and may be absent during operation, with the parameter dynamics fulfilling a weak incremental bounded-energy bounded-state property to ensure boundedness of the estimation error (with respect to the disturbance energy). The proposed estimation scheme involves a standard quadratic cost function with an adaptive regularization term depending on the current parameter observability. We develop robustness guarantees for the overall estimation error that are valid for all times, and that improve the more often the parameters are detected to be observable during operation. The theoretical results are illustrated by a simulation example. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Comments: accepted for presentation at NMPC 2024

Data-Based Control of Continuous-Time Linear Systems with Performance Specifications

Authors: Victor G. Lopez, Matthias A. Müller

Abstract: The design of direct data-based controllers has become a fundamental part of control theory research in the last few years. In this paper, we consider three classes of data-based state feedback control problems for linear systems. These control problems are such that, besides stabilization, some additional performance requirements must be satisfied. First, we formulate and solve a trajectory-refer… ▽ More The design of direct data-based controllers has become a fundamental part of control theory research in the last few years. In this paper, we consider three classes of data-based state feedback control problems for linear systems. These control problems are such that, besides stabilization, some additional performance requirements must be satisfied. First, we formulate and solve a trajectory-reference control problem, on which desired closed-loop trajectories are known and a controller that allows the system to closely follow those trajectories is computed. Then, in the area of data-based optimal control, we solve two different problems: the inverse problem of optimal control, and the solution of the LQR problem for continuous-time systems. Finally, we consider the case in which the precise position of the desired poles of the closed-loop system is known, and introduce a data-based variant of a robust pole-placement procedure. Although we focus on continuous-time systems, all of the presented methods can also be easily formulated for the discrete-time case. The applicability of the proposed methods is tested using numerical simulations. △ Less

Submitted 1 March, 2024; originally announced March 2024.

Comments: 16 pages, 1 figure

Gaussian Process-Based Nonlinear Moving Horizon Estimation

Authors: Tobias M. Wolff, Victor G. Lopez, Matthias A. Müller

Abstract: In this paper, we propose a novel Gaussian process-based moving horizon estimation (MHE) framework for unknown nonlinear systems. In the proposed scheme, we take advantage of the properties of Gaussian processes. On the one hand, we approximate the system dynamics by the posterior means of the learned Gaussian processes (GPs). On the other hand, we exploit the posterior variances of the Gaussian p… ▽ More In this paper, we propose a novel Gaussian process-based moving horizon estimation (MHE) framework for unknown nonlinear systems. In the proposed scheme, we take advantage of the properties of Gaussian processes. On the one hand, we approximate the system dynamics by the posterior means of the learned Gaussian processes (GPs). On the other hand, we exploit the posterior variances of the Gaussian processes to design the weighting matrices in the MHE cost function and account for the uncertainty in the learned system dynamics. The data collection and the tuning of the hyperparameters are done offline. We prove robust stability of the GP-based MHE scheme using a Lyapunov-based proof technique. Furthermore, as additional contribution, we analyze under which conditions incremental input/output-to-state stability (a nonlinear detectability notion) is preserved when approximating the system dynamics using, e.g., machine learning techniques. Finally, we illustrate the performance of the GP-based MHE scheme in a simulation case study and show how the chosen weighting matrices can lead to an improved performance compared to standard cost functions. △ Less

Submitted 7 February, 2024; originally announced February 2024.

Comments: 16 pages

Online convex optimization for robust control of constrained dynamical systems

Authors: Marko Nonhoff, Emiliano Dall'Anese, Matthias A. Müller

Abstract: This article investigates the problem of controlling linear time-invariant systems subject to time-varying and a priori unknown cost functions, state and input constraints, and exogenous disturbances. We combine the online convex optimization framework with tools from robust model predictive control to propose an algorithm that is able to guarantee robust constraint satisfaction. The performance o… ▽ More This article investigates the problem of controlling linear time-invariant systems subject to time-varying and a priori unknown cost functions, state and input constraints, and exogenous disturbances. We combine the online convex optimization framework with tools from robust model predictive control to propose an algorithm that is able to guarantee robust constraint satisfaction. The performance of the closed loop emerging from application of our framework is studied in terms of its dynamic regret, which is proven to be bounded linearly by the variation of the cost functions and the magnitude of the disturbances. We corroborate our theoretical findings and illustrate implementational aspects of the proposed algorithm by a numerical case study of a tracking control problem of an autonomous vehicle. △ Less

Submitted 9 January, 2024; originally announced January 2024.

Comments: 16 pages

Sample-based nonlinear detectability for discrete-time systems

Authors: Isabelle Krauss, Victor G. Lopez, Matthias A. Müller

Abstract: This paper introduces two sample-based formulations of incremental input/output-to-state stability (i-IOSS), a suitable detectability notion for general nonlinear systems. In this work we consider the case of limited output information, i.e., measurements are only infrequently and/or irregularly available. The output-dependent term of the sample-based i-IOSS bound is properly modified to yield a c… ▽ More This paper introduces two sample-based formulations of incremental input/output-to-state stability (i-IOSS), a suitable detectability notion for general nonlinear systems. In this work we consider the case of limited output information, i.e., measurements are only infrequently and/or irregularly available. The output-dependent term of the sample-based i-IOSS bound is properly modified to yield a characterization for detectability in presence of incomplete output sequences. We provide both a non-timediscounted and a time-discounted formulation of samplebased i-IOSS. Furthermore, conditions for an i-IOSS system to be also sample-based i-IOSS are given and the relation between the two formulations of sample-based i-IOSS is shown. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Nonlinear moving horizon estimation for robust state and parameter estimation

Authors: Julian D. Schiller, Matthias A. Müller

Abstract: We propose a moving horizon estimation scheme to estimate the states and the unknown constant parameters of general nonlinear uncertain discrete time systems. The proposed framework and analysis explicitly do not involve the a priori verification of a particular excitation condition for the parameters. Instead, we use online information about the actual excitation of the parameters at any time dur… ▽ More We propose a moving horizon estimation scheme to estimate the states and the unknown constant parameters of general nonlinear uncertain discrete time systems. The proposed framework and analysis explicitly do not involve the a priori verification of a particular excitation condition for the parameters. Instead, we use online information about the actual excitation of the parameters at any time during operation and ensure that the regularization term in the cost function is always automatically selected appropriately. This ensures that the state and parameter estimation error is bounded for all times, even if the parameters are never (or only rarely) excited during operation. Additionally, the more often sufficient excitation is detected, the better (i.e., smaller) the bound becomes. Robust exponential stability of the state and parameter estimation error emerges under an additional uniform condition on the maximum duration of insufficient excitation. The theoretical results are illustrated by a numerical example. △ Less

Submitted 20 December, 2023; originally announced December 2023.

An efficient data-based off-policy Q-learning algorithm for optimal output feedback control of linear systems

Authors: Mohammad Alsalti, Victor G. Lopez, Matthias A. Müller

Abstract: In this paper, we present a Q-learning algorithm to solve the optimal output regulation problem for discrete-time LTI systems. This off-policy algorithm only relies on using persistently exciting input-output data, measured offline. No model knowledge or state measurements are needed and the obtained optimal policy only uses past input-output information. Moreover, our formulation of the proposed… ▽ More In this paper, we present a Q-learning algorithm to solve the optimal output regulation problem for discrete-time LTI systems. This off-policy algorithm only relies on using persistently exciting input-output data, measured offline. No model knowledge or state measurements are needed and the obtained optimal policy only uses past input-output information. Moreover, our formulation of the proposed algorithm renders it computationally efficient. We provide conditions that guarantee the convergence of the algorithm to the optimal solution. Finally, the performance of our method is compared to existing algorithms in the literature. △ Less

Submitted 6 December, 2023; originally announced December 2023.

Notes on data-driven output-feedback control of linear MIMO systems

Authors: Mohammad Alsalti, Victor G. Lopez, Matthias A. Müller

Abstract: Recent works have approached the data-driven design of output-feedback controllers for discrete-time LTI systems by constructing non-minimal state vectors composed of past inputs and outputs. Depending on the system's complexity (order, lag and number of inputs), it was observed in several works that such an approach presents certain limitations, but no methods were proposed to overcome them. In t… ▽ More Recent works have approached the data-driven design of output-feedback controllers for discrete-time LTI systems by constructing non-minimal state vectors composed of past inputs and outputs. Depending on the system's complexity (order, lag and number of inputs), it was observed in several works that such an approach presents certain limitations, but no methods were proposed to overcome them. In this note, we clarify these limitations and solve them by proposing the construction of (alternative) non-minimal state vectors that facilitate output-feedback control of MIMO discrete-time LTI systems. △ Less

Submitted 29 November, 2023; originally announced November 2023.

Sample- and computationally efficient data-driven predictive control

Authors: Mohammad Alsalti, Manuel Barkey, Victor G. Lopez, Matthias A. Müller

Abstract: Recently proposed data-driven predictive control schemes for LTI systems use non-parametric representations based on the image of a Hankel matrix of previously collected, persistently exciting, input-output data. Persistence of excitation necessitates that the data is sufficiently long and, hence, the computational complexity of the corresponding finite-horizon optimal control problem increases. I… ▽ More Recently proposed data-driven predictive control schemes for LTI systems use non-parametric representations based on the image of a Hankel matrix of previously collected, persistently exciting, input-output data. Persistence of excitation necessitates that the data is sufficiently long and, hence, the computational complexity of the corresponding finite-horizon optimal control problem increases. In this paper, we propose an efficient data-driven predictive control (eDDPC) scheme which is both more sample efficient (requires less offline data) and computationally efficient (uses less decision variables) compared to existing schemes. This is done by leveraging an alternative data-based representation of the trajectories of LTI systems. We analytically and numerically compare the performance of this scheme to existing ones from the literature. △ Less

Submitted 6 March, 2024; v1 submitted 20 September, 2023; originally announced September 2023.

Comments: accepted for presentation at the 22nd European Control Conference (ECC) in Stockholm, Sweden

Model predictive control for the prescription of antithyroid agents

Authors: Maylin Menzel, Tobias M. Wolff, Johannes W. Dietrich, Matthias A. Müller

Abstract: Although hyperthyroidism is a common disease, the pharmaceutical therapy is based on a trial-and-error approach. We extend a mathematical model of the pituitary-thyroid feedback loop such that the intake of one antithyroid agent, namely methimazole (MMI), can be considered and use a model predictive control (MPC) scheme to determine suitable dosages. Although hyperthyroidism is a common disease, the pharmaceutical therapy is based on a trial-and-error approach. We extend a mathematical model of the pituitary-thyroid feedback loop such that the intake of one antithyroid agent, namely methimazole (MMI), can be considered and use a model predictive control (MPC) scheme to determine suitable dosages. △ Less

Submitted 31 July, 2023; originally announced July 2023.

Comments: 2 pages

Towards Continuous Time Finite Horizon LQR Control in SE(3)

Authors: Shivesh Kumar, Andreas Mueller, Patrick Wensing, Frank Kirchner

Abstract: The control of free-floating robots requires dealing with several challenges. The motion of such robots evolves on a continuous manifold described by the Special Euclidean Group of dimension 3, known as SE(3). Methods from finite horizon Linear Quadratic Regulators (LQR) control have gained recent traction in the robotics community. However, such approaches are inherently solving an unconstrained… ▽ More The control of free-floating robots requires dealing with several challenges. The motion of such robots evolves on a continuous manifold described by the Special Euclidean Group of dimension 3, known as SE(3). Methods from finite horizon Linear Quadratic Regulators (LQR) control have gained recent traction in the robotics community. However, such approaches are inherently solving an unconstrained optimization problem and hence are unable to respect the manifold constraints imposed by the group structure of SE(3). This may lead to small errors, singularity problems and double cover issues depending on the choice of coordinates to model the floating base motion. In this paper, we propose the use of canonical exponential coordinates of SE(3) and the associated Exponential map along with its differentials to embed this structure in the theory of finite horizon LQR controllers. △ Less

Submitted 26 July, 2023; originally announced July 2023.

Comments: IEEE International Conference on Robotics and Automation (ICRA) 2023 Workshop on Geometric Representations The Roles of Modern Screw Theory, Lie algebra, and Geometric Algebra in Robotics

Data-based system representations from irregularly measured data

Authors: Mohammad Alsalti, Ivan Markovsky, Victor G. Lopez, Matthias A. Müller

Abstract: Non-parametric representations of dynamical systems based on the image of a Hankel matrix of data are extensively used for data-driven control. However, if samples of data are missing, obtaining such representations becomes a difficult task. By exploiting the kernel structure of Hankel matrices of irregularly measured data generated by a linear time-invariant system, we provide computational metho… ▽ More Non-parametric representations of dynamical systems based on the image of a Hankel matrix of data are extensively used for data-driven control. However, if samples of data are missing, obtaining such representations becomes a difficult task. By exploiting the kernel structure of Hankel matrices of irregularly measured data generated by a linear time-invariant system, we provide computational methods for which any complete finite-length behavior of the system can be obtained. For the special case of periodically missing outputs, we provide conditions on the input such that the former result is guaranteed. In the presence of noise in the data, our method returns an approximate finite-length behavior of the system. We illustrate our result with several examples, including its use for approximate data completion in real-world applications and compare it to alternative methods. △ Less

Submitted 24 February, 2024; v1 submitted 21 July, 2023; originally announced July 2023.

Comments: submitted to IEEE Transactions on Automatic Control

Analysis and design of model predictive control frameworks for dynamic operation -- An overview

Authors: Johannes Köhler, Matthas A. Müller, Frank Allgöwer

Abstract: This article provides an overview of model predictive control (MPC) frameworks for dynamic operation of nonlinear constrained systems. Dynamic operation is often an integral part of the control objective, ranging from tracking of reference signals to the general economic operation of a plant under online changing time-varying operating conditions. We focus on the particular challenges that arise w… ▽ More This article provides an overview of model predictive control (MPC) frameworks for dynamic operation of nonlinear constrained systems. Dynamic operation is often an integral part of the control objective, ranging from tracking of reference signals to the general economic operation of a plant under online changing time-varying operating conditions. We focus on the particular challenges that arise when dealing with such more general control goals and present methods that have emerged in the literature to address these issues. The goal of this article is to present an overview of the state-of-the-art techniques, providing a diverse toolkit to apply and further develop MPC formulations that can handle the challenges intrinsic to dynamic operation. We also critically assess the applicability of the different research directions, discussing limitations and opportunities for further research. △ Less

Submitted 9 January, 2024; v1 submitted 6 July, 2023; originally announced July 2023.

Comments: This is the accepted version of the paper in Annual Reviews in Control, 2024

Journal ref: Annual Reviews in Control (2024)

Screw and Lie Group Theory in Multibody Kinematics -- Motion Representation and Recursive Kinematics of Tree-Topology Systems

Authors: Andreas Mueller

Abstract: After three decades of computational multibody system (MBS) dynamics, current research is centered at the development of compact and user friendly yet computationally efficient formulations for the analysis of complex MBS. The key to this is a holistic geometric approach to the kinematics modeling observing that the general motion of rigid bodies as well as the relative motion due to technical joi… ▽ More After three decades of computational multibody system (MBS) dynamics, current research is centered at the development of compact and user friendly yet computationally efficient formulations for the analysis of complex MBS. The key to this is a holistic geometric approach to the kinematics modeling observing that the general motion of rigid bodies as well as the relative motion due to technical joints are screw motions. Moreover, screw theory provides the geometric setting and Lie group theory the analytic foundation for an intuitive and compact MBS modeling. The inherent frame invariance of this modeling approach gives rise to very efficient recursive $O\left( n\right) $ algorithms, for which the so-called 'spatial operator algebra' is one example, and allows for use of readily available geometric data. In this paper three variants for describing the configuration of tree-topology MBS in terms of relative coordinates, i.e. joint variables, are presented: the standard formulation using body-fixed joint frames, a formulation without joint frames, and a formulation without either joint or body-fixed reference frames. This allows for describing the MBS kinematics without introducing joint reference frames and therewith rendering the use of restrictive modeling convention, such as Denavit-Hartenberg parameters, redundant. Four different definitions of twists are recalled and the corresponding recursive expressions are derived. The corresponding Jacobians and their factorization are derived. The aim of this paper is to motivate the use of Lie group modeling and to provide a review of the different formulations for the kinematics of tree-topology MBS in terms of relative (joint) coordinates from the unifying perspective of screw and Lie group theory. △ Less

Submitted 30 June, 2023; originally announced June 2023.

Journal ref: Multibody System Dynamics, Vol. 43, 2018, pp. 37-70

Robust stability of moving horizon estimation for continuous-time systems

Authors: Julian D. Schiller, Matthias A. Müller

Abstract: We consider a moving horizon estimation (MHE) scheme involving a discounted least squares objective for general nonlinear continuous-time systems. Provided that the system is detectable (incrementally integral input/output-to-state stable, i-iIOSS), we show that there exists a sufficiently long estimation horizon that guarantees robust global exponential stability of the estimation error in a time… ▽ More We consider a moving horizon estimation (MHE) scheme involving a discounted least squares objective for general nonlinear continuous-time systems. Provided that the system is detectable (incrementally integral input/output-to-state stable, i-iIOSS), we show that there exists a sufficiently long estimation horizon that guarantees robust global exponential stability of the estimation error in a time-discounted $L^2$-to-$L^\infty$ sense. In addition, we show that i-iIOSS Lyapunov functions can be efficiently constructed by verifying certain linear matrix inequality conditions. In combination, we propose a flexible Lyapunov-based MHE framework in continuous time, which particularly offers more tuning possibilities than its discrete-time analog, and provide sufficient conditions for stability that can be easily verified in practice. Our results are illustrated by a numerical example. △ Less

Submitted 31 January, 2024; v1 submitted 11 May, 2023; originally announced May 2023.

Comments: Replaced by accepted version

Journal ref: at-Automatisierungstechnik 2024; 72(2): 120-133

On an integral variant of incremental input/output-to-state stability and its use as a notion of nonlinear detectability

Authors: Julian D. Schiller, Matthias A. Müller

Abstract: We propose a time-discounted integral variant of incremental input/output-to-state stability (i-iIOSS) together with an equivalent Lyapunov function characterization. Continuity of the i-iIOSS Lyapunov function is ensured if the system satisfies a certain continuity assumption involving the Osgood condition. We show that the proposed i-iIOSS notion is a necessary condition for the existence of a r… ▽ More We propose a time-discounted integral variant of incremental input/output-to-state stability (i-iIOSS) together with an equivalent Lyapunov function characterization. Continuity of the i-iIOSS Lyapunov function is ensured if the system satisfies a certain continuity assumption involving the Osgood condition. We show that the proposed i-iIOSS notion is a necessary condition for the existence of a robustly globally asymptotically stable observer map** in a time-discounted ``$L^2$-to-$L^\infty$'' sense. In combination, our results provide a general framework for a Lyapunov-based robust stability analysis of observers for continuous-time systems, which in particular is crucial for the use of optimization-based state estimators (such as moving horizon estimation). △ Less

Submitted 19 June, 2023; v1 submitted 9 May, 2023; originally announced May 2023.

Comments: replaced with accepted version

Towards Tumour Graph Learning for Survival Prediction in Head & Neck Cancer Patients

Authors: Angel Victor Juanco Muller, Joao F. C. Mota, Keith A. Goatman, Corne Hoogendoorn

Abstract: With nearly one million new cases diagnosed worldwide in 2020, head \& neck cancer is a deadly and common malignity. There are challenges to decision making and treatment of such cancer, due to lesions in multiple locations and outcome variability between patients. Therefore, automated segmentation and prognosis estimation approaches can help ensure each patient gets the most effective treatment.… ▽ More With nearly one million new cases diagnosed worldwide in 2020, head \& neck cancer is a deadly and common malignity. There are challenges to decision making and treatment of such cancer, due to lesions in multiple locations and outcome variability between patients. Therefore, automated segmentation and prognosis estimation approaches can help ensure each patient gets the most effective treatment. This paper presents a framework to perform these functions on arbitrary field of view (FoV) PET and CT registered scans, thus approaching tasks 1 and 2 of the HECKTOR 2022 challenge as team \texttt{VokCow}. The method consists of three stages: localization, segmentation and survival prediction. First, the scans with arbitrary FoV are cropped to the head and neck region and a u-shaped convolutional neural network (CNN) is trained to segment the region of interest. Then, using the obtained regions, another CNN is combined with a support vector machine classifier to obtain the semantic segmentation of the tumours, which results in an aggregated Dice score of 0.57 in task 1. Finally, survival prediction is approached with an ensemble of Weibull accelerated failure times model and deep learning methods. In addition to patient health record data, we explore whether processing graphs of image patches centred at the tumours via graph convolutions can improve the prognostic predictions. A concordance index of 0.64 was achieved in the test set, ranking 6th in the challenge leaderboard for this task. △ Less

Submitted 16 May, 2023; v1 submitted 17 April, 2023; originally announced April 2023.

Comments: Published by Springer as part of the HECKTOR 2022 challenge proccedings https://link.springer.com/chapter/10.1007/978-3-031-27420-6_18

Robust Stability of Gaussian Process Based Moving Horizon Estimation

Authors: Tobias M. Wolff, Victor G. Lopez, Matthias A. Müller

Abstract: In this paper, we introduce a Gaussian process based moving horizon estimation (MHE) framework. The scheme is based on offline collected data and offline hyperparameter optimization. In particular, compared to standard MHE schemes, we replace the mathematical model of the system by the posterior mean of the Gaussian process. To account for the uncertainty of the learned model, we exploit the poste… ▽ More In this paper, we introduce a Gaussian process based moving horizon estimation (MHE) framework. The scheme is based on offline collected data and offline hyperparameter optimization. In particular, compared to standard MHE schemes, we replace the mathematical model of the system by the posterior mean of the Gaussian process. To account for the uncertainty of the learned model, we exploit the posterior variance of the learned Gaussian process in the weighting matrices of the cost function of the proposed MHE scheme. We prove practical robust exponential stability of the resulting estimator using a recently proposed Lyapunov-based proof technique. Finally, the performance of the Gaussian process based MHE scheme is illustrated via a nonlinear system. △ Less

Submitted 14 June, 2023; v1 submitted 13 April, 2023; originally announced April 2023.

Comments: 8 pages

Distributed Model Predictive Control for Periodic Cooperation of Multi-Agent Systems

Authors: Matthias Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We consider multi-agent systems with heterogeneous, nonlinear agents subject to individual constraints that want to achieve a periodic, dynamic cooperative control goal which can be characterised by a set and a suitable cost. We propose a sequential distributed model predictive control (MPC) scheme in which agents sequentially solve an individual optimisation problem to track an artificial periodi… ▽ More We consider multi-agent systems with heterogeneous, nonlinear agents subject to individual constraints that want to achieve a periodic, dynamic cooperative control goal which can be characterised by a set and a suitable cost. We propose a sequential distributed model predictive control (MPC) scheme in which agents sequentially solve an individual optimisation problem to track an artificial periodic output trajectory. The optimisation problems are coupled through these artificial periodic output trajectories, which are communicated and penalised using the cost that characterises the cooperative goal. The agents communicate only their artificial trajectories and only once per time step. We show that under suitable assumptions, the agents can incrementally move their artificial output trajectories towards the cooperative goal, and, hence, their closed-loop output trajectories asymptotically achieve it. We illustrate the scheme with a simulation example. △ Less

Submitted 6 April, 2023; originally announced April 2023.

An Efficient Off-Policy Reinforcement Learning Algorithm for the Continuous-Time LQR Problem

Authors: Victor G. Lopez, Matthias A. Müller

Abstract: In this paper, an off-policy reinforcement learning algorithm is designed to solve the continuous-time LQR problem using only input-state data measured from the system. Different from other algorithms in the literature, we propose the use of a specific persistently exciting input as the exploration signal during the data collection step. We then show that, using this persistently excited data, the… ▽ More In this paper, an off-policy reinforcement learning algorithm is designed to solve the continuous-time LQR problem using only input-state data measured from the system. Different from other algorithms in the literature, we propose the use of a specific persistently exciting input as the exploration signal during the data collection step. We then show that, using this persistently excited data, the solution of the matrix equation in our algorithm is guaranteed to exist and to be unique at every iteration. Convergence of the algorithm to the optimal control input is also proven. Moreover, we formulate the policy evaluation step as the solution of a Sylvester-transpose equation, which increases the efficiency of its solution. Finally, a method to determine a stabilizing policy to initialize the algorithm using only measured data is proposed. △ Less

Submitted 31 March, 2023; originally announced March 2023.

Comments: 7 pages

Transient Performance of MPC for Tracking

Authors: Matthias Köhler, Lisa Krügel, Lars Grüne, Matthias A. Müller, Frank Allgöwer

Abstract: We analyse the closed-loop performance of a model predictive control (MPC) for tracking formulation with artificial references. It has been shown that such a scheme guarantees closed-loop stability and recursive feasibility for any externally supplied reference, even if it is unreachable or time-varying. The basic idea is to consider an artificial reference as an additional decision variable and t… ▽ More We analyse the closed-loop performance of a model predictive control (MPC) for tracking formulation with artificial references. It has been shown that such a scheme guarantees closed-loop stability and recursive feasibility for any externally supplied reference, even if it is unreachable or time-varying. The basic idea is to consider an artificial reference as an additional decision variable and to formulate generalised terminal ingredients with respect to it. In addition, its offset is penalised in the MPC optimisation problem, leading to closed-loop convergence to the best reachable reference. In this paper, we provide a transient performance bound on the closed loop using MPC for tracking. We employ mild assumptions on the offset cost and scale it with the prediction horizon. In this case, an increasing horizon in MPC for tracking recovers the infinite horizon optimal solution. △ Less

Submitted 24 January, 2024; v1 submitted 17 March, 2023; originally announced March 2023.

Journal ref: IEEE Control Systems Letters, vol. 7, pp. 2545-2550, 2023

On the design of persistently exciting inputs for data-driven control of linear and nonlinear systems

Authors: Mohammad Alsalti, Victor G. Lopez, Matthias A. Müller

Abstract: In the context of data-driven control, persistence of excitation (PE) of an input sequence is defined in terms of a rank condition on the Hankel matrix of the input data. For nonlinear systems, recent results employed rank conditions involving collected input and state/output data, for which no guidelines are available on how to satisfy them a priori. In this paper, we first show that a set of dis… ▽ More In the context of data-driven control, persistence of excitation (PE) of an input sequence is defined in terms of a rank condition on the Hankel matrix of the input data. For nonlinear systems, recent results employed rank conditions involving collected input and state/output data, for which no guidelines are available on how to satisfy them a priori. In this paper, we first show that a set of discrete impulses is guaranteed to be persistently exciting for any controllable LTI system. Based on this result, for certain classes of nonlinear systems, we guarantee persistence of excitation of sequences of basis functions a priori, by design of the physical input only. △ Less

Submitted 19 June, 2023; v1 submitted 15 March, 2023; originally announced March 2023.

Journal ref: IEEE Control Systems Letters, 2023

Treating Hyperthyroidism: Model Predictive Control for the Prescription of Antithyroid Agents

Authors: Tobias M. Wolff, Maylin Menzel, Johannes W. Dietrich, Matthias A. Müller

Abstract: In this work, we propose an approach to determine the dosages of antithyroid agents to treat hyperthyroid patients. Instead of relying on a trial-and-error approach as it is commonly done in clinical practice, we suggest to determine the dosages by means of a model predictive control (MPC) scheme. To this end, we extend a mathematical model of the pituitary-thyroid feedback loop such that the inta… ▽ More In this work, we propose an approach to determine the dosages of antithyroid agents to treat hyperthyroid patients. Instead of relying on a trial-and-error approach as it is commonly done in clinical practice, we suggest to determine the dosages by means of a model predictive control (MPC) scheme. To this end, we extend a mathematical model of the pituitary-thyroid feedback loop such that the intake of methimazole, a common antithyroid agent, can be considered. Based on this extension, we develop an MPC scheme to determine suitable dosages. In numerical simulations, we consider scenarios in which (i) patients are affected by Graves' disease and take the medication orally, (ii) patients are additionally affected by high intrathyroidal iodide concentrations and take the medication orally and, (iii) patients suffering from a life-threatening thyrotoxicosis, in which the medication is usually given intravenously. Our results suggest that determining the medication dosages by means of an MPC scheme is a promising alternative to the currently applied trial-and-error approach. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Comments: Submitted to IFAC World Congress 2023

Informed Circular Fields for Global Reactive Obstacle Avoidance of Robotic Manipulators

Authors: Marvin Becker, Philipp Caspers, Tom Hattendorf, Torsten Lilge, Sami Haddadin, Matthias A. Müller

Abstract: In this paper a global reactive motion planning framework for robotic manipulators in complex dynamic environments is presented. In particular, the circular field predictions (CFP) planner from Becker et al. (2021) is extended to ensure obstacle avoidance of the whole structure of a robotic manipulator. Towards this end, a motion planning framework is developed that leverages global information ab… ▽ More In this paper a global reactive motion planning framework for robotic manipulators in complex dynamic environments is presented. In particular, the circular field predictions (CFP) planner from Becker et al. (2021) is extended to ensure obstacle avoidance of the whole structure of a robotic manipulator. Towards this end, a motion planning framework is developed that leverages global information about promising avoidance directions from arbitrary configuration space motion planners, resulting in improved global trajectories while reactively avoiding dynamic obstacles and decreasing the required computational power. The resulting motion planning framework is tested in multiple simulations with complex and dynamic obstacles and demonstrates great potential compared to existing motion planning approaches. △ Less

Submitted 4 August, 2023; v1 submitted 12 December, 2022; originally announced December 2022.

Comments: Accepted to IFAC World Congress 2023

Robust peak-to-peak gain analysis using integral quadratic constraints

Authors: Lukas Schwenkel, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: This work provides a framework to compute an upper bound on the robust peak-to-peak gain of discrete-time uncertain linear systems using integral quadratic constraints (IQCs). Such bounds are of particular interest in the computation of reachable sets and the $\ell_1$-norm, as well as when safety-critical constraints need to be satisfied pointwise in time. The use of $ρ$-hard IQCs with a terminal… ▽ More This work provides a framework to compute an upper bound on the robust peak-to-peak gain of discrete-time uncertain linear systems using integral quadratic constraints (IQCs). Such bounds are of particular interest in the computation of reachable sets and the $\ell_1$-norm, as well as when safety-critical constraints need to be satisfied pointwise in time. The use of $ρ$-hard IQCs with a terminal cost enables us to deal with a wide variety of uncertainty classes, for example, we provide $ρ$-hard IQCs with a terminal cost for the class of parametric uncertainties. This approach unifies, generalizes, and significantly improves state-of-the-art methods, which is also demonstrated in a numerical example. △ Less

Submitted 17 November, 2022; originally announced November 2022.

Comments: 6 pages, submitted to IFAC WC 2023

Online convex optimization for constrained control of linear systems using a reference governor

Authors: Marko Nonhoff, Johannes Köhler, Matthias A. Müller

Abstract: In this work, we propose a control scheme for linear systems subject to pointwise in time state and input constraints that aims to minimize time-varying and a priori unknown cost functions. The proposed controller is based on online convex optimization and a reference governor. In particular, we apply online gradient descent to track the time-varying and a priori unknown optimal steady state of th… ▽ More In this work, we propose a control scheme for linear systems subject to pointwise in time state and input constraints that aims to minimize time-varying and a priori unknown cost functions. The proposed controller is based on online convex optimization and a reference governor. In particular, we apply online gradient descent to track the time-varying and a priori unknown optimal steady state of the system. Moreover, we use a $λ$-contractive set to enforce constraint satisfaction and a sufficient convergence rate of the closed-loop system to the optimal steady state. We prove that the proposed scheme is recursively feasible, ensures that the state and input constraints are satisfied at all times, and achieves a dynamic regret that is linearly bounded by the variation of the cost functions. The algorithm's performance and constraint satisfaction is illustrated by means of a simulation example. △ Less

Submitted 15 June, 2023; v1 submitted 16 November, 2022; originally announced November 2022.

Comments: Accepted for publication in the proceedings of the 2023 IFAC World Congress

A moving horizon state and parameter estimation scheme with guaranteed robust convergence

Authors: Julian D. Schiller, Matthias A. Müller

Abstract: We propose a moving horizon estimation scheme for joint state and parameter estimation for nonlinear uncertain discrete-time systems. We establish robust exponential convergence of the combined estimation error subject to process disturbances and measurement noise. We employ a joint incremental input/output-to-state stability ($δ$-IOSS) Lyapunov function to characterize nonlinear detectability for… ▽ More We propose a moving horizon estimation scheme for joint state and parameter estimation for nonlinear uncertain discrete-time systems. We establish robust exponential convergence of the combined estimation error subject to process disturbances and measurement noise. We employ a joint incremental input/output-to-state stability ($δ$-IOSS) Lyapunov function to characterize nonlinear detectability for the states and (constant) parameters of the system. Sufficient conditions for the construction of a joint $δ$-IOSS Lyapunov function are provided for a special class of nonlinear systems using a persistence of excitation condition. The theoretical results are illustrated by a numerical example. △ Less

Submitted 22 December, 2023; v1 submitted 16 November, 2022; originally announced November 2022.

Comments: Replaced by final version. Presented at IFAC World Congress 2023, Yokohama, Japan

Journal ref: IFAC-PapersOnLine, Volume 56, Issue 2, 2023, Pages 6759-6764

Data-driven Nonlinear Predictive Control for Feedback Linearizable Systems

Authors: Mohammad Alsalti, Victor G. Lopez, Julian Berberich, Frank Allgöwer, Matthias A. Müller

Abstract: We present a data-driven nonlinear predictive control approach for the class of discrete-time multi-input multi-output feedback linearizable nonlinear systems. The scheme uses a non-parametric predictive model based only on input and noisy output data along with a set of basis functions that approximate the unknown nonlinearities. Despite the noisy output data as well as the mismatch caused by the… ▽ More We present a data-driven nonlinear predictive control approach for the class of discrete-time multi-input multi-output feedback linearizable nonlinear systems. The scheme uses a non-parametric predictive model based only on input and noisy output data along with a set of basis functions that approximate the unknown nonlinearities. Despite the noisy output data as well as the mismatch caused by the use of basis functions, we show that the proposed multistep robust data-driven nonlinear predictive control scheme is recursively feasible and renders the closed-loop system practically exponentially stable. We illustrate our results on a model of a fully-actuated double inverted pendulum. △ Less

Submitted 27 March, 2023; v1 submitted 11 November, 2022; originally announced November 2022.

Comments: accepted to IFAC World Congress 2023. arXiv admin note: substantial text overlap with arXiv:2204.01148

Motion Planning using Reactive Circular Fields: A 2D Analysis of Collision Avoidance and Goal Convergence

Authors: Marvin Becker, Johannes Köhler, Sami Haddadin, Matthias A. Müller

Abstract: Recently, many reactive trajectory planning approaches were suggested in the literature because of their inherent immediate adaption in the ever more demanding cluttered and unpredictable environments of robotic systems. However, typically those approaches are only locally reactive without considering global path planning and no guarantees for simultaneous collision avoidance and goal convergence… ▽ More Recently, many reactive trajectory planning approaches were suggested in the literature because of their inherent immediate adaption in the ever more demanding cluttered and unpredictable environments of robotic systems. However, typically those approaches are only locally reactive without considering global path planning and no guarantees for simultaneous collision avoidance and goal convergence can be given. In this paper, we study a recently developed circular field (CF)-based motion planner that combines local reactive control with global trajectory generation by adapting an artificial magnetic field such that multiple trajectories around obstacles can be evaluated. In particular, we provide a mathematically rigorous analysis of this planner in a planar environment to ensure safe motion of the controlled robot. Contrary to existing results, the derived collision avoidance analysis covers the entire CF motion planning algorithm including attractive forces for goal convergence and is not limited to a specific choice of the rotation field, i.e., our guarantees are not limited to a specific potentially suboptimal trajectory. Our Lyapunov-type collision avoidance analysis is based on the definition of an (equivalent) two-dimensional auxiliary system, which enables us to provide tight, if and only if conditions for the case of a collision with point obstacles. Furthermore, we show how this analysis naturally extends to multiple obstacles and we specify sufficient conditions for goal convergence. Finally, we provide a challenging simulation scenario with multiple non-convex point cloud obstacles and demonstrate collision avoidance and goal convergence. △ Less

Submitted 3 November, 2023; v1 submitted 28 October, 2022; originally announced October 2022.

Comments: Published in IEEE Transactions on Automatic Control (Early Access)

Distributed MPC for Self-Organized Cooperation of Multiagent Systems -- Extended Version

Authors: Matthias Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: We present a sequential distributed model predictive control (MPC) scheme for cooperative control of multi-agent systems with dynamically decoupled heterogeneous nonlinear agents subject to individual constraints. In the scheme, we explore the idea of using tracking MPC with artificial references to let agents coordinate their cooperation without external guidance. Each agent combines a tracking M… ▽ More We present a sequential distributed model predictive control (MPC) scheme for cooperative control of multi-agent systems with dynamically decoupled heterogeneous nonlinear agents subject to individual constraints. In the scheme, we explore the idea of using tracking MPC with artificial references to let agents coordinate their cooperation without external guidance. Each agent combines a tracking MPC with artificial references, the latter penalized by a suitable coupling cost. They solve an individual optimization problem for this artificial reference and an input that tracks it, only communicating the former to its neighbors in a communication graph. This puts the cooperative problem on a different layer than the handling of the dynamics and constraints, loosening the connection between the two. We provide sufficient conditions on the formulation of the cooperative problem and the coupling cost for the closed-loop system to asymptotically achieve it. Since the dynamics and the cooperative problem are only loosely connected, classical results from distributed optimization can be used to this end. We illustrate the scheme's application to consensus and formation control. △ Less

Submitted 12 June, 2024; v1 submitted 18 October, 2022; originally announced October 2022.

Comments: Extended version of https://doi.org/10.1109/TAC.2024.3407633 containing a technical proof and additional numerical examples

Robust Data-Driven Moving Horizon Estimation for Linear Discrete-Time Systems

Authors: Tobias M. Wolff, Victor G. Lopez, Matthias A. Müller

Abstract: In this paper, a robust data-driven moving horizon estimation (MHE) scheme for linear time-invariant discrete-time systems is introduced. The scheme solely relies on offline collected data without employing any system identification step. We prove practical robust exponential stability for the setting where both the online measurements and the offline collected data are corrupted by non-vanishing… ▽ More In this paper, a robust data-driven moving horizon estimation (MHE) scheme for linear time-invariant discrete-time systems is introduced. The scheme solely relies on offline collected data without employing any system identification step. We prove practical robust exponential stability for the setting where both the online measurements and the offline collected data are corrupted by non-vanishing and bounded noise. The behavior of the novel robust data-driven MHE scheme is illustrated by means of simulation examples and compared to a standard model-based MHE scheme, where the model is identified using the same offline data as for the data-driven MHE scheme. △ Less

Submitted 28 February, 2024; v1 submitted 17 October, 2022; originally announced October 2022.

Comments: 13 pages

Stability in data-driven MPC: an inherent robustness perspective

Authors: Julian Berberich, Johannes Köhler, Matthias A. Müller, Frank Allgöwer

Abstract: Data-driven model predictive control (DD-MPC) based on Willems' Fundamental Lemma has received much attention in recent years, allowing to control systems directly based on an implicit data-dependent system description. The literature contains many successful practical applications as well as theoretical results on closed-loop stability and robustness. In this paper, we provide a tutorial introduc… ▽ More Data-driven model predictive control (DD-MPC) based on Willems' Fundamental Lemma has received much attention in recent years, allowing to control systems directly based on an implicit data-dependent system description. The literature contains many successful practical applications as well as theoretical results on closed-loop stability and robustness. In this paper, we provide a tutorial introduction to DD-MPC for unknown linear time-invariant (LTI) systems with focus on (robust) closed-loop stability. We first address the scenario of noise-free data, for which we present a DD-MPC scheme with terminal equality constraints and derive closed-loop properties. In case of noisy data, we introduce a simple yet powerful approach to analyze robust stability of DD-MPC by combining continuity of DD-MPC w.r.t. noise with inherent robustness of model-based MPC, i.e., robustness of nominal MPC w.r.t. small disturbances. Moreover, we discuss how the presented proof technique allows to show closed-loop stability of a variety of DD-MPC schemes with noisy data, as long as the corresponding model-based MPC is inherently robust. △ Less

Submitted 25 August, 2022; v1 submitted 24 May, 2022; originally announced May 2022.

Comments: Final version, accepted for presentation at the 61st IEEE Conference on Decision and Control 2022. This version contains the full proof of Theorem IV.1

Linearly discounted economic MPC without terminal conditions for periodic optimal operation

Authors: Lukas Schwenkel, Alexander Hadorn, Matthias A. Müller, Frank Allgöwer

Abstract: In this work, we study economic model predictive control (MPC) in situations where the optimal operating behavior is periodic. In such a setting, the performance of a standard economic MPC scheme without terminal conditions can generally be far from optimal even with arbitrarily long prediction horizons. Whereas there are modified economic MPC schemes that guarantee optimal performance, all of the… ▽ More In this work, we study economic model predictive control (MPC) in situations where the optimal operating behavior is periodic. In such a setting, the performance of a standard economic MPC scheme without terminal conditions can generally be far from optimal even with arbitrarily long prediction horizons. Whereas there are modified economic MPC schemes that guarantee optimal performance, all of them are based on prior knowledge of the optimal period length or of the optimal periodic orbit itself. In contrast to these approaches, we propose to achieve optimality by multiplying the stage cost by a linear discount factor. This modification is not only easy to implement but also independent of any system- or cost-specific properties, making the scheme robust against online changes therein. Under standard dissipativity and controllability assumptions, we can prove that the resulting linearly discounted economic MPC without terminal conditions achieves optimal asymptotic average performance up to an error that vanishes with growing prediction horizons. Moreover, we can guarantee practical asymptotic stability of the optimal periodic orbit under the additional technical assumption that dissipativity holds with a continuous storage function. We complement these qualitative guarantees with a quantitative analysis of the transient and asymptotic average performance of the linearly discounted MPC scheme in a numerical simulation study. △ Less

Submitted 8 January, 2024; v1 submitted 6 May, 2022; originally announced May 2022.

Journal ref: Automatica, Volume 159, 2024, pp. 111393

Sample-based observability of linear discrete-time systems

Authors: Isabelle Krauss, Victor G. Lopez, Matthias A. Müller

Abstract: In this work, sample-based observability of linear discrete-time systems is studied. That is, we consider the case where the system output measurements are not available at every time instance. It is shown that some discrete-time systems exhibit particular behaviors that lead to pathological sampling. Depending on the characteristics of the system, different sampling schemes are developed that all… ▽ More In this work, sample-based observability of linear discrete-time systems is studied. That is, we consider the case where the system output measurements are not available at every time instance. It is shown that some discrete-time systems exhibit particular behaviors that lead to pathological sampling. Depending on the characteristics of the system, different sampling schemes are developed that allow the system state to be reconstructed. △ Less

Submitted 25 April, 2023; v1 submitted 13 April, 2022; originally announced April 2022.

Journal ref: Proceedings of the 2022 IEEE 61st Conference on Decision and Control (CDC), pp. 4199-4205

Practical exponential stability of a robust data-driven nonlinear predictive control scheme

Authors: Mohammad Alsalti, Victor G. Lopez, Julian Berberich, Frank Allgöwer, Matthias A. Müller

Abstract: We provide theoretical guarantees for recursive feasibility and practical exponential stability of the closed-loop system of a feedback linearizable nonlinear system when controlled by a robust data-driven nonlinear predictive control scheme. This technical report serves as a supplementary material to our recent paper "Data-driven Nonlinear Predictive Control for Feedback Linearizable Systems". Th… ▽ More We provide theoretical guarantees for recursive feasibility and practical exponential stability of the closed-loop system of a feedback linearizable nonlinear system when controlled by a robust data-driven nonlinear predictive control scheme. This technical report serves as a supplementary material to our recent paper "Data-driven Nonlinear Predictive Control for Feedback Linearizable Systems". The arguments shown in this report follow similar steps to those for the LTI case, since feedback linearizable systems are linear in transformed coordinates. However, the proof was suitably adapted to match the nonlinear setting under consideration, and the differences are emphasized throughout the proof. △ Less

Submitted 27 March, 2023; v1 submitted 3 April, 2022; originally announced April 2022.

Comments: This technical report serves as a supplementary material to our recent paper "Data-driven Nonlinear Predictive Control for Feedback Linearizable Systems"

Data-based Control of Feedback Linearizable Systems

Authors: Mohammad Alsalti, Victor G. Lopez, Julian Berberich, Frank Allgöwer, Matthias A. Müller

Abstract: We present an extension of Willems' Fundamental Lemma to the class of multi-input multi-output discrete-time feedback linearizable nonlinear systems, thus providing a data-based representation of their input-output trajectories. Two sources of uncertainty are considered. First, the unknown linearizing input is inexactly approximated by a set of basis functions. Second, the measured output data is… ▽ More We present an extension of Willems' Fundamental Lemma to the class of multi-input multi-output discrete-time feedback linearizable nonlinear systems, thus providing a data-based representation of their input-output trajectories. Two sources of uncertainty are considered. First, the unknown linearizing input is inexactly approximated by a set of basis functions. Second, the measured output data is contaminated by additive noise. Further, we propose an approach to approximate the solution of the data-based simulation and output matching problems, and show that the difference from the true solution is bounded. Finally, the results are illustrated on an example of a fully-actuated double inverted pendulum. △ Less

Submitted 16 March, 2023; v1 submitted 3 April, 2022; originally announced April 2022.

Journal ref: in IEEE Transactions on Automatic Control, 2023

A simple suboptimal moving horizon estimation scheme with guaranteed robust stability

Authors: Julian D. Schiller, Boyang Wu, Matthias A. Müller

Abstract: We propose a suboptimal moving horizon estimation (MHE) scheme for a general class of nonlinear systems. To this end, we consider an MHE formulation that optimizes over the trajectory of a robustly stable observer. Assuming that the observer admits a Lyapunov function, we show that this function is an M-step Lyapunov function for suboptimal MHE. The presented sufficient conditions can be easily ve… ▽ More We propose a suboptimal moving horizon estimation (MHE) scheme for a general class of nonlinear systems. To this end, we consider an MHE formulation that optimizes over the trajectory of a robustly stable observer. Assuming that the observer admits a Lyapunov function, we show that this function is an M-step Lyapunov function for suboptimal MHE. The presented sufficient conditions can be easily verified in practice. We illustrate the practicability of the proposed suboptimal MHE scheme with a standard nonlinear benchmark example. Here, performing a single iteration is sufficient to significantly improve the observer's estimation results under valid theoretical guarantees. △ Less

Submitted 15 July, 2022; v1 submitted 30 March, 2022; originally announced March 2022.

Journal ref: IEEE Control Systems Letters, vol. 7, pp. 19-24, 2023

State and parameter estimation for retinal laser treatment

Authors: Viktoria Kleyman, Manuel Schaller, Mario Mordmuller, Mitsuru Wilson, Ralf Brinkmann, Karl Worthmann, Matthias A. Muller

Abstract: Adequate therapeutic retinal laser irradiation needs to be adapted to the local absorption. This leads to time-consuming treatments as the laser power needs to be successively adjusted to avoid under- and overtreatment caused by too low or too high temperatures. Closed-loop control can overcome this burden by means of temperature measurements. To allow for model predictive control schemes, the cur… ▽ More Adequate therapeutic retinal laser irradiation needs to be adapted to the local absorption. This leads to time-consuming treatments as the laser power needs to be successively adjusted to avoid under- and overtreatment caused by too low or too high temperatures. Closed-loop control can overcome this burden by means of temperature measurements. To allow for model predictive control schemes, the current state and the spot-dependent absorption need to be estimated. In this paper, we thoroughly compare moving horizon estimator (MHE) and extended Kalman filter (EKF) designs for joint state and parameter estimation. We consider two different scenarios, the estimation of one or two unknown absorption coefficients. For one unknown parameter, both estimators perform very similar. For two unknown parameters, we found that the MHE benefits from active parameter constraints at the beginning of the estimation, whereas after a settling time both estimators perform again very similar as long as the parameters are inside the considered parameter bounds. △ Less

Submitted 23 March, 2022; originally announced March 2022.

A novel constraint tightening approach for robust data-driven predictive control

Authors: Christian Klöppelt, Julian Berberich, Frank Allgöwer, Matthias A. Müller

Abstract: In this paper, we present a data-driven model predictive control (MPC) scheme that is capable of stabilizing unknown linear time-invariant systems under the influence of process disturbances. To this end, Willems' lemma is used to predict the future behavior of the system. This allows the entire scheme to be set up using only a priori measured data and knowledge of an upper bound on the system ord… ▽ More In this paper, we present a data-driven model predictive control (MPC) scheme that is capable of stabilizing unknown linear time-invariant systems under the influence of process disturbances. To this end, Willems' lemma is used to predict the future behavior of the system. This allows the entire scheme to be set up using only a priori measured data and knowledge of an upper bound on the system order. First, we develop a state-feedback MPC scheme, based on input-state data, which guarantees closed-loop practical exponential stability and recursive feasibility as well as closed-loop constraint satisfaction. The scheme is extended by a suitable constraint tightening, which can also be constructed using only data. In order to control a priori unstable systems, the presented scheme contains a pre-stabilizing controller and an associated input constraint tightening. We first present the proposed data-driven MPC scheme for the case of full state measurements, and also provide extensions for obtaining similar closed-loop guarantees in case of output feedback. The presented scheme is applied to a numerical example. △ Less

Submitted 14 March, 2022; originally announced March 2022.

Comments: This paper has been submitted to International Journal of Robust and Nonlinear Control

On a Continuous-Time Version of Willems' Lemma

Authors: Victor G. Lopez, Matthias A. Müller

Abstract: In this paper, a method to represent every input-output trajectory of a continuous-time linear system in terms of previously collected data is presented. This corresponds to a continuous-time version of the well-known Willems' lemma. The result is obtained by sampling the continuous signals at regular intervals, and constructing Hankel-like structures that closely resemble their discrete-time coun… ▽ More In this paper, a method to represent every input-output trajectory of a continuous-time linear system in terms of previously collected data is presented. This corresponds to a continuous-time version of the well-known Willems' lemma. The result is obtained by sampling the continuous signals at regular intervals, and constructing Hankel-like structures that closely resemble their discrete-time counterparts. Then, it is shown how to use measured persistently excited data to design a time-varying vector of parameters that allows the generation of arbitrary piecewise differentiable trajectories. A class of input signals that satisfies the conditions for persistence of excitation is also provided. △ Less

Submitted 31 March, 2023; v1 submitted 7 March, 2022; originally announced March 2022.

Comments: 6 pages, conference paper

Journal ref: Proceedings of the 2022 IEEE 61st Conference on Decision and Control (CDC), pp. 2759-2764

Parameter estimation and model reduction for retinal laser treatment

Authors: Manuel Schaller, Mitsuru Wilson, Viktoria Kleyman, Mario Mordmüller, Ralf Brinkmann, Matthias A. Müller, Karl Worthmann

Abstract: Laser photocoagulation is one of the most frequently used treatment approaches for retinal diseases such as diabetic retinopathy and macular edema. The use of model-based control, such as Model Predictive Control (MPC), enhances a safe and effective treatment by guaranteeing temperature bounds. In general, real-time requirements for model-based control designs are not met since the temperature dis… ▽ More Laser photocoagulation is one of the most frequently used treatment approaches for retinal diseases such as diabetic retinopathy and macular edema. The use of model-based control, such as Model Predictive Control (MPC), enhances a safe and effective treatment by guaranteeing temperature bounds. In general, real-time requirements for model-based control designs are not met since the temperature distribution in the eye fundus is governed by a heat equation with a nonlinear parameter dependency. This issue is circumvented by representing the model by a lower-dimensional system which well-approximates the original model, including the parametric dependency. We combine a global-basis approach with the discrete empirical interpolation method, tailor its hyperparameters to laser photocoagulation, and show its superiority in comparison to a recently proposed method based on Taylor-series approximation. Its effectiveness is measured in computation time for MPC. We further present a case study to estimate the range of absorption parameters in porcine eyes, and by means of a theoretical and numerical sensitivity analysis we show that the sensitivity of the temperature increase is higher with respect to the absorption coefficient of the retinal pigment epithelium (RPE) than of the choroid's. △ Less

Submitted 25 February, 2022; originally announced February 2022.

Model predictive control for retinal laser treatment at 1 kHz

Authors: Manuel Schaller, Viktoria Kleyman, Mario Mordmüller, Christian Schmidt, Mitsuru Wilson, Ralf Brinkmann, Matthias A. Müller, Karl Worthmann

Abstract: Laser photocoagulation is a technique applied in the treatment of retinal diseases. While this is often done manually or using simple control schemes, we pursue an optimization-based approach, namely Model Predictive Control (MPC), to enforce bounds on the peak temperature and, thus, safety during the medical treatment procedure - despite the spot-dependent absorption of the tissue. To this end, a… ▽ More Laser photocoagulation is a technique applied in the treatment of retinal diseases. While this is often done manually or using simple control schemes, we pursue an optimization-based approach, namely Model Predictive Control (MPC), to enforce bounds on the peak temperature and, thus, safety during the medical treatment procedure - despite the spot-dependent absorption of the tissue. To this end, a repetition rate of 1 kHz is desirable rendering the real-time requirements a major challenge. We present a tailored MPC scheme using parametric model reduction, an extended Kalman filter for the parameter and state estimation, and suitably constructed stage costs and verify its applicability both in simulation and experiments with porcine eyes. Moreover, we give some insight on the implementation specifically tailored for fast numerical computations. △ Less

Submitted 24 March, 2022; v1 submitted 25 February, 2022; originally announced February 2022.

Data-driven distributed MPC of dynamically coupled linear systems

Authors: Matthias Köhler, Julian Berberich, Matthias A. Müller, Frank Allgöwer

Abstract: In this paper, we present a data-driven distributed model predictive control (MPC) scheme to stabilise the origin of dynamically coupled discrete-time linear systems subject to decoupled input constraints. The local optimisation problems solved by the subsystems rely on a distributed adaptation of the Fundamental Lemma by Willems et al., allowing to parametrise system trajectories using only measu… ▽ More In this paper, we present a data-driven distributed model predictive control (MPC) scheme to stabilise the origin of dynamically coupled discrete-time linear systems subject to decoupled input constraints. The local optimisation problems solved by the subsystems rely on a distributed adaptation of the Fundamental Lemma by Willems et al., allowing to parametrise system trajectories using only measured input-output data without explicit model knowledge. For the local predictions, the subsystems rely on communicated assumed trajectories of neighbours. Each subsystem guarantees a small deviation from these trajectories via a consistency constraint. We provide a theoretical analysis of the resulting non-iterative distributed MPC scheme, including proofs of recursive feasibility and (practical) stability. Finally, the approach is successfully applied to a numerical example. △ Less

Submitted 11 August, 2023; v1 submitted 25 February, 2022; originally announced February 2022.

Journal ref: IFAC-PapersOnLine, 55(30), 365-370 (2022)

A Lyapunov function for robust stability of moving horizon estimation

Authors: Julian D. Schiller, Simon Muntwiler, Johannes Köhler, Melanie N. Zeilinger, Matthias A. Müller

Abstract: We provide a novel robust stability analysis for moving horizon estimation (MHE) using a Lyapunov function. Additionally, we introduce linear matrix inequalities (LMIs) to verify the necessary incremental input/output-to-state stability ($δ$-IOSS) detectability condition. We consider an MHE formulation with time-discounted quadratic objective for nonlinear systems admitting an exponential $δ$-IOSS… ▽ More We provide a novel robust stability analysis for moving horizon estimation (MHE) using a Lyapunov function. Additionally, we introduce linear matrix inequalities (LMIs) to verify the necessary incremental input/output-to-state stability ($δ$-IOSS) detectability condition. We consider an MHE formulation with time-discounted quadratic objective for nonlinear systems admitting an exponential $δ$-IOSS Lyapunov function. We show that with a suitable parameterization of the MHE objective, the $δ$-IOSS Lyapunov function serves as an $M$-step Lyapunov function for MHE. Provided that the estimation horizon is chosen large enough, this directly implies exponential stability of MHE. The stability analysis is also applicable to full information estimation, where the restriction to exponential $δ$-IOSS can be relaxed. Moreover, we provide simple LMI conditions to systematically derive $δ$-IOSS Lyapunov functions, which allows us to easily verify $δ$-IOSS for a large class of nonlinear detectable systems. This is useful in the context of MHE in general, since most of the existing nonlinear (robust) stability results for MHE depend on the system being $δ$-IOSS (detectable). In combination, we thus provide a framework for designing MHE schemes with guaranteed robust exponential stability. The applicability of the proposed methods is demonstrated with a nonlinear chemical reactor process and a 12-state quadrotor model. △ Less

Submitted 8 June, 2023; v1 submitted 25 February, 2022; originally announced February 2022.

Comments: *Julian D. Schiller and Simon Muntwiler contributed equally to this paper. 16 pages, 3 figures. Published in: IEEE Transactions on Automatic Control. This version contains an additional numerical example in Section V.B

Experimental Data-Driven Model Predictive Control of a Hospital HVAC System During Regular Use

Authors: Emilio T. Maddalena, Silvio A. Muller, Rafael M. dos Santos, Christophe Salzmann, Colin N. Jones

Abstract: Herein we report a multi-zone, heating, ventilation and air-conditioning (HVAC) control case study of an industrial plant responsible for cooling a hospital surgery center. The adopted approach to guaranteeing thermal comfort and reducing electrical energy consumption is based on a statistical non-parametric, non-linear regression technique named Gaussian processes. Our study aimed at assessing th… ▽ More Herein we report a multi-zone, heating, ventilation and air-conditioning (HVAC) control case study of an industrial plant responsible for cooling a hospital surgery center. The adopted approach to guaranteeing thermal comfort and reducing electrical energy consumption is based on a statistical non-parametric, non-linear regression technique named Gaussian processes. Our study aimed at assessing the suitability of the aforementioned technique to learning the building dynamics and yielding models for our model predictive control (MPC) scheme. Experimental results gathered while the building was under regular use showcase the final controller performance while subject to a number of measured and unmeasured disturbances. Finally, we provide readers with practical details and recommendations on how to manage the computational complexity of the on-line optimization problem and obtain high-quality solutions from solvers. △ Less

Submitted 31 January, 2022; v1 submitted 14 December, 2021; originally announced December 2021.

Comments: 11 pages, 8 figures