Showing 1–11 of 11 results for author: Martinelli, A

Interconnection of (Q,S,R)-Dissipative Systems in Discrete Time

Authors: Andrea Martinelli, Ahmed Aboudonia, John Lygeros

Abstract: Discrete-time systems cannot be passive unless there is a direct feedthrough from the input to the output. For passivity-based control to be exploited nevertheless, some authors introduce virtual outputs, while others rely on continuous-time passivity and then apply discretization techniques that preserve passivity in discrete time. Here we argue that quadratic supply rates incorporate and extend… ▽ More Discrete-time systems cannot be passive unless there is a direct feedthrough from the input to the output. For passivity-based control to be exploited nevertheless, some authors introduce virtual outputs, while others rely on continuous-time passivity and then apply discretization techniques that preserve passivity in discrete time. Here we argue that quadratic supply rates incorporate and extend the effect of virtual outputs, allowing one to exploit dissipativity properties directly in discrete time. We derive decentralized (Q,S,R)-dissipativity conditions for a set of nonlinear systems interconnected with arbitrary topology, so that the overall network is guaranteed to be stable. For linear systems, we develop dissipative control conditions that are linear in the supply rate matrices. To demonstrate the validity of our methods, we provide numerical examples in the context of islanded microgrids. △ Less

Submitted 24 June, 2024; v1 submitted 14 November, 2023; originally announced November 2023.

Data-driven optimal control via linear programming: boundedness guarantees

Authors: Lucia Falconi, Andrea Martinelli, John Lygeros

Abstract: The linear programming (LP) approach is, together with value iteration and policy iteration, one of the three fundamental methods to solve optimal control problems in a dynamic programming setting. Despite its simple formulation, versatility, and predisposition to be employed in model-free settings, the LP approach has not enjoyed the same popularity as the other methods. The reason is the often p… ▽ More The linear programming (LP) approach is, together with value iteration and policy iteration, one of the three fundamental methods to solve optimal control problems in a dynamic programming setting. Despite its simple formulation, versatility, and predisposition to be employed in model-free settings, the LP approach has not enjoyed the same popularity as the other methods. The reason is the often poor scalability of the exact LP approach and the difficulty to obtain bounded solutions for a reasonable amount of constraints. We mitigate these issues here, by investigating fundamental geometric features of the LP and develo** sufficient conditions to guarantee finite solutions with minimal constraints. In the model-free context, we show that boundedness can be guaranteed by a suitable choice of dataset and objective function. △ Less

Submitted 30 October, 2023; originally announced October 2023.

Detection of a very serious error in the paper: "On identifiability of nonlinear ODE models and applications in viral dynamics"

Authors: Agostino Martinelli

Abstract: This erratum highlights a very serious error in a paper published by SIAM Review in 2011. The error is in Section 6.2 of [1]. It is very important to notify this error because of the following two reasons: (i) [1] is one of the most cited contributions in the field of identifiability of viral dynamics models, and (ii)the error is relevant because, as a result of it, a very popular viral model (per… ▽ More This erratum highlights a very serious error in a paper published by SIAM Review in 2011. The error is in Section 6.2 of [1]. It is very important to notify this error because of the following two reasons: (i) [1] is one of the most cited contributions in the field of identifiability of viral dynamics models, and (ii)the error is relevant because, as a result of it, a very popular viral model (perhaps the most popular in the field of HIV dynamics) has been classified as identifiable. In contrast, three of its parameters are not identifiable, even locally. This erratum first proves the non uniqueness of the three unidentifiable parameters by exhibiting infinitely many distinct but indistinguishable values of them. The non uniqueness is even local. Then, this erratum details the error made by the authors of [1] which produced the claimed (but false) local identifiability of all the model parameters. △ Less

Submitted 27 April, 2023; originally announced April 2023.

Comments: SIAM review refuses to publish this erratum. This is in my opinion a very wrong decision which significantly deteriorates the rank of this journal. Or, even worse, this decision highlights an unfortunately low rank of this journal

Report number: https://inria.hal.science/hal-04419008

Identifiability of nonlinear ODE Models with Time-Varying Parameters: the General Analytical Solution and Applications in Viral Dynamics

Authors: Agostino Martinelli

Abstract: Identifiability is a structural property of any ODE model characterized by a set of unknown parameters. It describes the possibility of determining the values of these parameters from fusing the observations of the system inputs and outputs. This paper finds the general analytical solution of this fundamental problem and, based on this, provides a general and automated analytical method to determi… ▽ More Identifiability is a structural property of any ODE model characterized by a set of unknown parameters. It describes the possibility of determining the values of these parameters from fusing the observations of the system inputs and outputs. This paper finds the general analytical solution of this fundamental problem and, based on this, provides a general and automated analytical method to determine the identifiability of the unknown parameters. In particular, the method can handle any model, regardless of its complexity and type of non-linearity, and provides the identifiability of the parameters even when they are time-varying. In addition, it is automatic as it simply needs to follow the steps of a systematic procedure that only requires to perform the calculation of derivatives and matrix ranks. Time-varying parameters are treated as unknown inputs and their identification is based on the very recent analytical solution of the unknown input observability problem [1, 2]. The method is used to determine the identifiability of the unknown time-varying parameters that characterize two non-linear models in the field of viral dynamics (HIV and Covid-19) and a non-linear model that characterizes the genetic toggle switch. New fundamental properties that characterize these models are determined and discussed in detail through a comparison with the state-of-the-art results. In particular, regarding the very popular HIV ODE model and the genetic toggle switch model, the method automatically finds new important results that are in contrast with the results in the current literature. △ Less

Submitted 4 December, 2023; v1 submitted 24 November, 2022; originally announced November 2022.

Reconfigurable Plug-and-play Distributed Model Predictive Control for Reference Tracking

Authors: Ahmed Aboudonia, Andrea Martinelli, Nicolas Hoischen, John Lygeros

Abstract: A plug-and-play model predictive control (PnP MPC) scheme is proposed for varying-topology networks to track piecewise constant references. The proposed scheme allows subsystems to occasionally join and leave the network while preserving asymptotic stability and recursive feasibility and comprises two main phases. In the redesign phase, passivity-based control is used to ensure that asymptotic sta… ▽ More A plug-and-play model predictive control (PnP MPC) scheme is proposed for varying-topology networks to track piecewise constant references. The proposed scheme allows subsystems to occasionally join and leave the network while preserving asymptotic stability and recursive feasibility and comprises two main phases. In the redesign phase, passivity-based control is used to ensure that asymptotic stability of the network is preserved. In the transition phase, reconfigurable terminal ingredients are used to ensure that the distributed MPC problem is initially feasible after the PnP operation. The efficacy of the proposed scheme is evaluated by applying it to a network of mass-spring-damper systems and comparing it to a benchmark scheme. It is found that the novel redesign phase results in faster PnP operations, whereas the novel transition phase increases flexibility by accepting more requests. △ Less

Submitted 16 November, 2022; v1 submitted 19 July, 2022; originally announced July 2022.

Data-Driven Optimal Control of Affine Systems: A Linear Programming Perspective

Authors: Andrea Martinelli, Matilde Gargiani, Marina Draskovic, John Lygeros

Abstract: In this letter, we discuss the problem of optimal control for affine systems in the context of data-driven linear programming. First, we introduce a unified framework for the fixed point characterization of the value function, Q-function and relaxed Bellman operators. Then, in a model-free setting, we show how to synthesize and estimate Bellman inequalities from a small but sufficiently rich datas… ▽ More In this letter, we discuss the problem of optimal control for affine systems in the context of data-driven linear programming. First, we introduce a unified framework for the fixed point characterization of the value function, Q-function and relaxed Bellman operators. Then, in a model-free setting, we show how to synthesize and estimate Bellman inequalities from a small but sufficiently rich dataset. To guarantee exploration richness, we complete the extension of Willem's fundamental lemma to affine systems. △ Less

Submitted 11 July, 2022; v1 submitted 22 March, 2022; originally announced March 2022.

Journal ref: IEEE Control Systems Letters, vol. 6, pp. 3092-3097, 2022

On the Synthesis of Bellman Inequalities for Data-Driven Optimal Control

Authors: Andrea Martinelli, Matilde Gargiani, John Lygeros

Abstract: In the context of the linear programming (LP) approach to data-driven control, one assumes that the dynamical system is unknown but can be observed indirectly through data on its evolution. Both theoretical and empirical evidence suggest that a desired suboptimality gap is often only achieved with massive exploration of the state-space. In case of linear systems, we discuss how a relatively small… ▽ More In the context of the linear programming (LP) approach to data-driven control, one assumes that the dynamical system is unknown but can be observed indirectly through data on its evolution. Both theoretical and empirical evidence suggest that a desired suboptimality gap is often only achieved with massive exploration of the state-space. In case of linear systems, we discuss how a relatively small but sufficiently rich dataset can be exploited to generate new constraints offline and without observing the corresponding transitions. Moreover, we show how to reconstruct the associated unknown stage-costs and, when the system is stochastic, we offer insights on the related problem of estimating the expected value in the Bellman operator without re-initializing the dynamics in the same state-input pairs. △ Less

Submitted 27 September, 2021; originally announced September 2021.

Passivity-based Decentralized Control for Discrete-time Large-scale Systems

Authors: Ahmed Aboudonia, Andrea Martinelli, John Lygeros

Abstract: Passivity theory has recently contributed to develo** decentralized control schemes for large-scale systems. Many decentralized passivity-based control schemes are designed in continuous-time. It is well-known, however, that the passivity properties of continuous-time systems may be lost under discretization. In this work, we present a novel stabilizing decentralized control scheme by ensuring p… ▽ More Passivity theory has recently contributed to develo** decentralized control schemes for large-scale systems. Many decentralized passivity-based control schemes are designed in continuous-time. It is well-known, however, that the passivity properties of continuous-time systems may be lost under discretization. In this work, we present a novel stabilizing decentralized control scheme by ensuring passivity for discrete-time systems directly and thus avoiding the issue of passivity preservation. The controller is synthesized by locally solving a semidefinite program offline for each subsystem in a decentralized fashion. This program comprises local conditions ensuring that the corresponding subsystem is locally passive. Passivity is ensured with respect to a local virtual output which is different from the local actual output. The program also comprises local conditions ensuring that the local passivity of all subsystems implies the asymptotic stability of the whole system. The performance of the proposed controller is evaluated on a case study in DC microgrids. △ Less

Submitted 15 July, 2021; originally announced July 2021.

Control of Networked Systems by Clustering: The Degree of Freedom Concept

Authors: Andrea Martinelli, John Lygeros

Abstract: We address the problem of local flux redistribution in networked systems. The aim is to detect a suitable cluster which is able to locally adsorb a disturbance by means of an appropriate redistribution of control load among its nodes, such that no external node is affected. Traditional clustering measures are not suitable for our purpose, since they do not explicitly take into account the structur… ▽ More We address the problem of local flux redistribution in networked systems. The aim is to detect a suitable cluster which is able to locally adsorb a disturbance by means of an appropriate redistribution of control load among its nodes, such that no external node is affected. Traditional clustering measures are not suitable for our purpose, since they do not explicitly take into account the structural conditions for disturbance containment. We propose a new measure based on the concept of degree of freedom for a cluster, and we introduce a heuristic procedure to quickly select a set of nodes according to this measure. Finally, we show an application of the method in the context of DC microgrids voltage control. △ Less

Submitted 21 April, 2020; originally announced April 2020.

Rank Conditions for Observability and Controllability for Time-varying Nonlinear Systems

Authors: Agostino Martinelli

Abstract: This paper provides the extension of the observability rank condition and the extension of the controllability rank condition to time-varying nonlinear systems. Previous conditions to check the state observability and controllability, only account for nonlinear systems that do not explicitly depend on time, or, for time-varying systems, they only account for the linear case. In this paper, the gen… ▽ More This paper provides the extension of the observability rank condition and the extension of the controllability rank condition to time-varying nonlinear systems. Previous conditions to check the state observability and controllability, only account for nonlinear systems that do not explicitly depend on time, or, for time-varying systems, they only account for the linear case. In this paper, the general analytic conditions are provided. The paper shows that both these two new conditions (the extended observability rank condition and the extended controllability rank condition) reduce to the well known rank conditions for observability and controllability in the two simpler cases of time-varying linear systems and time-invariant nonlinear systems. The proposed new conditions work automatically and can deal with any system, independently of its complexity (state dimension, type of nonlinearity, etc). Simple examples illustrate both these conditions. In addition, the two new conditions are used to study the observability and the controllability properties of a lunar module. For this system, the dynamics exhibit an explicit time-dependence due to the variation of the weight and the variation of the moment of inertia. These variations are a consequence of the fuel consumption. To study the observability and the controllability properties of this system, the extended observability rank condition and the extended controllability rank condition introduced by this paper are required. The paper shows that, even under the constraint that the main rocket engine delivers constant power, the state is weakly locally controllable. Additionally, it is weakly locally observable up to the yaw angle. △ Less

Submitted 21 March, 2020; originally announced March 2020.

Comments: 28 pages, 1 figure

Data-driven optimal control with a relaxed linear program

Authors: Andrea Martinelli, Matilde Gargiani, John Lygeros

Abstract: The linear programming (LP) approach has a long history in the theory of approximate dynamic programming. When it comes to computation, however, the LP approach often suffers from poor scalability. In this work, we introduce a relaxed version of the Bellman operator for q-functions and prove that it is still a monotone contraction map** with a unique fixed point. In the spirit of the LP approach… ▽ More The linear programming (LP) approach has a long history in the theory of approximate dynamic programming. When it comes to computation, however, the LP approach often suffers from poor scalability. In this work, we introduce a relaxed version of the Bellman operator for q-functions and prove that it is still a monotone contraction map** with a unique fixed point. In the spirit of the LP approach, we exploit the new operator to build a relaxed linear program (RLP). Compared to the standard LP formulation, our RLP has only one family of constraints and half the decision variables, making it more scalable and computationally efficient. For deterministic systems, the RLP trivially returns the correct q-function. For stochastic linear systems in continuous spaces, the solution to the RLP preserves the minimizer of the optimal q-function, hence retrieves the optimal policy. Theoretical results are backed up in simulation where we solve sampled versions of the LPs with data collected by interacting with the environment. For general nonlinear systems, we observe that the RLP again tends to preserve the minimizers of the solution to the LP, though the relative performance is influenced by the specific geometry of the problem. △ Less

Submitted 30 November, 2020; v1 submitted 19 March, 2020; originally announced March 2020.