-
Secure state estimation over Markov wireless communication channels (extended version)
Authors:
Anastasia Impicciatore,
Anastasios Tsiamis,
Yuriy Zacchia Lun,
Alessandro D'Innocenzo,
George J. Pappas
Abstract:
This note studies state estimation in wireless networked control systems with secrecy against eavesdrop**. Specifically, a sensor transmits a system state information to the estimator over a legitimate user link, and an eavesdropper overhears these data over its link independent of the user link. Each connection may be affected by packet losses and is modeled by a finite-state Markov channel (FS…
▽ More
This note studies state estimation in wireless networked control systems with secrecy against eavesdrop**. Specifically, a sensor transmits a system state information to the estimator over a legitimate user link, and an eavesdropper overhears these data over its link independent of the user link. Each connection may be affected by packet losses and is modeled by a finite-state Markov channel (FSMC), an abstraction widely used to design wireless communication systems. This paper presents a novel concept of optimal mean square expected secrecy over FSMCs and delineates the design of a secrecy parameter requiring the user mean square estimation error (MSE) to be bounded and eavesdropper MSE unbounded. We illustrate the developed results on an example of an inverted pendulum on a cart whose parameters are estimated remotely over a wireless link exposed to an eavesdropper.
△ Less
Submitted 12 September, 2022;
originally announced September 2022.
-
Learning Markov models of fading channels in wireless control networks: a regression trees based approach
Authors:
Luis Felipe Florenzan Reyes,
Francesco Smarra,
Yuriy Zacchia Lun,
Alessandro D'Innocenzo
Abstract:
Finite-state Markov models are widely used for modeling wireless channels affected by a variety of non-idealities, ranging from shadowing to interference. In an industrial environment, the derivation of a Markov model based on the wireless communication physics can be prohibitive as it requires a complete knowledge of both the communication dynamics parameters and of the disturbances/interferers.…
▽ More
Finite-state Markov models are widely used for modeling wireless channels affected by a variety of non-idealities, ranging from shadowing to interference. In an industrial environment, the derivation of a Markov model based on the wireless communication physics can be prohibitive as it requires a complete knowledge of both the communication dynamics parameters and of the disturbances/interferers. In this work, a novel methodology is proposed to learn a Markov model of a fading channel via historical data of the signal-to-interference-plus-noise-ratio (SINR). Such methodology can be used to derive a Markov jump model of a wireless control network, and thus to design a stochastic optimal controller that takes into account the interdependence between the plant and the wireless channel dynamics. The proposed method is validated by comparing its prediction accuracy and control performance with those of a stationary finite-state Markov chain derived assuming perfect knowledge of the physical channel model and parameters of a WirelessHART point-to-point communication based on the IEEE-802.15.4 standard.
△ Less
Submitted 29 April, 2021; v1 submitted 27 April, 2021;
originally announced April 2021.
-
Sufficient Lyapunov conditions for exponential mean square stability of discrete-time systems with markovian delays (extended version)
Authors:
Anastasia Impicciatore,
Maria Teresa Grifa,
Pierdomenico Pepe,
Alessandro D'Innocenzo
Abstract:
This paper introduces sufficient Lyapunov conditions guaranteeing exponential mean square stability of discrete-time systems with markovian delays. We provide a transformation of the discrete-time system with markovian delays into a discrete-time Markov jump system. Then, we extend sufficient Lyapunov conditions existing for the global asymptotic stability of discrete-time systems with delays digr…
▽ More
This paper introduces sufficient Lyapunov conditions guaranteeing exponential mean square stability of discrete-time systems with markovian delays. We provide a transformation of the discrete-time system with markovian delays into a discrete-time Markov jump system. Then, we extend sufficient Lyapunov conditions existing for the global asymptotic stability of discrete-time systems with delays digraphs to the mean square stability of discrete-time systems with markovian delays. Finally, an example is provided to illustrate the efficiency and advantage of the proposed method.
△ Less
Submitted 26 April, 2021;
originally announced April 2021.
-
Optimal output-feedback control and separation principle for Markov jump linear systems modeling wireless networked control scenarios (extended version)
Authors:
Anastasia Impicciatore,
Yuriy Zacchia Lun,
Pierdomenico Pepe,
Alessandro D'Innocenzo
Abstract:
The communication channels used to convey information between the components of wireless networked control systems (WNCSs) are subject to packet losses due to time-varying fading and interference. We consider a wireless networked control scenario, where the packet loss occurs in both the sensor-controller link (sensing link) and the controller-actuator link (actuation link). Moreover, we consider…
▽ More
The communication channels used to convey information between the components of wireless networked control systems (WNCSs) are subject to packet losses due to time-varying fading and interference. We consider a wireless networked control scenario, where the packet loss occurs in both the sensor-controller link (sensing link) and the controller-actuator link (actuation link). Moreover, we consider one time-step delay mode observations of the actuation link. While the problems of state feedback optimal control and stabilizability conditions for systems with one time-step delay mode observations of the actuation link have been already solved, we study the optimal output feedback control problem, and we derive a separation principle for the aforementioned wireless networked control scenario. Particularly, we show that the optimal control problem (with one time-step delay in the mode observation of actuation link state) and the optimal filtering problem can be solved independently under a TCP-like communication scheme.
△ Less
Submitted 22 March, 2021; v1 submitted 16 March, 2021;
originally announced March 2021.
-
NeurOpt: Neural network based optimization for building energy management and climate control
Authors:
Achin Jain,
Francesco Smarra,
Enrico Reticcioli,
Alessandro D'Innocenzo,
Manfred Morari
Abstract:
Model predictive control (MPC) can provide significant energy cost savings in building operations in the form of energy-efficient control with better occupant comfort, lower peak demand charges, and risk-free participation in demand response. However, the engineering effort required to obtain physics-based models of buildings is considered to be the biggest bottleneck in making MPC scalable to rea…
▽ More
Model predictive control (MPC) can provide significant energy cost savings in building operations in the form of energy-efficient control with better occupant comfort, lower peak demand charges, and risk-free participation in demand response. However, the engineering effort required to obtain physics-based models of buildings is considered to be the biggest bottleneck in making MPC scalable to real buildings. In this paper, we propose a data-driven control algorithm based on neural networks to reduce this cost of model identification. Our approach does not require building domain expertise or retrofitting of existing heating and cooling systems. We validate our learning and control algorithms on a two-story building with ten independently controlled zones, located in Italy. We learn dynamical models of energy consumption and zone temperatures with high accuracy and demonstrate energy savings and better occupant comfort compared to the default system controller.
△ Less
Submitted 4 May, 2020; v1 submitted 21 January, 2020;
originally announced January 2020.
-
Stabilizability of Markov jump linear systems modeling wireless networked control scenarios (extended version)
Authors:
Yuriy Zacchia Lun,
Alessandro D'Innocenzo
Abstract:
The communication channels used to convey information between the components of wireless networked control systems (WNCSs) are subject to packet losses due to time-varying fading and interference. The WNCSs with missing packets can be modeled as Markov jump linear systems with one time-step delayed mode observations. While the problem of the optimal linear quadratic regulation for such systems has…
▽ More
The communication channels used to convey information between the components of wireless networked control systems (WNCSs) are subject to packet losses due to time-varying fading and interference. The WNCSs with missing packets can be modeled as Markov jump linear systems with one time-step delayed mode observations. While the problem of the optimal linear quadratic regulation for such systems has been already solved, we derive the necessary and sufficient conditions for stabilizability. We also show, with an example considering a communication channel model based on WirelessHART (a on-the-market wireless communication standard specifically designed for process automation), that such conditions are essential to the analysis of WNCSs where packet losses are modeled with Bernoulli random variables representing the expected value of the real random process governing the channel.
△ Less
Submitted 4 September, 2019; v1 submitted 29 July, 2019;
originally announced July 2019.
-
Linear quadratic regulation of polytopic time-inhomogeneous Markov jump linear systems (extended version)
Authors:
Y. Zacchia Lun,
A. Abate,
A. D'Innocenzo
Abstract:
In most real cases transition probabilities between operational modes of Markov jump linear systems cannot be computed exactly and are time-varying. We take into account this aspect by considering Markov jump linear systems where the underlying Markov chain is polytopic and time-inhomogeneous, i.e. its transition probability matrix is varying over time, with variations that are arbitrary within a…
▽ More
In most real cases transition probabilities between operational modes of Markov jump linear systems cannot be computed exactly and are time-varying. We take into account this aspect by considering Markov jump linear systems where the underlying Markov chain is polytopic and time-inhomogeneous, i.e. its transition probability matrix is varying over time, with variations that are arbitrary within a polytopic set of stochastic matrices. We address and solve for this class of systems the infinite-horizon optimal control problem. In particular, we show that the optimal controller can be obtained from a set of coupled algebraic Riccati equations, and that for mean square stabilizable systems the optimal finite-horizon cost corresponding to the solution to a parsimonious set of coupled difference Riccati equations converges exponentially fast to the optimal infinite-horizon cost related to the set of coupled algebraic Riccati equations. All the presented concepts are illustrated on a numerical example showing the efficiency of the provided solution.
△ Less
Submitted 7 March, 2019;
originally announced March 2019.
-
Approximate Abstractions of Markov Chains with Interval Decision Processes (Extended Version)
Authors:
Y. Zacchia Lun,
J. Wheatley,
A. D'Innocenzo,
A. Abate
Abstract:
This work introduces a new abstraction technique for reducing the state space of large, discrete-time labelled Markov chains. The abstraction leverages the semantics of interval Markov decision processes and the existing notion of approximate probabilistic bisimulation. Whilst standard abstractions make use of abstract points that are taken from the state space of the concrete model and which serv…
▽ More
This work introduces a new abstraction technique for reducing the state space of large, discrete-time labelled Markov chains. The abstraction leverages the semantics of interval Markov decision processes and the existing notion of approximate probabilistic bisimulation. Whilst standard abstractions make use of abstract points that are taken from the state space of the concrete model and which serve as representatives for sets of concrete states, in this work the abstract structure is constructed considering abstract points that are not necessarily selected from the states of the concrete model, rather they are a function of these states. The resulting model presents a smaller one-step bisimulation error, when compared to a like-sized, standard Markov chain abstraction. We outline a method to perform probabilistic model checking, and show that the computational complexity of the new method is comparable to that of standard abstractions based on approximate probabilistic bisimulations.
△ Less
Submitted 23 April, 2018;
originally announced April 2018.
-
Cyber-Physical Systems Security: a Systematic Map** Study
Authors:
Yuriy Zacchia Lun,
Alessandro D'Innocenzo,
Ivano Malavolta,
Maria Domenica Di Benedetto
Abstract:
Cyber-physical systems are integrations of computation, networking, and physical processes. Due to the tight cyber-physical coupling and to the potentially disrupting consequences of failures, security here is one of the primary concerns. Our systematic map** study sheds some light on how security is actually addressed when dealing with cyber-physical systems. The provided systematic map of 118…
▽ More
Cyber-physical systems are integrations of computation, networking, and physical processes. Due to the tight cyber-physical coupling and to the potentially disrupting consequences of failures, security here is one of the primary concerns. Our systematic map** study sheds some light on how security is actually addressed when dealing with cyber-physical systems. The provided systematic map of 118 selected studies is based on, for instance, application fields, various system components, related algorithms and models, attacks characteristics and defense strategies. It presents a powerful comparison framework for existing and future research on this hot topic, important for both industry and academia.
△ Less
Submitted 31 May, 2016;
originally announced May 2016.
-
A sub-optimal solution for optimal control of linear systems with unmeasurable switching delays
Authors:
Antonio Cicone,
Alessandro D'Innocenzo,
Nicola Guglielmi,
Linda Laglia
Abstract:
We consider the optimal control design problem for discrete-time LTI systems with state feedback, when the actuation signal is subject to unmeasurable switching propagation delays, due to e.g. the routing in a multi-hop communication network and/or jitter. In particular, we set up a constrained optimization problem where the cost function is the worst-case $\mathcal{L}_2$ norm for all admissible s…
▽ More
We consider the optimal control design problem for discrete-time LTI systems with state feedback, when the actuation signal is subject to unmeasurable switching propagation delays, due to e.g. the routing in a multi-hop communication network and/or jitter. In particular, we set up a constrained optimization problem where the cost function is the worst-case $\mathcal{L}_2$ norm for all admissible switching delays. We first show how to model these systems as pure switching linear systems, and as main contribution of the paper we provide an algorithm to compute a sub-optimal solution.
△ Less
Submitted 7 September, 2015;
originally announced September 2015.
-
Co-design of controller and routing redundancy over a wireless network
Authors:
G. D. Di Girolamo,
A. D'Innocenzo,
M. D. Di Benedetto
Abstract:
In this paper we investigate the exploitation of redundancy when routing actuation data to a discrete-time LTI system connected to the controller via a wireless network affected by packet drops. We assume that actuation packets can be delivered from the controller to the actuator via multiple paths, each associated with a delay and a packet loss probability. We show that the joint design of contro…
▽ More
In this paper we investigate the exploitation of redundancy when routing actuation data to a discrete-time LTI system connected to the controller via a wireless network affected by packet drops. We assume that actuation packets can be delivered from the controller to the actuator via multiple paths, each associated with a delay and a packet loss probability. We show that the joint design of controller gain and routing redundancy exploitation can tremendously improve the control performance. To achieve this goal we set up and solve a LQR problem for a class of systems that extends discrete-time Markov Jump Linear Systems, in that both continuous and discrete control signals can be actuated.
△ Less
Submitted 22 September, 2015; v1 submitted 21 August, 2015;
originally announced August 2015.
-
Modeling, analysis and design of linear systems with switching delays
Authors:
R. M. Jungers,
A. D'Innocenzo,
M. D. Di Benedetto
Abstract:
We consider the modeling, stability analysis and controller design problems for discrete-time LTI systems with state feedback, when the actuation signal is subject to switching propagation delays, due to e.g. the routing in a multi-hop communication network. We show how to model these systems as regular switching linear systems and, as a corollary, we provide an (exponential-time) algorithm for ro…
▽ More
We consider the modeling, stability analysis and controller design problems for discrete-time LTI systems with state feedback, when the actuation signal is subject to switching propagation delays, due to e.g. the routing in a multi-hop communication network. We show how to model these systems as regular switching linear systems and, as a corollary, we provide an (exponential-time) algorithm for robust stability analysis. We also show that the general stability analysis problem is NP-hard in general. Even though the systems studied here are inherently switching systems, we show that their particular structure allows for analytical understanding of the dynamics, and even efficient algorithms for some problems: for instance, we give an algorithm that computes in a finite number of steps the minimal look-ahead knowledge of the delays necessary to achieve controllability. We finally show that when the switching signal cannot be measured it can be necessary to use nonlinear controllers for stabilizing a linear plant.
△ Less
Submitted 8 January, 2014;
originally announced January 2014.
-
Fault detection and isolation of malicious nodes in MIMO Multi-hop Control Networks
Authors:
A. D'Innocenzo,
M. D. Di Benedetto,
F. Smarra
Abstract:
A MIMO Multi-hop Control Network (MCN) consists of a MIMO LTI system where the communication between sensors, actuators and computational units is supported by a (wireless) multi-hop communication network, and data flow is performed using scheduling and routing of sensing and actuation data. We provide necessary and sufficient conditions on the plant dynamics and on the communication protocol conf…
▽ More
A MIMO Multi-hop Control Network (MCN) consists of a MIMO LTI system where the communication between sensors, actuators and computational units is supported by a (wireless) multi-hop communication network, and data flow is performed using scheduling and routing of sensing and actuation data. We provide necessary and sufficient conditions on the plant dynamics and on the communication protocol configuration such that the Fault Detection and Isolation (FDI) problem of failures and malicious attacks to communication nodes can be solved.
△ Less
Submitted 9 September, 2013;
originally announced September 2013.
-
Optimal co-design of control, scheduling and routing in multi-hop control networks
Authors:
F. Smarra,
A. D'Innocenzo,
M. D. Di Benedetto
Abstract:
A Multi-hop Control Network consists of a plant where the communication between sensors, actuators and computational units is supported by a (wireless) multi-hop communication network, and data flow is performed using scheduling and routing of sensing and actuation data. Given a SISO LTI plant, we will address the problem of co-designing a digital controller and the network parameters (scheduling…
▽ More
A Multi-hop Control Network consists of a plant where the communication between sensors, actuators and computational units is supported by a (wireless) multi-hop communication network, and data flow is performed using scheduling and routing of sensing and actuation data. Given a SISO LTI plant, we will address the problem of co-designing a digital controller and the network parameters (scheduling and routing) in order to guarantee stability and maximize a performance metric on the transient response to a step input, with constraints on the control effort, on the output overshoot and on the bandwidth of the communication channel. We show that the above optimization problem is a polynomial optimization problem, which is generally NP-hard. We provide sufficient conditions on the network topology, scheduling and routing such that it is computationally feasible, namely such that it reduces to a convex optimization problem.
△ Less
Submitted 31 August, 2012; v1 submitted 28 August, 2012;
originally announced August 2012.
-
Feedback stabilization of dynamical systems with switched delays
Authors:
Raphael M. Jungers,
Alessandro D'Innocenzo,
Maria D. Di Benedetto
Abstract:
We analyze a classification of two main families of controllers that are of interest when the feedback loop is subject to switching propagation delays due to routing via a wireless multi-hop communication network. We show that we can cast this problem as a subclass of classical switching systems, which is a non-trivial generalization of classical LTI systems with timevarying delays. We consider bo…
▽ More
We analyze a classification of two main families of controllers that are of interest when the feedback loop is subject to switching propagation delays due to routing via a wireless multi-hop communication network. We show that we can cast this problem as a subclass of classical switching systems, which is a non-trivial generalization of classical LTI systems with timevarying delays. We consider both cases where delay-dependent and delay independent controllers are used, and show that both can be modeled as switching systems with unconstrained switchings. We provide NP-hardness results for the stability verification problem, and propose a general methodology for approximate stability analysis with arbitrary precision. We finally give evidence that non-trivial design problems arise for which new algorithmic methods are needed.
△ Less
Submitted 21 July, 2012;
originally announced July 2012.
-
Link Failure Detection in Multi-hop Control Networks
Authors:
Alessandro D'Innocenzo,
Maria Domenica Di Benedetto,
Emmanuele Serra
Abstract:
A Multi-hop Control Network (MCN) consists of a plant where the communication between sensors, actuators and computational unit is supported by a wireless multi-hop communication network, and data flow is performed using scheduling and routing of sensing and actuation data. We characterize the problem of detecting the failure of links of the radio connectivity graph and provide necessary and suffi…
▽ More
A Multi-hop Control Network (MCN) consists of a plant where the communication between sensors, actuators and computational unit is supported by a wireless multi-hop communication network, and data flow is performed using scheduling and routing of sensing and actuation data. We characterize the problem of detecting the failure of links of the radio connectivity graph and provide necessary and sufficient conditions on the plant dynamics and on the communication protocol. We also provide a methodology to \emph{explicitly} design the network topology, scheduling and routing of a communication protocol in order to satisfy the above conditions.
△ Less
Submitted 26 August, 2011;
originally announced August 2011.
-
Digital Self Triggered Robust Control of Nonlinear Systems
Authors:
M. D. Di Benedetto,
S. Di Gennaro,
A. D'Innocenzo
Abstract:
In this paper we develop novel results on self triggering control of nonlinear systems, subject to perturbations and actuation delays. First, considering an unperturbed nonlinear system with bounded actuation delays, we provide conditions that guarantee the existence of a self triggering control strategy stabilizing the closed--loop system. Then, considering parameter uncertainties, disturbances,…
▽ More
In this paper we develop novel results on self triggering control of nonlinear systems, subject to perturbations and actuation delays. First, considering an unperturbed nonlinear system with bounded actuation delays, we provide conditions that guarantee the existence of a self triggering control strategy stabilizing the closed--loop system. Then, considering parameter uncertainties, disturbances, and bounded actuation delays, we provide conditions guaranteeing the existence of a self triggering strategy, that keeps the state arbitrarily close to the equilibrium point. In both cases, we provide a methodology for the computation of the next execution time. We show on an example the relevant benefits obtained with this approach, in terms of energy consumption, with respect to control algorithms based on a constant sampling, with a sensible reduction of the average sampling time.
△ Less
Submitted 25 August, 2011;
originally announced August 2011.
-
Fault Tolerant Stabilizability of Multi-Hop Control Networks
Authors:
Maria D. Di Benedetto,
Alessandro D'Innocenzo,
Emmanuele Serra
Abstract:
A Multi-hop Control Network (MCN) consists of a plant where the communication between sensor, actuator and computational unit is supported by a wireless multi-hop communication network, and data flow is performed using scheduling and routing of sensing and actuation data. We address the problem of characterizing controllability and observability of a MCN, by means of necessary and sufficient condi…
▽ More
A Multi-hop Control Network (MCN) consists of a plant where the communication between sensor, actuator and computational unit is supported by a wireless multi-hop communication network, and data flow is performed using scheduling and routing of sensing and actuation data. We address the problem of characterizing controllability and observability of a MCN, by means of necessary and sufficient conditions on the plant dynamics and on the communication scheduling and routing. We provide a methodology to design scheduling and routing, in order to satisfy controllability and observability of a MCN for any fault occurrence in a given set of configurations of failures.
△ Less
Submitted 7 April, 2011; v1 submitted 22 March, 2011;
originally announced March 2011.