-
An Equivalent Circuit Workflow for Unconstrained Optimization
Authors:
Aayushya Agarwal,
Carmel Fiscko,
Soummya Kar,
Larry Pileggi,
Bruno Sinopoli
Abstract:
We introduce a new workflow for unconstrained optimization whereby objective functions are mapped onto a physical domain to more easily design algorithms that are robust to hyperparameters and achieve fast convergence rates. Specifically, we represent optimization problems as an equivalent circuit that are then solved solely as nonlinear circuits using robust solution methods. The equivalent circu…
▽ More
We introduce a new workflow for unconstrained optimization whereby objective functions are mapped onto a physical domain to more easily design algorithms that are robust to hyperparameters and achieve fast convergence rates. Specifically, we represent optimization problems as an equivalent circuit that are then solved solely as nonlinear circuits using robust solution methods. The equivalent circuit models the trajectory of component-wise scaled gradient flow problem as the transient response of the circuit for which the steady-state coincides with a critical point of the objective function. The equivalent circuit model leverages circuit domain knowledge to methodically design new optimization algorithms that would likely not be developed without a physical model. We incorporate circuit knowledge into optimization methods by 1) enhancing the underlying circuit model for fast numerical analysis, 2) controlling the optimization trajectory by designing the nonlinear circuit components, and 3) solving for step sizes using well-known methods from the circuit simulation. We first establish the necessary conditions that the controls must fulfill for convergence. We show that existing descent algorithms can be re-derived as special cases of this approach and derive new optimization algorithms that are developed with insights from a circuit-based model. The new algorithms can be designed to be robust to hyperparameters, achieve convergence rates comparable or faster than state of the art methods, and are applicable to optimizing a variety of both convex and nonconvex problems.
△ Less
Submitted 23 May, 2023;
originally announced May 2023.
-
CANE: A Cascade-Control Approach for Network-Assisted Video QoE Management
Authors:
Mehdi Hosseinzadeh,
Karthick Shankar,
Maria Apostolaki,
Jay Ramachandran,
Steven Adams,
Vyas Sekar,
Bruno Sinopoli
Abstract:
Prior efforts have shown that network-assisted schemes can improve the Quality-of-Experience (QoE) and QoE fairness when multiple video players compete for bandwidth. However, realizing network-assisted schemes in practice is challenging, as: i) the network has limited visibility into the client players' internal state and actions; ii) players' actions may nullify or negate the network's actions;…
▽ More
Prior efforts have shown that network-assisted schemes can improve the Quality-of-Experience (QoE) and QoE fairness when multiple video players compete for bandwidth. However, realizing network-assisted schemes in practice is challenging, as: i) the network has limited visibility into the client players' internal state and actions; ii) players' actions may nullify or negate the network's actions; and iii) the players' objectives might be conflicting. To address these challenges, we formulate network-assisted QoE optimization through a cascade control abstraction. This informs the design of CANE, a practical network-assisted QoE framework. CANE uses machine learning techniques to approximate each player's behavior as a black-box model and model predictive control to achieve a near-optimal solution. We evaluate CANE through realistic simulations and show that CANE improves multiplayer QoE fairness by ~50% compared to pure client-side adaptive bitrate algorithms and by ~20% compared to uniform traffic sha**.
△ Less
Submitted 13 January, 2023;
originally announced January 2023.
-
Optimal Active Fault Detection in Inverter-Based Grids
Authors:
Mohammad Pirani,
Mehdi Hosseinzadeh,
Joshua A. Taylor,
Bruno Sinopoli
Abstract:
Ground faults in converter-based grids can be difficult to detect because, unlike in grids with synchronous machines, they often do not result in large currents. One recent strategy is for each converter to inject a perturbation that makes faults easier to distinguish from normal operation. In this paper, we construct optimal perturbation sequences for use with the Multiple Model Kalman Filter. Th…
▽ More
Ground faults in converter-based grids can be difficult to detect because, unlike in grids with synchronous machines, they often do not result in large currents. One recent strategy is for each converter to inject a perturbation that makes faults easier to distinguish from normal operation. In this paper, we construct optimal perturbation sequences for use with the Multiple Model Kalman Filter. The perturbations maximize the difference between faulty and fault-free operation while respecting limits on performance degradation. Simulations show that the optimal input sequence increases the confidence of fault detection while decreasing detection time. It is shown that there is a tradeoff between detection and degradation of the control performance, and that the method is robust to parameter variations.
△ Less
Submitted 14 September, 2022;
originally announced September 2022.
-
MPC-Based Emergency Vehicle-Centered Multi-Intersection Traffic Control
Authors:
Mehdi Hosseinzadeh,
Bruno Sinopoli,
Ilya Kolmanovsky,
Sanjoy Baruah
Abstract:
This paper proposes a traffic control scheme to alleviate traffic congestion in a network of interconnected signaled lanes/roads. The proposed scheme is emergency vehicle-centered, meaning that it provides an efficient and timely routing for emergency vehicles. In the proposed scheme, model predictive control is utilized to control inlet traffic flows by means of network gates, as well as configur…
▽ More
This paper proposes a traffic control scheme to alleviate traffic congestion in a network of interconnected signaled lanes/roads. The proposed scheme is emergency vehicle-centered, meaning that it provides an efficient and timely routing for emergency vehicles. In the proposed scheme, model predictive control is utilized to control inlet traffic flows by means of network gates, as well as configuration of traffic lights across the network. Two schemes are considered in this paper: i) centralized; and ii) decentralized. In the centralized scheme, a central unit controls the entire network. This scheme provides the optimal solution, even though it might not fulfil real-time computation requirements for large networks. In the decentralized scheme, each intersection has its own control unit, which sends local information to an aggregator. The main responsibility of this aggregator is to receive local information from all control units across the network as well as the emergency vehicle, to augment the received information, and to share it with the control units. Since the decision-making in decentralized scheme is local and the aggregator should fulfil the above-mentioned tasks during a traffic cycle which takes a long period of time, the decentralized scheme is suitable for large networks, even though it may provide a sub-optimal solution. Extensive simulation studies are carried out to validate the proposed schemes, and assess their performance. Notably, the obtained results reveal that traveling times of emergency vehicles can be reduced up to ~50% by using the centralized scheme and up to ~30% by using the decentralized scheme, without causing congestion in other lanes.
△ Less
Submitted 11 April, 2022;
originally announced April 2022.
-
Implementing Optimization-Based Control Tasks in Cyber-Physical Systems With Limited Computing Capacity
Authors:
Mehdi Hosseinzadeh,
Bruno Sinopoli,
Ilya Kolmanovsky,
Sanjoy Baruah
Abstract:
A common aspect of today's cyber-physical systems is that multiple optimization-based control tasks may execute in a shared processor. Such control tasks make use of online optimization and thus have large execution times; hence, their sampling periods must be large as well to satisfy real-time schedulability condition. However, larger sampling periods may cause worse control performance. The goal…
▽ More
A common aspect of today's cyber-physical systems is that multiple optimization-based control tasks may execute in a shared processor. Such control tasks make use of online optimization and thus have large execution times; hence, their sampling periods must be large as well to satisfy real-time schedulability condition. However, larger sampling periods may cause worse control performance. The goal of our work is to develop a robust to early termination optimization approach that can be used to effectively solve onboard optimization problems involved in controlling the system despite the presence of unpredictable, variable, and limited computing capacity. The significance of the developed approach is that the optimization iterations can be stopped at any time instant with a guaranteed feasible solution; as a result, optimization-based control tasks can be implemented with a small sampling period (and consequently with a minimum degradation in the control performance).
△ Less
Submitted 10 March, 2022;
originally announced March 2022.
-
ROTEC: Robust to Early Termination Command Governor for Systems with Limited Computing Capacity
Authors:
Mehdi Hosseinzadeh,
Bruno Sinopoli,
Ilya Kolmanovsky,
Sanjoy Baruah
Abstract:
A Command Governor (CG) is an optimization-based add-on scheme to a nominal closed-loop system. It is used to enforce state and control constraints by modifying reference commands. This paper considers the implementation of a CG on embedded processors that have limited computing resources and must execute multiple control and diagnostics functions; consequently, the time available for CG computati…
▽ More
A Command Governor (CG) is an optimization-based add-on scheme to a nominal closed-loop system. It is used to enforce state and control constraints by modifying reference commands. This paper considers the implementation of a CG on embedded processors that have limited computing resources and must execute multiple control and diagnostics functions; consequently, the time available for CG computations is limited and may vary over time. To address this issue, a robust to early termination command governor is developed which embeds the solution of a CG problem into the internal states of a virtual continuous-time dynamical system which runs in parallel to the process. This virtual system is built so that its trajectory converges to the optimal solution (with a tunable convergence rate), and provides a sub-optimal but feasible solution whenever its evolution is terminated. This allows the designer to implement a CG strategy with a small sampling period (and consequently with a minimum degradation in its performance), while maintaining its constraint-handling capabilities. Simulations are carried out to assess the effectiveness of the developed scheme in satisfying performance requirements and real-time schedulability conditions for a practical vehicle rollover example.
△ Less
Submitted 8 January, 2022;
originally announced January 2022.
-
Reference Governor-Based Fault-Tolerant Constrained Control
Authors:
Mehdi Hosseinzadeh,
Ilya Kolmanovsky,
Sanjoy Baruah,
Bruno Sinopoli
Abstract:
This paper presents a fault-tolerant control scheme for constrained linear systems. First, a new variant of the Reference Governor (RG) called At Once Reference Governor (AORG) is introduced. The AORG is distinguished from the conventional RG by computing the Auxiliary Reference (AR) sequence so that to optimize performance over a prescribed time interval instead of only at the current time instan…
▽ More
This paper presents a fault-tolerant control scheme for constrained linear systems. First, a new variant of the Reference Governor (RG) called At Once Reference Governor (AORG) is introduced. The AORG is distinguished from the conventional RG by computing the Auxiliary Reference (AR) sequence so that to optimize performance over a prescribed time interval instead of only at the current time instant; this enables the integration of the AORG with fault detection schemes. In particular, it is shown that, when the AORG is combined with a Multi-Model Adaptive Estimator (MMAE), the AR sequence can be determined such that the tracking properties are guaranteed and constraints are satisfied at all times, while the detection performance is optimized, i.e., faults can be detected with a high probability of correctness. In addition a reconfiguration scheme is presented that ensures system viability despite the presence of faults based on recoverable sets. Simulations on a Boeing 747-100 aircraft model are carried out to evaluate the effectiveness of the AORG scheme in enforcing constraints and tracking the desired roll and side-slip angles. The effectiveness of the presented fault-tolerant control scheme in maintaining the airplane viability in the presence of damaged vertical stabilizer is also demonstrated.
△ Less
Submitted 18 July, 2021;
originally announced July 2021.
-
Attack Resilient Interconnected Second Order Systems: A Game-Theoretic Approach
Authors:
Mohammad Pirani,
Joshua A. Taylor,
Bruno Sinopoli
Abstract:
This paper studies the resilience of second-order networked dynamical systems to strategic attacks. We discuss two widely used control laws, which have applications in power networks and formation control of autonomous agents. In the first control law, each agent receives pure velocity feedback from its neighbor. In the second control law, each agent receives its velocity relative to its neighbors…
▽ More
This paper studies the resilience of second-order networked dynamical systems to strategic attacks. We discuss two widely used control laws, which have applications in power networks and formation control of autonomous agents. In the first control law, each agent receives pure velocity feedback from its neighbor. In the second control law, each agent receives its velocity relative to its neighbors. The attacker selects a subset of nodes in which to inject a signal, and its objective is to maximize the $\mathcal{H}_2$ norm of the system from the attack signal to the output. The defender improves the resilience of the system by adding self-feedback loops to certain nodes of the network with the objective of minimizing the system's $\mathcal{H}_2$ norm. Their decisions comprise a strategic game. Graph-theoretic necessary and sufficient conditions for the existence of Nash equilibria are presented. In the case of no Nash equilibrium, a Stackelberg game is discussed, and the optimal solution when the defender acts as the leader is characterized. For the case of a single attacked node and a single defense node, it is shown that the optimal location of the defense node for each of the control laws is determined by a specific network centrality measure. The extension of the game to the case of multiple attacked and defense nodes is also addressed.
△ Less
Submitted 8 May, 2019;
originally announced May 2019.
-
Minimum Sensor Placement for Robust Observability of Structured Complex Networks
Authors:
Xiaofei Liu,
Sergio Pequito,
Soummya Kar,
Bruno Sinopoli,
A. Pedro Aguiar
Abstract:
This paper addresses problems on the robust structural design of complex networks. More precisely, we address the problem of deploying the minimum number of dedicated sensors, i.e., those measuring a single state variable, that ensure the network to be structurally observable under disruptive scenarios. The disruptive scenarios considered are as follows: (i) the malfunction/loss of one arbitrary s…
▽ More
This paper addresses problems on the robust structural design of complex networks. More precisely, we address the problem of deploying the minimum number of dedicated sensors, i.e., those measuring a single state variable, that ensure the network to be structurally observable under disruptive scenarios. The disruptive scenarios considered are as follows: (i) the malfunction/loss of one arbitrary sensor, and (ii) the failure of connection (either unidirectional or bidirectional communication) between a pair of agents. First, we show these problems to be NP-hard, which implies that efficient algorithms to determine a solution are unlikely to exist. Secondly, we propose an intuitive two step approach: (1) we achieve an arbitrary minimum sensor placement ensuring structural observability; (2) we develop a sequential process to find minimum number of additional sensors required for robust observability. This step can be solved by recasting it as a weighted set covering problem. Although this is known to be an NP-hard problem, feasible approximations can be determined in polynomial-time that can be used to obtain feasible approximations to the robust structural design problems with optimality guarantees.
△ Less
Submitted 10 June, 2016; v1 submitted 26 July, 2015;
originally announced July 2015.
-
Consensus and Products of Random Stochastic Matrices: Exact Rate for Convergence in Probability
Authors:
Dragana Bajovic,
Joao Xavier,
Jose M. F. Moura,
Bruno Sinopoli
Abstract:
Distributed consensus and other linear systems with system stochastic matrices $W_k$ emerge in various settings, like opinion formation in social networks, rendezvous of robots, and distributed inference in sensor networks. The matrices $W_k$ are often random, due to, e.g., random packet dropouts in wireless sensor networks. Key in analyzing the performance of such systems is studying convergence…
▽ More
Distributed consensus and other linear systems with system stochastic matrices $W_k$ emerge in various settings, like opinion formation in social networks, rendezvous of robots, and distributed inference in sensor networks. The matrices $W_k$ are often random, due to, e.g., random packet dropouts in wireless sensor networks. Key in analyzing the performance of such systems is studying convergence of matrix products $W_kW_{k-1}... W_1$. In this paper, we find the exact exponential rate $I$ for the convergence in probability of the product of such matrices when time $k$ grows large, under the assumption that the $W_k$'s are symmetric and independent identically distributed in time. Further, for commonly used random models like with gossip and link failure, we show that the rate $I$ is found by solving a min-cut problem and, hence, easily computable. Finally, we apply our results to optimally allocate the sensors' transmission power in consensus+innovations distributed detection.
△ Less
Submitted 28 February, 2012;
originally announced February 2012.
-
Stochastic Sensor Scheduling for Energy Constrained Estimation in Multi-Hop Wireless Sensor Networks
Authors:
Yilin Mo,
Emanuele Garone,
Alessandro Casavola,
Bruno Sinopoli
Abstract:
Wireless Sensor Networks (WSNs) enable a wealth of new applications where remote estimation is essential. Individual sensors simultaneously sense a dynamic process and transmit measured information over a shared channel to a central fusion center. The fusion center computes an estimate of the process state by means of a Kalman filter. In this paper we assume that the WSN admits a tree topology wit…
▽ More
Wireless Sensor Networks (WSNs) enable a wealth of new applications where remote estimation is essential. Individual sensors simultaneously sense a dynamic process and transmit measured information over a shared channel to a central fusion center. The fusion center computes an estimate of the process state by means of a Kalman filter. In this paper we assume that the WSN admits a tree topology with fusion center at the root. At each time step only a subset of sensors can be selected to transmit observations to the fusion center due to a limited energy budget. We propose a stochastic sensor selection algorithm that randomly selects a subset of sensors according to certain probability distribution, which is opportunely designed to minimize the asymptotic expected estimation error covariance matrix. We show that the optimal stochastic sensor selection problem can be relaxed into a convex optimization problem and thus solved efficiently. We also provide a possible implementation of our algorithm which does not introduce any communication overhead. The paper ends with some numerical examples that show the effectiveness of the proposed approach.
△ Less
Submitted 8 July, 2011;
originally announced July 2011.
-
Towards Finding the Critical Value for Kalman Filtering with Intermittent Observations
Authors:
Yilin Mo,
Bruno Sinopoli
Abstract:
In [1], Sinopoli et al. analyze the problem of optimal estimation for linear Gaussian systems where packets containing observations are dropped according to an i.i.d. Bernoulli process, modeling a memoryless erasure channel. In this case the authors show that the Kalman Filter is still the optimal estimator, although boundedness of the error depends directly upon the channel arrival probability, p…
▽ More
In [1], Sinopoli et al. analyze the problem of optimal estimation for linear Gaussian systems where packets containing observations are dropped according to an i.i.d. Bernoulli process, modeling a memoryless erasure channel. In this case the authors show that the Kalman Filter is still the optimal estimator, although boundedness of the error depends directly upon the channel arrival probability, p. In particular they also prove the existence of a critical value, pc, for such probability, below which the Kalman filter will diverge. The authors are not able to compute the actual value of this critical probability for general linear systems, but provide upper and lower bounds. They are able to show that for special cases, i.e. C invertible, such critical value coincides with the lower bound. This paper computes the value of the critical arrival probability, under minimally restrictive conditions on the matrices A and C.
△ Less
Submitted 13 May, 2010;
originally announced May 2010.
-
A Random Dynamical Systems Approach to Filtering in Large-scale Networks
Authors:
S. Kar,
B. Sinopoli,
J. M. F. Moura
Abstract:
The paper studies the problem of filtering a discrete-time linear system observed by a network of sensors. The sensors share a common communication medium to the estimator and transmission is bit and power budgeted. Under the assumption of conditional Gaussianity of the signal process at the estimator (which may be ensured by observation packet acknowledgements), the conditional prediction error…
▽ More
The paper studies the problem of filtering a discrete-time linear system observed by a network of sensors. The sensors share a common communication medium to the estimator and transmission is bit and power budgeted. Under the assumption of conditional Gaussianity of the signal process at the estimator (which may be ensured by observation packet acknowledgements), the conditional prediction error covariance of the optimum mean-squared error filter is shown to evolve according to a random dynamical system (RDS) on the space of non-negative definite matrices. Our RDS formalism does not depend on the particular medium access protocol (randomized) and, under a minimal distributed observability assumption, we show that the sequence of random conditional prediction error covariance matrices converges in distribution to a unique invariant distribution (independent of the initial filter state), i.e., the conditional error process is shown to be ergodic. Under broad assumptions on the medium access protocol, we show that the conditional error covariance sequence satisfies a Markov-Feller property, leading to an explicit characterization of the support of its invariant measure. The methodology adopted in this work is sufficiently general to envision this application to sample path analysis of more general hybrid or switched systems, where existing analysis is mostly moment-based.
△ Less
Submitted 5 October, 2009;
originally announced October 2009.
-
Proofs of "LQG Control For MIMO System Over Multiple TCP-like Erasure Channels"
Authors:
E. Garone,
B. Sinopoli,
A. Goldsmith,
A. Casavola
Abstract:
Here we will provide the proofs of the results stated in the Infinite Horizon LQG Control section of [1] by focusing on the control law and the related MARE. The analysis of the observation case can be achieved in a dual way and it is partially covered by [2].
Here we will provide the proofs of the results stated in the Infinite Horizon LQG Control section of [1] by focusing on the control law and the related MARE. The analysis of the observation case can be achieved in a dual way and it is partially covered by [2].
△ Less
Submitted 11 September, 2009;
originally announced September 2009.
-
Kalman Filtering with Intermittent Observations: Weak Convergence to a Stationary Distribution
Authors:
Soummya Kar,
Bruno Sinopoli,
Jose M. F. Moura
Abstract:
The paper studies the asymptotic behavior of Random Algebraic Riccati Equations (RARE) arising in Kalman filtering when the arrival of the observations is described by a Bernoulli i.i.d. process. We model the RARE as an order-preserving, strongly sublinear random dynamical system (RDS). Under a sufficient condition, stochastic boundedness, and using a limit-set dichotomy result for order-preservin…
▽ More
The paper studies the asymptotic behavior of Random Algebraic Riccati Equations (RARE) arising in Kalman filtering when the arrival of the observations is described by a Bernoulli i.i.d. process. We model the RARE as an order-preserving, strongly sublinear random dynamical system (RDS). Under a sufficient condition, stochastic boundedness, and using a limit-set dichotomy result for order-preserving, strongly sublinear RDS, we establish the asymptotic properties of the RARE: the sequence of random prediction error covariance matrices converges weakly to a unique invariant distribution, whose support exhibits fractal behavior. In particular, this weak convergence holds under broad conditions and even when the observations arrival rate is below the critical probability for mean stability. We apply the weak-Feller property of the Markov process governing the RARE to characterize the support of the limiting invariant distribution as the topological closure of a countable set of points, which, in general, is not dense in the set of positive semi-definite matrices. We use the explicit characterization of the support of the invariant distribution and the almost sure ergodicity of the sample paths to easily compute the moments of the invariant distribution. A one dimensional example illustrates that the support is a fractured subset of the non-negative reals with self-similarity properties.
△ Less
Submitted 28 May, 2010; v1 submitted 16 March, 2009;
originally announced March 2009.