-
Mitigating Information Asymmetry in Two-Stage Contracts with Non-Myopic Agents
Authors:
Munther A. Dahleh,
Thibaut Horel,
M. Umar B. Niazi
Abstract:
We consider a Stackelberg game in which a principal (she) establishes a two-stage contract with a non-myopic agent (he) whose type is unknown. The contract takes the form of an incentive function map** the agent's first-stage action to his second-stage incentive. While the first-stage action reveals the agent's type under truthful play, a non-myopic agent could benefit from portraying a false ty…
▽ More
We consider a Stackelberg game in which a principal (she) establishes a two-stage contract with a non-myopic agent (he) whose type is unknown. The contract takes the form of an incentive function map** the agent's first-stage action to his second-stage incentive. While the first-stage action reveals the agent's type under truthful play, a non-myopic agent could benefit from portraying a false type in the first stage to obtain a larger incentive in the second stage. The challenge is thus for the principal to design the incentive function so as to induce truthful play. We show that this is only possible with a constant, non-reactive incentive functions when the type space is continuous, whereas it can be achieved with reactive functions for discrete types. Additionally, we show that introducing an adjustment mechanism that penalizes inconsistent behavior across both stages allows the principal to design more flexible incentive functions.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Incentive Design for Eco-driving in Urban Transportation Networks
Authors:
M. Umar B. Niazi,
Jung-Hoon Cho,
Munther A. Dahleh,
Roy Dong,
Cathy Wu
Abstract:
Eco-driving emerges as a cost-effective and efficient strategy to mitigate greenhouse gas emissions in urban transportation networks. Acknowledging the persuasive influence of incentives in sha** driver behavior, this paper presents the `eco-planner,' a digital platform devised to promote eco-driving practices in urban transportation. At the outset of their trips, users provide the platform with…
▽ More
Eco-driving emerges as a cost-effective and efficient strategy to mitigate greenhouse gas emissions in urban transportation networks. Acknowledging the persuasive influence of incentives in sha** driver behavior, this paper presents the `eco-planner,' a digital platform devised to promote eco-driving practices in urban transportation. At the outset of their trips, users provide the platform with their trip details and travel time preferences, enabling the eco-planner to formulate personalized eco-driving recommendations and corresponding incentives, while adhering to its budgetary constraints. Upon trip completion, incentives are transferred to users who comply with the recommendations and effectively reduce their emissions. By comparing our proposed incentive mechanism with a baseline scheme that offers uniform incentives to all users, we demonstrate that our approach achieves superior emission reductions and increased user compliance with a smaller budget.
△ Less
Submitted 16 May, 2024; v1 submitted 6 November, 2023;
originally announced November 2023.
-
Secure Set-Based State Estimation for Linear Systems under Adversarial Attacks on Sensors
Authors:
M. Umar B. Niazi,
Michelle S. Chong,
Amr Alanwar,
Karl H. Johansson
Abstract:
Set-based state estimation plays a vital role in the safety verification of dynamical systems, which becomes significantly challenging when the system's sensors are susceptible to cyber-attacks. Existing methods often impose limitations on the attacker's capabilities, restricting the number of attacked sensors to be strictly less than half of the total number of sensors. This paper proposes a Secu…
▽ More
Set-based state estimation plays a vital role in the safety verification of dynamical systems, which becomes significantly challenging when the system's sensors are susceptible to cyber-attacks. Existing methods often impose limitations on the attacker's capabilities, restricting the number of attacked sensors to be strictly less than half of the total number of sensors. This paper proposes a Secure Set-Based State Estimation (S3E) algorithm that addresses this limitation. The S3E algorithm guarantees that the true system state is contained within the estimated set, provided the initialization set encompasses the true initial state and the system is redundantly observable from the set of uncompromised sensors. The algorithm gives the estimated set as a collection of constrained zonotopes, which can be employed as robust certificates for verifying whether the system adheres to safety constraints. Furthermore, we demonstrate that the estimated set remains unaffected by attack signals of sufficiently large and also establish sufficient conditions for attack detection, identification, and filtering. This compels the attacker to inject only stealthy signals of small magnitude to evade detection, thus preserving the accuracy of the estimated set. When a few number of sensors (less than half) can be compromised, we prove that the estimated set remains bounded by a contracting set that converges to a ball whose radius is solely determined by the noise magnitude and is independent of the attack signals. To address the computational complexity of the algorithm, we offer several strategies for complexity-performance trade-offs. The efficacy of the proposed algorithm is illustrated through its application to a three-story building model.
△ Less
Submitted 16 May, 2024; v1 submitted 10 September, 2023;
originally announced September 2023.
-
Sensor Fault Detection and Isolation in Autonomous Nonlinear Systems Using Neural Network-Based Observers
Authors:
John Cao,
Muhammad Umar B. Niazi,
Matthieu Barreau,
Karl Henrik Johansson
Abstract:
This paper presents a novel observer-based approach to detect and isolate faulty sensors in nonlinear systems. The proposed sensor fault detection and isolation (s-FDI) method applies to a general class of nonlinear systems. Our focus is on s-FDI for two types of faults: complete failure and sensor degradation. The key aspect of this approach lies in the utilization of a neural network-based Kazan…
▽ More
This paper presents a novel observer-based approach to detect and isolate faulty sensors in nonlinear systems. The proposed sensor fault detection and isolation (s-FDI) method applies to a general class of nonlinear systems. Our focus is on s-FDI for two types of faults: complete failure and sensor degradation. The key aspect of this approach lies in the utilization of a neural network-based Kazantzis-Kravaris/Luenberger (KKL) observer. The neural network is trained to learn the dynamics of the observer, enabling accurate output predictions of the system. Sensor faults are detected by comparing the actual output measurements with the predicted values. If the difference surpasses a theoretical threshold, a sensor fault is detected. To identify and isolate which sensor is faulty, we compare the numerical difference of each sensor meassurement with an empirically derived threshold. We derive both theoretical and empirical thresholds for detection and isolation, respectively. Notably, the proposed approach is robust to measurement noise and system uncertainties. Its effectiveness is demonstrated through numerical simulations of sensor faults in a network of Kuramoto oscillators.
△ Less
Submitted 22 November, 2023; v1 submitted 18 April, 2023;
originally announced April 2023.
-
Parameterization-Free Observer Design for Nonlinear Systems: Application to the State Estimation of Networked SIR Epidemics
Authors:
Muhammad Umar B. Niazi,
Karl H. Johansson
Abstract:
Traditional observer design methods rely on certain properties of the system's nonlinearity, such as Lipschitz continuity, one-sided Lipschitzness, a bounded Jacobian, or quadratic boundedness. These properties are described by parameterized inequalities. However, enforcing these inequalities globally can lead to very large parameters, resulting in overly conservative observer design criteria. The…
▽ More
Traditional observer design methods rely on certain properties of the system's nonlinearity, such as Lipschitz continuity, one-sided Lipschitzness, a bounded Jacobian, or quadratic boundedness. These properties are described by parameterized inequalities. However, enforcing these inequalities globally can lead to very large parameters, resulting in overly conservative observer design criteria. These criteria become infeasible for highly nonlinear applications, such as networked epidemic processes. In this paper, we present an observer design approach for estimating the state of nonlinear systems, without requiring any parameterization of the system's nonlinearities. The proposed observer design depends only on systems' matrices and applies to systems with any nonlinearity. We establish different design criteria for ensuring both asymptotic and exponential convergence of the estimation error to zero. To demonstrate the efficacy of our approach, we employ it for estimating the state of a networked SIR epidemic model. We show that, even in the presence of measurement noise, the observer can accurately estimate the epidemic state of each node in the network. To the best of our knowledge, the proposed observer is the first that is capable of estimating the state of networked SIR models.
△ Less
Submitted 7 April, 2023;
originally announced April 2023.
-
Feedback Design for Devising Optimal Epidemic Control Policies
Authors:
Muhammad Umar B. Niazi,
Philip E. Paré,
Karl H. Johansson
Abstract:
This paper proposes a feedback design that effectively copes with uncertainties for reliable epidemic monitoring and control. There are several optimization-based methods to estimate the parameters of an epidemic model by utilizing past reported data. However, due to the possibility of noise in the data, the estimated parameters may not be accurate, thereby exacerbating the model uncertainty. To a…
▽ More
This paper proposes a feedback design that effectively copes with uncertainties for reliable epidemic monitoring and control. There are several optimization-based methods to estimate the parameters of an epidemic model by utilizing past reported data. However, due to the possibility of noise in the data, the estimated parameters may not be accurate, thereby exacerbating the model uncertainty. To address this issue, we provide an observer design that enables robust state estimation of epidemic processes, even in the presence of uncertain models and noisy measurements. Using the estimated model and state, we then devise optimal control policies by minimizing a predicted cost functional. To demonstrate the effectiveness of our approach, we implement it on a modified SIR epidemic model. The results show that our proposed method is efficient in mitigating the uncertainties that may arise in epidemic monitoring and control.
△ Less
Submitted 5 April, 2023; v1 submitted 21 November, 2022;
originally announced November 2022.
-
Resilient Set-based State Estimation for Linear Time-Invariant Systems Using Zonotopes
Authors:
Muhammad Umar B. Niazi,
Amr Alanwar,
Michelle S. Chong,
Karl Henrik Johansson
Abstract:
This paper considers the problem of set-based state estimation for linear time-invariant (LTI) systems under time-varying sensor attacks. Provided that the LTI system is stable and observable via every single sensor and that at least one sensor is uncompromised, we guarantee that the true state is always contained in the estimated set. We use zonotopes to represent these sets for computational eff…
▽ More
This paper considers the problem of set-based state estimation for linear time-invariant (LTI) systems under time-varying sensor attacks. Provided that the LTI system is stable and observable via every single sensor and that at least one sensor is uncompromised, we guarantee that the true state is always contained in the estimated set. We use zonotopes to represent these sets for computational efficiency. However, we show that intelligently designed stealthy attacks may cause exponential growth in the algorithm's worst-case complexity. We present several strategies to handle this complexity issue and illustrate our resilient zonotope-based state estimation algorithm on a rotating target system.
△ Less
Submitted 15 November, 2022;
originally announced November 2022.
-
Robust Data-Driven Predictive Control of Unknown Nonlinear Systems using Reachability Analysis
Authors:
Mahsa Farjadnia,
Amr Alanwar,
Muhammad Umar B. Niazi,
Marco Molinari,
Karl Henrik Johansson
Abstract:
This work proposes a robust data-driven predictive control approach for unknown nonlinear systems in the presence of bounded process and measurement noise. Data-driven reachable sets are employed for the controller design instead of using an explicit nonlinear system model. Although the process and measurement noise are bounded, the statistical properties of the noise are not required to be known.…
▽ More
This work proposes a robust data-driven predictive control approach for unknown nonlinear systems in the presence of bounded process and measurement noise. Data-driven reachable sets are employed for the controller design instead of using an explicit nonlinear system model. Although the process and measurement noise are bounded, the statistical properties of the noise are not required to be known. By using the past noisy input-output data in the learning phase, we propose a novel method to over-approximate reachable sets of an unknown nonlinear system. Then, we propose a data-driven predictive control approach to compute safe and robust control policies from noisy online data. The constraints are guaranteed in the control phase with robust safety margins through the effective use of the predicted output reachable set obtained in the learning phase. Finally, a numerical example validates the efficacy of the proposed approach and demonstrates comparable performance with a model-based predictive control approach.
△ Less
Submitted 16 July, 2023; v1 submitted 10 November, 2022;
originally announced November 2022.
-
Secure State Estimation against Sparse Attacks on a Time-varying Set of Sensors
Authors:
Zishuo Li,
Muhammad Umar B. Niazi,
Changxin Liu,
Yilin Mo,
Karl H. Johansson
Abstract:
This paper studies the problem of secure state estimation of a linear time-invariant (LTI) system with bounded noise in the presence of sparse attacks on an unknown, time-varying set of sensors. In other words, at each time, the attacker has the freedom to choose an arbitrary set of no more that $p$ sensors and manipulate their measurements without restraint. To this end, we propose a secure state…
▽ More
This paper studies the problem of secure state estimation of a linear time-invariant (LTI) system with bounded noise in the presence of sparse attacks on an unknown, time-varying set of sensors. In other words, at each time, the attacker has the freedom to choose an arbitrary set of no more that $p$ sensors and manipulate their measurements without restraint. To this end, we propose a secure state estimation scheme and guarantee a bounded estimation error subject to $2p$-sparse observability and a mild, technical assumption that the system matrix has no degenerate eigenvalues. The proposed scheme comprises a design of decentralized observer for each sensor based on the local observable subspace decomposition. At each time step, the local estimates of sensors are fused by solving an optimization problem to obtain a secure estimation, which is then followed by a local detection-and-resetting process of the decentralized observers. The estimation error is shown to be upper-bounded by a constant which is determined only by the system parameters and noise magnitudes. Moreover, we optimize the detector threshold to ensure that the benign sensors do not trigger the detector. The efficacy of the proposed algorithm is demonstrated by its application on a benchmark example of IEEE 14-bus system.
△ Less
Submitted 21 July, 2023; v1 submitted 10 November, 2022;
originally announced November 2022.
-
Learning-based Design of Luenberger Observers for Autonomous Nonlinear Systems
Authors:
Muhammad Umar B. Niazi,
John Cao,
Xudong Sun,
Amritam Das,
Karl Henrik Johansson
Abstract:
Designing Luenberger observers for nonlinear systems involves the challenging task of transforming the state to an alternate coordinate system, possibly of higher dimensions, where the system is asymptotically stable and linear up to output injection. The observer then estimates the system's state in the original coordinates by inverting the transformation map. However, finding a suitable injectiv…
▽ More
Designing Luenberger observers for nonlinear systems involves the challenging task of transforming the state to an alternate coordinate system, possibly of higher dimensions, where the system is asymptotically stable and linear up to output injection. The observer then estimates the system's state in the original coordinates by inverting the transformation map. However, finding a suitable injective transformation whose inverse can be derived remains a primary challenge for general nonlinear systems. We propose a novel approach that uses supervised physics-informed neural networks to approximate both the transformation and its inverse. Our method exhibits superior generalization capabilities to contemporary methods and demonstrates robustness to both neural network's approximation errors and system uncertainties.
△ Less
Submitted 5 April, 2023; v1 submitted 4 October, 2022;
originally announced October 2022.
-
Observer Design for the State Estimation of Epidemic Processes
Authors:
Muhammad Umar B. Niazi,
Karl Henrik Johansson
Abstract:
Although an appropriate choice of measured state variables may ensure observability, designing state observers for the state estimation of epidemic models remains a challenging task. Epidemic spread is a nonlinear process, often modeled as the law of mass action, which is of a quadratic form; thus, on a compact domain, its Lipschitz constant turns out to be local and relatively large, which render…
▽ More
Although an appropriate choice of measured state variables may ensure observability, designing state observers for the state estimation of epidemic models remains a challenging task. Epidemic spread is a nonlinear process, often modeled as the law of mass action, which is of a quadratic form; thus, on a compact domain, its Lipschitz constant turns out to be local and relatively large, which renders the Lipschitz-based design criteria of existing observer architectures infeasible. In this paper, a novel observer architecture is proposed for the state estimation of a class of nonlinear systems that encompasses the deterministic epidemic models. The proposed observer offers extra leverage to reduce the influence of nonlinearity in the estimation error dynamics, which is not possible in other Luenberger-like observers. Algebraic Riccati inequalities are derived as sufficient conditions for the asymptotic convergence of the estimation error to zero under local Lipschitz and generalized Lipschitz assumptions. Equivalent linear matrix inequality formulations of the algebraic Riccati inequalities are also provided. The efficacy of the proposed observer design is illustrated by its application on the celebrated SIDARTHE-V epidemic model.
△ Less
Submitted 25 July, 2022;
originally announced July 2022.
-
Clustering-Based Average State Observer Design for Large-Scale Network Systems
Authors:
Muhammad Umar B. Niazi,
Xiaodong Cheng,
Carlos Canudas-de-Wit,
Jacquelien M. A. Scherpen
Abstract:
This paper addresses the aggregated monitoring problem for large-scale network systems with a few dedicated sensors. Full state estimation of such systems is often infeasible due to unobservability and/or computational infeasibility. Therefore, through clustering and aggregation, a tractable representation of a network system, called a projected network system, is obtained for designing a minimum-…
▽ More
This paper addresses the aggregated monitoring problem for large-scale network systems with a few dedicated sensors. Full state estimation of such systems is often infeasible due to unobservability and/or computational infeasibility. Therefore, through clustering and aggregation, a tractable representation of a network system, called a projected network system, is obtained for designing a minimum-order average state observer. This observer estimates the average states of the clusters, which are identified with explicit consideration to the estimation error. Moreover, given the clustering, the proposed observer design algorithm exploits the structure of the estimation error dynamics to achieve computational tractability. Simulations show that the computation of the proposed algorithm is significantly faster than the usual $\mathcal{H}_2/\mathcal{H}_\infty$ observer design techniques. On the other hand, compromise on the estimation error characteristics is shown to be marginal.
△ Less
Submitted 26 May, 2022;
originally announced May 2022.
-
Data-driven Set-based Estimation of Polynomial Systems with Application to SIR Epidemics
Authors:
Amr Alanwar,
Muhammad Umar B. Niazi,
Karl H. Johansson
Abstract:
This paper proposes a data-driven set-based estimation algorithm for a class of nonlinear systems with polynomial nonlinearities. Using the system's input-output data, the proposed method computes a set that guarantees the inclusion of the system's state in real-time. Although the system is assumed to be a polynomial type, the exact polynomial functions, and their coefficients are assumed to be un…
▽ More
This paper proposes a data-driven set-based estimation algorithm for a class of nonlinear systems with polynomial nonlinearities. Using the system's input-output data, the proposed method computes a set that guarantees the inclusion of the system's state in real-time. Although the system is assumed to be a polynomial type, the exact polynomial functions, and their coefficients are assumed to be unknown. To this end, the estimator relies on offline and online phases. The offline phase utilizes past input-output data to estimate a set of possible coefficients of the polynomial system. Then, using this estimated set of coefficients and the side information about the system, the online phase provides a set estimate of the state. Finally, the proposed methodology is evaluated through its application on SIR (Susceptible, Infected, Recovered) epidemic model.
△ Less
Submitted 30 March, 2022; v1 submitted 8 November, 2021;
originally announced November 2021.
-
Effective Testing Policies for Controlling an Epidemic Outbreak
Authors:
Muhammad Umar B. Niazi,
Alain Kibangou,
Carlos Canudas-de-Wit,
Denis Nikitin,
Liudmila Tumash,
Pierre-Alexandre Bliman
Abstract:
Testing is a crucial control mechanism for an epidemic outbreak because it enables the health authority to detect and isolate the infected cases, thereby limiting the disease transmission to susceptible people, when no effective treatment or vaccine is available. In this paper, an epidemic model that incorporates the testing rate as a control input is presented. The proposed model distinguishes be…
▽ More
Testing is a crucial control mechanism for an epidemic outbreak because it enables the health authority to detect and isolate the infected cases, thereby limiting the disease transmission to susceptible people, when no effective treatment or vaccine is available. In this paper, an epidemic model that incorporates the testing rate as a control input is presented. The proposed model distinguishes between the undetected infected and the detected infected cases with the latter assumed to be isolated from the disease spreading process in the population. Two testing policies, effective during the onset of an epidemic when no treatment or vaccine is available, are devised: (i) best-effort strategy for testing (BEST) and (ii) constant optimal strategy for testing (COST). The BEST is a suppression policy that provides a lower bound on the testing rate to stop the growth of the epidemic. The COST is a mitigation policy that minimizes the peak of the epidemic by providing a constant, optimal allocation of tests in a certain time interval when the total stockpile of tests is limited. Both testing policies are evaluated by their impact on the number of active intensive care unit (ICU) cases and the cumulative number of deaths due to COVID-19 in France.
△ Less
Submitted 26 September, 2021;
originally announced September 2021.
-
Modeling and Control of Epidemics through Testing Policies
Authors:
Muhammad Umar B. Niazi,
Alain Kibangou,
Carlos Canudas-de-Wit,
Denis Nikitin,
Liudmila Tumash,
Pierre-Alexandre Bliman
Abstract:
Testing is a crucial control mechanism in the beginning phase of an epidemic when the vaccines are not yet available. It enables the public health authority to detect and isolate the infected cases from the population, thereby limiting the disease transmission to susceptible people. However, despite the significance of testing in epidemic control, the recent literature on the subject lacks a contr…
▽ More
Testing is a crucial control mechanism in the beginning phase of an epidemic when the vaccines are not yet available. It enables the public health authority to detect and isolate the infected cases from the population, thereby limiting the disease transmission to susceptible people. However, despite the significance of testing in epidemic control, the recent literature on the subject lacks a control-theoretic perspective. In this paper, an epidemic model is proposed that incorporates the testing rate as a control input and differentiates the undetected infected from the detected infected cases, who are assumed to be removed from the disease spreading process in the population. After estimating the model on the data corresponding to the beginning phase of COVID-19 in France, two testing policies are proposed: the so-called best-effort strategy for testing (BEST) and constant optimal strategy for testing (COST). The BEST policy is a suppression strategy that provides a minimum testing rate that stops the growth of the epidemic when implemented. The COST policy, on the other hand, is a mitigation strategy that provides an optimal value of testing rate minimizing the peak value of the infected population when the total stockpile of tests is limited. Both testing policies are evaluated by their impact on the number of active intensive care unit (ICU) cases and the cumulative number of deaths for the COVID-19 case of France.
△ Less
Submitted 26 September, 2021; v1 submitted 29 October, 2020;
originally announced October 2020.
-
A Differential Game Model of Opinion Dynamics: Accord and Discord as Nash Equilibria
Authors:
Muhammad Umar B. Niazi,
Arif Bülent Özgüler
Abstract:
A noncooperative differential (dynamic) game model of opinion dynamics is proposed. In this game, the agents' motives are shaped by their expectations of the nature of others' opinions as well as how susceptible they are to get influenced by others, how stubborn they are, and how quick they are willing to change their opinions on a set of issues in a prescribed time interval. These motives are ind…
▽ More
A noncooperative differential (dynamic) game model of opinion dynamics is proposed. In this game, the agents' motives are shaped by their expectations of the nature of others' opinions as well as how susceptible they are to get influenced by others, how stubborn they are, and how quick they are willing to change their opinions on a set of issues in a prescribed time interval. These motives are independently formed by all agents. The existence of a Nash equilibrium in the network means that a collective behavior emerges out of local interaction rules and these individual motives. We prove that a unique Nash equilibrium may exist in the game under quite different circumstances. It may exist not only if there is a harmony of perceptions among the agents of the network, but also when agents have different views about the correlation among issues. The first leads to an accord in the network usually expressed as a partial consensus, and the second to a discord in the form of oscillating opinions. In case of an accord, the harmony in the network may be in the form of similarity in pairwise conceptions about the issues but may also be an agreement on the status of a "leader" in the network. A Nash equilibrium may fail to exist only when the network is in a state of discord.
△ Less
Submitted 23 February, 2020; v1 submitted 29 June, 2017;
originally announced June 2017.
-
Consensus as a Nash Equilibrium of a Dynamic Game
Authors:
Muhammad Umar B. Niazi,
Arif Bülent Özgüler,
Aykut Yıldız
Abstract:
Consensus formation in a social network is modeled by a dynamic game of a prescribed duration played by members of the network. Each member independently minimizes a cost function that represents his/her motive. An integral cost function penalizes a member's differences of opinion from the others as well as from his/her own initial opinion, weighted by influence and stubbornness parameters. Each m…
▽ More
Consensus formation in a social network is modeled by a dynamic game of a prescribed duration played by members of the network. Each member independently minimizes a cost function that represents his/her motive. An integral cost function penalizes a member's differences of opinion from the others as well as from his/her own initial opinion, weighted by influence and stubbornness parameters. Each member uses its rate of change of opinion as a control input. This defines a dynamic non-cooperative game that turns out to have a unique Nash equilibrium. Analytic explicit expressions are derived for the opinion trajectory of each member for two representative cases obtained by suitable assumptions on the graph topology of the network. These trajectories are then examined under different assumptions on the relative sizes of the influence and stubbornness parameters that appear in the cost functions.
△ Less
Submitted 5 January, 2017;
originally announced January 2017.