Showing 1–8 of 8 results for author: Zheng, W X

A Control-Recoverable Added-Noise-based Privacy Scheme for LQ Control in Networked Control Systems

Authors: Xuening Tang, Xianghui Cao, Wei Xing Zheng

Abstract: As networked control systems continue to evolve, ensuring the privacy of sensitive data becomes an increasingly pressing concern, especially in situations where the controller is physically separated from the plant. In this paper, we propose a secure control scheme for computing linear quadratic control in a networked control system utilizing two networked controllers, a privacy encoder and a cont… ▽ More As networked control systems continue to evolve, ensuring the privacy of sensitive data becomes an increasingly pressing concern, especially in situations where the controller is physically separated from the plant. In this paper, we propose a secure control scheme for computing linear quadratic control in a networked control system utilizing two networked controllers, a privacy encoder and a control restorer. Specifically, the encoder generates two state signals blurred with random noise and sends them to the controllers, while the restorer reconstructs the correct control signal. The proposed design effectively preserves the privacy of the control system's state without sacrificing the control performance. We theoretically quantify the privacy-preserving performance in terms of the state estimation error of the controllers and the disclosure probability. Additionally, the proposed privacy-preserving scheme is also proven to satisfy differential privacy. Moreover, we extend the proposed privacy-preserving scheme and evaluation method to cases where collusion between two controllers occurs. Finally, we verify the validity of our proposed scheme through simulations. △ Less

Submitted 22 March, 2024; v1 submitted 20 March, 2024; originally announced March 2024.

A Lightweight Sensor Scheduler Based on AoI Function for Remote State Estimation over Lossy Wireless Channels

Authors: Taige Chang, Xianghui Cao, Wei Xing Zheng

Abstract: This paper investigates the problem of sensor scheduling for remotely estimating the states of heterogeneous dynamical systems over resource-limited and lossy wireless channels. Considering the low time complexity and high versatility requirements of schedulers deployed on the transport layer, we propose a lightweight scheduler based on an Age of Information (AoI) function built with the tight sca… ▽ More This paper investigates the problem of sensor scheduling for remotely estimating the states of heterogeneous dynamical systems over resource-limited and lossy wireless channels. Considering the low time complexity and high versatility requirements of schedulers deployed on the transport layer, we propose a lightweight scheduler based on an Age of Information (AoI) function built with the tight scalar upper bound of the remote estimation error. We show that the proposed scheduler is indexable and sub-optimal. We derive an upper and a lower bound of the proposed scheduler and give stability conditions for estimation error. Numerical simulations demonstrate that, compared to existing policies, the proposed scheduler achieves estimation performance very close to the optimal at a much lower computation time. △ Less

Submitted 30 August, 2023; v1 submitted 14 August, 2023; originally announced August 2023.

Aggressive Quadrotor Flight Using Curiosity-Driven Reinforcement Learning

Authors: Qiyu Sun, **bao Fang, Wei Xing Zheng, Yang Tang

Abstract: The ability to perform aggressive movements, which are called aggressive flights, is important for quadrotors during navigation. However, aggressive quadrotor flights are still a great challenge to practical applications. The existing solutions to aggressive flights heavily rely on a predefined trajectory, which is a time-consuming preprocessing step. To avoid such path planning, we propose a curi… ▽ More The ability to perform aggressive movements, which are called aggressive flights, is important for quadrotors during navigation. However, aggressive quadrotor flights are still a great challenge to practical applications. The existing solutions to aggressive flights heavily rely on a predefined trajectory, which is a time-consuming preprocessing step. To avoid such path planning, we propose a curiosity-driven reinforcement learning method for aggressive flight missions and a similarity-based curiosity module is introduced to speed up the training procedure. A branch structure exploration (BSE) strategy is also applied to guarantee the robustness of the policy and to ensure the policy trained in simulations can be performed in real-world experiments directly. The experimental results in simulations demonstrate that our reinforcement learning algorithm performs well in aggressive flight tasks, speeds up the convergence process and improves the robustness of the policy. Besides, our algorithm shows a satisfactory simulated to real transferability and performs well in real-world experiments. △ Less

Submitted 26 March, 2022; originally announced March 2022.

Sparse Bayesian Deep Learning for Dynamic System Identification

Authors: Hongpeng Zhou, Chahine Ibrahim, Wei Xing Zheng, Wei Pan

Abstract: This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system identification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification problems. First, DNNs are known to be too complex that they can easily overfit the training data. Second, the selection of the input regressors for system identificat… ▽ More This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system identification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification problems. First, DNNs are known to be too complex that they can easily overfit the training data. Second, the selection of the input regressors for system identification is nontrivial. Third, uncertainty quantification of the model parameters and predictions are necessary. The proposed Bayesian approach offers a principled way to alleviate the above challenges by marginal likelihood/model evidence approximation and structured group sparsity-inducing priors construction. The identification algorithm is derived as an iterative regularised optimisation procedure that can be solved as efficiently as training typical DNNs. Remarkably, an efficient and recursive Hessian calculation method for each layer of DNNs is developed, turning the intractable training/optimisation process into a tractable one. Furthermore, a practical calculation approach based on the Monte-Carlo integration method is derived to quantify the uncertainty of the parameters and predictions. The effectiveness of the proposed Bayesian approach is demonstrated on several linear and nonlinear system identification benchmarks by achieving good and competitive simulation accuracy. The code to reproduce the experimental results is open-sourced and available online. △ Less

Submitted 1 June, 2022; v1 submitted 27 July, 2021; originally announced July 2021.

In-Field Gyroscope Autocalibration with Iterative Attitude Estimation

Authors: Li Wang, Rob Duffield, Deborah Fox, Athena Hammond, Andrew J. Zhang, Wei Xing Zheng, Steven W. Su

Abstract: This paper presents an efficient in-field calibration method tailored for low-cost triaxial MEMS gyroscopes often used in healthcare applications. Traditional calibration techniques are challenging to implement in clinical settings due to the unavailability of high-precision equipment. Unlike the auto-calibration approaches used for triaxial MEMS accelerometers, which rely on local gravity, gyrosc… ▽ More This paper presents an efficient in-field calibration method tailored for low-cost triaxial MEMS gyroscopes often used in healthcare applications. Traditional calibration techniques are challenging to implement in clinical settings due to the unavailability of high-precision equipment. Unlike the auto-calibration approaches used for triaxial MEMS accelerometers, which rely on local gravity, gyroscopes lack a reliable reference since the Earth's self-rotation speed is insufficient for accurate calibration. To address this limitation, we propose a novel method that uses manual rotation of the MEMS gyroscope to a specific angle (360°) as the calibration reference. This approach iteratively estimates the sensor's attitude without requiring any external equipment. Numerical simulations and empirical tests validate that the calibration error is low and that parameter estimation is unbiased. The method can be implemented in real-time on a low-energy microcontroller and completed in under 30 seconds. Comparative results demonstrate that the proposed technique outperforms existing state-of-the-art methods, achieving scale factor and bias errors of less than $2.5\times10^{-2}$ for LSM9DS1 and less than $1\times10^{-2}$ for ICM20948. △ Less

Submitted 13 March, 2024; v1 submitted 20 March, 2021; originally announced March 2021.

Model-Free Design of Stochastic LQR Controller from Reinforcement Learning and Primal-Dual Optimization Perspective

Authors: Man Li, Jiahu Qin, Wei Xing Zheng, Yaonan Wang, Yu Kang

Abstract: To further understand the underlying mechanism of various reinforcement learning (RL) algorithms and also to better use the optimization theory to make further progress in RL, many researchers begin to revisit the linear-quadratic regulator (LQR) problem, whose setting is simple and yet captures the characteristics of RL. Inspired by this, this work is concerned with the model-free design of stoch… ▽ More To further understand the underlying mechanism of various reinforcement learning (RL) algorithms and also to better use the optimization theory to make further progress in RL, many researchers begin to revisit the linear-quadratic regulator (LQR) problem, whose setting is simple and yet captures the characteristics of RL. Inspired by this, this work is concerned with the model-free design of stochastic LQR controller for linear systems subject to Gaussian noises, from the perspective of both RL and primal-dual optimization. From the RL perspective, we first develop a new model-free off-policy policy iteration (MF-OPPI) algorithm, in which the sampled data is repeatedly used for updating the policy to alleviate the data-hungry problem to some extent. We then provide a rigorous analysis for algorithm convergence by showing that the involved iterations are equivalent to the iterations in the classical policy iteration (PI) algorithm. From the perspective of optimization, we first reformulate the stochastic LQR problem at hand as a constrained non-convex optimization problem, which is shown to have strong duality. Then, to solve this non-convex optimization problem, we propose a model-based primal-dual (MB-PD) algorithm based on the properties of the resulting Karush-Kuhn-Tucker (KKT) conditions. We also give a model-free implementation for the MB-PD algorithm by solving a transformed dual feasibility condition. More importantly, we show that the dual and primal update steps in the MB-PD algorithm can be interpreted as the policy evaluation and policy improvement steps in the PI algorithm, respectively. Finally, we provide one simulation example to show the performance of the proposed algorithms. △ Less

Submitted 16 March, 2021; originally announced March 2021.

A General Control Framework for Boolean Networks

Authors: Shiyong Zhu, Jianquan Lu, Shun-ichi Azuma, Wei Xing Zheng

Abstract: This paper focuses on proposing a general control framework for large-scale Boolean networks (\texttt{BNs}). Only by the network structure, the concept of structural controllability for \texttt{BNs} is formalized. A necessary and sufficient criterion is derived for the structural controllability of \texttt{BNs}; it can be verified with $Θ(n^2)$ time, where $n$ is the number of network nodes. An in… ▽ More This paper focuses on proposing a general control framework for large-scale Boolean networks (\texttt{BNs}). Only by the network structure, the concept of structural controllability for \texttt{BNs} is formalized. A necessary and sufficient criterion is derived for the structural controllability of \texttt{BNs}; it can be verified with $Θ(n^2)$ time, where $n$ is the number of network nodes. An interesting conclusion is shown as that a \texttt{BN} is structurally controllable if and only if it is structurally fixed-time controllable. Afterwards, the minimum node control problem with respect to structural controllability is proved to be NP-hard for structural \texttt{BNs}. In virtue of the structurally controllable criterion, three difficult control issues can be efficiently addressed and accompanied with some advantages. In terms of the design of pinning controllers to generate a controllable \texttt{BN}, by utilizing the structurally controllable criterion, the selection procedure for the pinning node set is developed for the first time instead of just checking the controllability under the given pinning control form; the pinning controller is of distributed form, and the time complexity is $Θ(n2^{3d^{\ast}}+2(n+m)^2)$, where $m$ and $d^\ast$ are respectively the number of generators and the maximum vertex in-degree. With regard to the control design for stabilization in probability of probabilistic \texttt{BNs} (\texttt{PBNs}), an important theorem is proved to reveal the equivalence between several types of stability. The existing difficulties on the stabilization in probability are then solved to some extent via the structurally controllable criterion. △ Less

Submitted 26 May, 2021; v1 submitted 30 June, 2020; originally announced July 2020.

Sub/super-stochastic matrix with applications to bipartite tracking control over signed networks

Authors: Lei Shi, Wei Xing Zheng, **liang Shao, Yuhua Cheng

Abstract: In this contribution, the properties of sub-stochastic matrix and super-stochastic matrix are applied to analyze the bipartite tracking issues of multi-agent systems (MASs) over signed networks, in which the edges with positive weight and negative weight are used to describe the cooperation and competition among the agents, respectively. For the sake of integrity of the study, the overall content… ▽ More In this contribution, the properties of sub-stochastic matrix and super-stochastic matrix are applied to analyze the bipartite tracking issues of multi-agent systems (MASs) over signed networks, in which the edges with positive weight and negative weight are used to describe the cooperation and competition among the agents, respectively. For the sake of integrity of the study, the overall content is divided into two parts. In the first part, we examine the dynamics of bipartite tracking for first-order MASs, second-order MASs and general linear MASs in the presence of asynchronous interactions, respectively. Asynchronous interactions mean that each agent only interacts with its neighbors at the instants when it wants to update the state rather than kee** compulsory consistent with other agents. In the second part, we investigate the problems of bipartite tracing in different practical scenarios, such as time delays, switching topologies, random networks, lossy links, matrix disturbance, external noise disturbance, and a leader of unmeasurable velocity and acceleration. The bipartite tracking problems of MASs under these different scenario settings can be equivalently converted into the product convergence problems of infinite sub-stochastic matrices (ISubSM) or infinite super-stochastic matrices (ISupSM). With the help of nonnegative matrix theory together with some key results related to the compositions of directed edge sets, we establish systematic algebraic-graphical methods of dealing with the product convergence of ISubSM and ISupSM. Finally, the efficiency of the proposed methods is verified by computer simulations. △ Less

Submitted 16 December, 2020; v1 submitted 4 April, 2020; originally announced April 2020.