-
Optimal Control of a Stochastic Power System -- Algorithms and Mathematical Analysis
Authors:
Zhen Wang,
Kaihua Xi,
Aijie Cheng,
Hai Xiang Lin,
Jan H. van Schuppen
Abstract:
The considered optimal control problem of a stochastic power system, is to select the set of power supply vectors which infimizes the probability that the phase-angle differences of any power flow of the network, endangers the transient stability of the power system by leaving a critical subset. The set of control laws is restricted to be a periodically recomputed set of fixed power supply vectors…
▽ More
The considered optimal control problem of a stochastic power system, is to select the set of power supply vectors which infimizes the probability that the phase-angle differences of any power flow of the network, endangers the transient stability of the power system by leaving a critical subset. The set of control laws is restricted to be a periodically recomputed set of fixed power supply vectors based on predictions of power demand for the next short horizon. Neither state feedback nor output feedback is used. The associated control objective function is Lipschitz continuous, nondifferentiable, and nonconvex. The results of the paper include that a minimum exists in the value range of the control objective function. Furthermore, it includes a two-step procedure to compute an approximate minimizer based on two key methods: (1) a projected generalized subgradient method for computing an initial vector, and (2) a steepest descent method for approximating a local minimizer. Finally, it includes two convergence theorems that an approximation sequence converges to a local minimum.
△ Less
Submitted 30 January, 2024;
originally announced January 2024.
-
Unlocking Deep Learning: A BP-Free Approach for Parallel Block-Wise Training of Neural Networks
Authors:
Anzhe Cheng,
Zhenkun Wang,
Chenzhong Yin,
Mingxi Cheng,
Heng **,
Xiongye Xiao,
Shahin Nazarian,
Paul Bogdan
Abstract:
Backpropagation (BP) has been a successful optimization technique for deep learning models. However, its limitations, such as backward- and update-locking, and its biological implausibility, hinder the concurrent updating of layers and do not mimic the local learning processes observed in the human brain. To address these issues, recent research has suggested using local error signals to asynchron…
▽ More
Backpropagation (BP) has been a successful optimization technique for deep learning models. However, its limitations, such as backward- and update-locking, and its biological implausibility, hinder the concurrent updating of layers and do not mimic the local learning processes observed in the human brain. To address these issues, recent research has suggested using local error signals to asynchronously train network blocks. However, this approach often involves extensive trial-and-error iterations to determine the best configuration for local training. This includes decisions on how to decouple network blocks and which auxiliary networks to use for each block. In our work, we introduce a novel BP-free approach: a block-wise BP-free (BWBPF) neural network that leverages local error signals to optimize distinct sub-neural networks separately, where the global loss is only responsible for updating the output layer. The local error signals used in the BP-free model can be computed in parallel, enabling a potential speed-up in the weight update process through parallel implementation. Our experimental results consistently show that this approach can identify transferable decoupled architectures for VGG and ResNet variations, outperforming models trained with end-to-end backpropagation and other state-of-the-art block-wise learning techniques on datasets such as CIFAR-10 and Tiny-ImageNet. The code is released at https://github.com/Belis0811/BWBPF.
△ Less
Submitted 20 December, 2023;
originally announced December 2023.
-
Control of the Power Flows of a Stochastic Power System
Authors:
Zhen Wang,
Kaihua Xi,
Aijie Cheng,
Hai Xiang Lin,
Jan H. van Schuppen
Abstract:
How to determine the power supply of a power system to guarantee that the state remains during a short horizon in a critical subset of the state set? The critical subset is related to the power flows of all power lines of a power system and to transient stability. The control objective is to minimize a cost function. That function is defined as the maximal power flow over all power lines, includin…
▽ More
How to determine the power supply of a power system to guarantee that the state remains during a short horizon in a critical subset of the state set? The critical subset is related to the power flows of all power lines of a power system and to transient stability. The control objective is to minimize a cost function. That function is defined as the maximal power flow over all power lines, including a multiple of its standard deviation, as a function of the power supply vector. That the controlled system has an improved performance is shown by numerical results of three academic examples including an eight-node academic network, a twelve-node ring network, and a Manhattan-grid network.
△ Less
Submitted 27 November, 2023;
originally announced November 2023.
-
A Critical Escape Probability Formulation for Enhancing the Transient Stability of Power Systems with System Parameter Design
Authors:
Xian Wu,
Kaihua Xi,
Aijie Cheng,
Chenghui Zhang,
Hai Xiang Lin
Abstract:
For the enhancement of the transient stability of power systems, the key is to define a quantitative optimization formulation with system parameters as decision variables. In this paper, we model the disturbances by Gaussian noise and define a metric named Critical Escape Probability (CREP) based on the invariant probability measure of a linearised stochastic processes. CREP characterizes the prob…
▽ More
For the enhancement of the transient stability of power systems, the key is to define a quantitative optimization formulation with system parameters as decision variables. In this paper, we model the disturbances by Gaussian noise and define a metric named Critical Escape Probability (CREP) based on the invariant probability measure of a linearised stochastic processes. CREP characterizes the probability of the state esca** from a critical set. CREP involves all the system parameters and reflects the size of the basin of attraction of the nonlinear systems. An optimization framework that minimizes CREP with the system parameters as decision variablesis is presented. Simulations show that the mean first hitting time when the state hits the boundary of the critical set, that is often used to describe the stability of nonlinear systems, is dramatically increased by minimizing CREP. This indicates that the transient stability of the system is effectively enhanced. It also shown that suppressing the state fluctuations only is insufficient for enhancing the transient stability. In addition, the famous Braess' paradox which also exists in power systems is revisited. Surprisingly, it turned out that the paradoxes identified by the traditional metric may not exist according to CREP. This new metric opens a new avenue for the transient stability analysis of future power systems integrated with large amounts of renewable energy.
△ Less
Submitted 13 September, 2023;
originally announced September 2023.
-
AxonCallosumEM Dataset: Axon Semantic Segmentation of Whole Corpus Callosum cross section from EM Images
Authors:
Ao Cheng,
Guoqiang Zhao,
Lirong Wang,
Ruobing Zhang
Abstract:
The electron microscope (EM) remains the predominant technique for elucidating intricate details of the animal nervous system at the nanometer scale. However, accurately reconstructing the complex morphology of axons and myelin sheaths poses a significant challenge. Furthermore, the absence of publicly available, large-scale EM datasets encompassing complete cross sections of the corpus callosum,…
▽ More
The electron microscope (EM) remains the predominant technique for elucidating intricate details of the animal nervous system at the nanometer scale. However, accurately reconstructing the complex morphology of axons and myelin sheaths poses a significant challenge. Furthermore, the absence of publicly available, large-scale EM datasets encompassing complete cross sections of the corpus callosum, with dense ground truth segmentation for axons and myelin sheaths, hinders the advancement and evaluation of holistic corpus callosum reconstructions. To surmount these obstacles, we introduce the AxonCallosumEM dataset, comprising a 1.83 times 5.76mm EM image captured from the corpus callosum of the Rett Syndrome (RTT) mouse model, which entail extensive axon bundles. We meticulously proofread over 600,000 patches at a resolution of 1024 times 1024, thus providing a comprehensive ground truth for myelinated axons and myelin sheaths. Additionally, we extensively annotated three distinct regions within the dataset for the purposes of training, testing, and validation. Utilizing this dataset, we develop a fine-tuning methodology that adapts Segment Anything Model (SAM) to EM images segmentation tasks, called EM-SAM, enabling outperforms other state-of-the-art methods. Furthermore, we present the evaluation results of EM-SAM as a baseline.
△ Less
Submitted 5 July, 2023;
originally announced July 2023.
-
Explicit formulas for the Variance of the State of a Linearized Power System driven by Gaussian stochastic disturbances
Authors:
Xian Wu,
Kaihua Xi,
Aijie Cheng,
Hai Xiang Lin,
Jan H van Schuppen,
Chenghui Zhang
Abstract:
We look into the fluctuations caused by disturbances in power systems. In the linearized system of the power systems, the disturbance is modeled by a Brownian motion process, and the fluctuations are described by the covariance matrix of the associated stochastic process at the invariant probability distribution. We derive explicit formulas for the covariance matrix for the system with a uniform d…
▽ More
We look into the fluctuations caused by disturbances in power systems. In the linearized system of the power systems, the disturbance is modeled by a Brownian motion process, and the fluctuations are described by the covariance matrix of the associated stochastic process at the invariant probability distribution. We derive explicit formulas for the covariance matrix for the system with a uniform dam**-inertia ratio. The variance of the frequency at the node with the disturbance is significantly bigger than the sum of those at all the other nodes, indicating the disturbance effects the node most, according to research on the variances in complete graphs and star graphs. Additionally, it is shown that adding new nodes typically does not aid in reducing the variations at the disturbance's source node. Finally, it is shown by the explicit formulas that the line capacity affect the variation of the frequency and the inertia affects the variance of the phase differences.
△ Less
Submitted 16 March, 2023; v1 submitted 13 February, 2023;
originally announced February 2023.
-
Synchronization of Coupled Phase Oscillators with Stochastic Disturbances and the Cycle Space of the Graph
Authors:
Kaihua Xi,
Zhen Wang,
Aijie Cheng,
Hai Xiang Lin,
Jan H. van Schuppen,
Chenghui Zhang
Abstract:
The synchronization stability of a complex network system of coupled phase oscillators is discussed. In case the network is affected by disturbances, a stochastic linearized system of the coupled phase oscillators may be used to determine the fluctuations of phase differences in the lines between the nodes and to identify the vulnerable lines that may lead to desynchronization. The main result is…
▽ More
The synchronization stability of a complex network system of coupled phase oscillators is discussed. In case the network is affected by disturbances, a stochastic linearized system of the coupled phase oscillators may be used to determine the fluctuations of phase differences in the lines between the nodes and to identify the vulnerable lines that may lead to desynchronization. The main result is the derivation of the asymptotic variance matrix of the phase differences which characterizes the severity of the fluctuations. It is found that the cycle space of the graph of the system plays a role in this characterization. With theory of the cycle space, the effect of forming small cycles on the fluctuations are evaluated. It is proven that adding a new line or increasing the coupling strength of a line affect the fluctuations in the lines in any cycle including this line while it does not affect the fluctuations in the other lines. In particular, if the phase differences at the synchronous state are not changed by these actions, then the affected fluctuations reduce.
△ Less
Submitted 30 March, 2023; v1 submitted 31 December, 2021;
originally announced January 2022.
-
Hyperspectral Image Denoising Using Non-convex Local Low-rank and Sparse Separation with Spatial-Spectral Total Variation Regularization
Authors:
Chong Peng,
Yang Liu,
Yongyong Chen,
Xinxin Wu,
Andrew Cheng,
Zhao Kang,
Chenglizhao Chen,
Qiang Cheng
Abstract:
In this paper, we propose a novel nonconvex approach to robust principal component analysis for HSI denoising, which focuses on simultaneously develo** more accurate approximations to both rank and column-wise sparsity for the low-rank and sparse components, respectively. In particular, the new method adopts the log-determinant rank approximation and a novel $\ell_{2,\log}$ norm, to restrict the…
▽ More
In this paper, we propose a novel nonconvex approach to robust principal component analysis for HSI denoising, which focuses on simultaneously develo** more accurate approximations to both rank and column-wise sparsity for the low-rank and sparse components, respectively. In particular, the new method adopts the log-determinant rank approximation and a novel $\ell_{2,\log}$ norm, to restrict the local low-rank or column-wisely sparse properties for the component matrices, respectively. For the $\ell_{2,\log}$-regularized shrinkage problem, we develop an efficient, closed-form solution, which is named $\ell_{2,\log}$-shrinkage operator. The new regularization and the corresponding operator can be generally used in other problems that require column-wise sparsity. Moreover, we impose the spatial-spectral total variation regularization in the log-based nonconvex RPCA model, which enhances the global piece-wise smoothness and spectral consistency from the spatial and spectral views in the recovered HSI. Extensive experiments on both simulated and real HSIs demonstrate the effectiveness of the proposed method in denoising HSIs.
△ Less
Submitted 8 January, 2022;
originally announced January 2022.
-
Learning to automate cryo-electron microscopy data collection with Ptolemy
Authors:
Paul T. Kim,
Alex J. Noble,
Anchi Cheng,
Tristan Bepler
Abstract:
Over the past decade, cryogenic electron microscopy (cryo-EM) has emerged as a primary method for determining near-native, near-atomic resolution 3D structures of biological macromolecules. In order to meet increasing demand for cryo-EM, automated methods to improve throughput and efficiency while lowering costs are needed. Currently, all high-magnification cryo-EM data collection softwares requir…
▽ More
Over the past decade, cryogenic electron microscopy (cryo-EM) has emerged as a primary method for determining near-native, near-atomic resolution 3D structures of biological macromolecules. In order to meet increasing demand for cryo-EM, automated methods to improve throughput and efficiency while lowering costs are needed. Currently, all high-magnification cryo-EM data collection softwares require human input and manual tuning of parameters. Expert operators must navigate low- and medium-magnification images to find good high-magnification collection locations. Automating this is non-trivial: the images suffer from low signal-to-noise ratio and are affected by a range of experimental parameters that can differ for each collection session. Here, we use various computer vision algorithms, including mixture models, convolutional neural networks, and U-Nets to develop the first pipeline to automate low- and medium-magnification targeting. Learned models in this pipeline are trained on a large internal dataset of images from real world cryo-EM data collection sessions, labeled with locations that were selected by operators. Using these models, we show that we can effectively detect and classify regions of interest in low- and medium-magnification images, and can generalize to unseen sessions, as well as to images captured using different microscopes from external facilities. We expect our open-source pipeline, Ptolemy, will be both immediately useful as a tool for automation of cryo-EM data collection, and serve as a foundation for future advanced methods for efficient and automated cryo-EM microscopy.
△ Less
Submitted 14 January, 2022; v1 submitted 1 December, 2021;
originally announced December 2021.
-
Synchronization of Power Systems under Stochastic Disturbances
Authors:
Zhen Wang,
Kaihua Xi,
Aijie Cheng,
Hai Xiang Lin,
André C. M. Ran,
Jan H. van Schuppen,
Chenghui Zhang
Abstract:
The synchronization of power generators is an important condition for the proper functioning of a power system, in which the fluctuations in frequency and the phase angle differences between the generators are sufficiently small when subjected to stochastic disturbances. Serious fluctuations can prompt desynchronization, which may lead to widespread power outages. Here, we model the stochastic dis…
▽ More
The synchronization of power generators is an important condition for the proper functioning of a power system, in which the fluctuations in frequency and the phase angle differences between the generators are sufficiently small when subjected to stochastic disturbances. Serious fluctuations can prompt desynchronization, which may lead to widespread power outages. Here, we model the stochastic disturbance by a Brownian motion process in the linearized system of the non-linear power systems and characterize the fluctuations by the variances of the frequency and the phase angle differences in the invariant probability distribution. We propose a method to calculate the variances of the frequency and the phase angle differences. For the system with uniform disturbance-dam** ratio, we derive explicit formulas for the variance matrices of the frequency and the phase angle differences. It is shown that the fluctuation of the frequency at a node depends on the disturbance-dam** ratio and the inertia at this node only, and the fluctuations of the phase angle differences in the lines are independent of the inertia. In particular, the synchronization stability is related to the cycle space of the network. We reveal the influences of constructing new lines and increasing capacities of lines on the fluctuations in the phase angle differences in the existing lines. The results are illustrated for the transmission system of Shandong Province of China. For the system with non-uniform disturbance-dam** ratio, we further obtain bounds of the variance matrices.
△ Less
Submitted 17 August, 2023; v1 submitted 9 August, 2021;
originally announced August 2021.
