-
Graph Neural Networks on Factor Graphs for Robust, Fast, and Scalable Linear State Estimation with PMUs
Authors:
Ognjen Kundacina,
Mirsad Cosovic,
Dragisa Miskovic,
Dejan Vukobratovic
Abstract:
As phasor measurement units (PMUs) become more widely used in transmission power systems, a fast state estimation (SE) algorithm that can take advantage of their high sample rates is needed. To accomplish this, we present a method that uses graph neural networks (GNNs) to learn complex bus voltage estimates from PMU voltage and current measurements. We propose an original implementation of GNNs ov…
▽ More
As phasor measurement units (PMUs) become more widely used in transmission power systems, a fast state estimation (SE) algorithm that can take advantage of their high sample rates is needed. To accomplish this, we present a method that uses graph neural networks (GNNs) to learn complex bus voltage estimates from PMU voltage and current measurements. We propose an original implementation of GNNs over the power system's factor graph to simplify the integration of various types and quantities of measurements on power system buses and branches. Furthermore, we augment the factor graph to improve the robustness of GNN predictions. This model is highly efficient and scalable, as its computational complexity is linear with respect to the number of nodes in the power system. Training and test examples were generated by randomly sampling sets of power system measurements and annotated with the exact solutions of linear SE with PMUs. The numerical results demonstrate that the GNN model provides an accurate approximation of the SE solutions. Furthermore, errors caused by PMU malfunctions or communication failures that would normally make the SE problem unobservable have a local effect and do not deteriorate the results in the rest of the power system.
△ Less
Submitted 28 April, 2023;
originally announced April 2023.
-
Scalability and Sample Efficiency Analysis of Graph Neural Networks for Power System State Estimation
Authors:
Ognjen Kundacina,
Gorana Gojic,
Mirsad Cosovic,
Dragisa Miskovic,
Dejan Vukobratovic
Abstract:
Data-driven state estimation (SE) is becoming increasingly important in modern power systems, as it allows for more efficient analysis of system behaviour using real-time measurement data. This paper thoroughly evaluates a phasor measurement unit-only state estimator based on graph neural networks (GNNs) applied over factor graphs. To assess the sample efficiency of the GNN model, we perform multi…
▽ More
Data-driven state estimation (SE) is becoming increasingly important in modern power systems, as it allows for more efficient analysis of system behaviour using real-time measurement data. This paper thoroughly evaluates a phasor measurement unit-only state estimator based on graph neural networks (GNNs) applied over factor graphs. To assess the sample efficiency of the GNN model, we perform multiple training experiments on various training set sizes. Additionally, to evaluate the scalability of the GNN model, we conduct experiments on power systems of various sizes. Our results show that the GNN-based state estimator exhibits high accuracy and efficient use of data. Additionally, it demonstrated scalability in terms of both memory usage and inference time, making it a promising solution for data-driven SE in modern power systems.
△ Less
Submitted 2 March, 2023; v1 submitted 28 February, 2023;
originally announced March 2023.
-
Distributed Inference over Linear Models using Alternating Gaussian Belief Propagation
Authors:
Mirsad Cosovic,
Dragisa Miskovic,
Muhamed Delalic,
Darijo Raca,
Dejan Vukobratovic
Abstract:
We consider the problem of maximum likelihood estimation in linear models represented by factor graphs and solved via the Gaussian belief propagation algorithm. Motivated by massive internet of things (IoT) networks and edge computing, we set the above problem in a clustered scenario, where the factor graph is divided into clusters and assigned for processing in a distributed fashion across a numb…
▽ More
We consider the problem of maximum likelihood estimation in linear models represented by factor graphs and solved via the Gaussian belief propagation algorithm. Motivated by massive internet of things (IoT) networks and edge computing, we set the above problem in a clustered scenario, where the factor graph is divided into clusters and assigned for processing in a distributed fashion across a number of edge computing nodes. For these scenarios, we show that an alternating Gaussian belief propagation (AGBP) algorithm that alternates between inter- and intra-cluster iterations, demonstrates superior performance in terms of convergence properties compared to the existing solutions in the literature. We present a comprehensive framework and introduce appropriate metrics to analyse AGBP algorithm across a wide range of linear models characterised by symmetric and non-symmetric, square, and rectangular matrices. We extend the analysis to the case of dynamic linear models by introducing dynamic arrival of new data over time. Using a combination of analytical and extensive numerical results, we show the efficiency and scalability of AGBP algorithm, making it a suitable solution for large-scale inference in massive IoT networks.
△ Less
Submitted 30 May, 2023; v1 submitted 18 October, 2022;
originally announced October 2022.
-
Distributed Nonlinear State Estimation in Electric Power Systems using Graph Neural Networks
Authors:
Ognjen Kundacina,
Mirsad Cosovic,
Dragisa Miskovic,
Dejan Vukobratovic
Abstract:
Nonlinear state estimation (SE), with the goal of estimating complex bus voltages based on all types of measurements available in the power system, is usually solved using the iterative Gauss-Newton method. The nonlinear SE presents some difficulties when considering inputs from both phasor measurement units and supervisory control and data acquisition system. These include numerical instabilities…
▽ More
Nonlinear state estimation (SE), with the goal of estimating complex bus voltages based on all types of measurements available in the power system, is usually solved using the iterative Gauss-Newton method. The nonlinear SE presents some difficulties when considering inputs from both phasor measurement units and supervisory control and data acquisition system. These include numerical instabilities, convergence time depending on the starting point of the iterative method, and the quadratic computational complexity of a single iteration regarding the number of state variables. This paper introduces an original graph neural network based SE implementation over the augmented factor graph of the nonlinear power system SE, capable of incorporating measurements on both branches and buses, as well as both phasor and legacy measurements. The proposed regression model has linear computational complexity during the inference time once trained, with a possibility of distributed implementation. Since the method is noniterative and non-matrix-based, it is resilient to the problems that the Gauss-Newton solver is prone to. Aside from prediction accuracy on the test set, the proposed model demonstrates robustness when simulating cyber attacks and unobservable scenarios due to communication irregularities. In those cases, prediction errors are sustained locally, with no effect on the rest of the power system's results.
△ Less
Submitted 8 September, 2022; v1 submitted 23 July, 2022;
originally announced July 2022.
-
Near Real-Time Distributed State Estimation via AI/ML-Empowered 5G Networks
Authors:
Ognjen Kundacina,
Miodrag Forcan,
Mirsad Cosovic,
Darijo Raca,
Merim Dzaferagic,
Dragisa Miskovic,
Mirjana Maksimovic,
Dejan Vukobratovic
Abstract:
Fifth-Generation (5G) networks have a potential to accelerate power system transition to a flexible, softwarized, data-driven, and intelligent grid. With their evolving support for Machine Learning (ML)/Artificial Intelligence (AI) functions, 5G networks are expected to enable novel data-centric Smart Grid (SG) services. In this paper, we explore how data-driven SG services could be integrated wit…
▽ More
Fifth-Generation (5G) networks have a potential to accelerate power system transition to a flexible, softwarized, data-driven, and intelligent grid. With their evolving support for Machine Learning (ML)/Artificial Intelligence (AI) functions, 5G networks are expected to enable novel data-centric Smart Grid (SG) services. In this paper, we explore how data-driven SG services could be integrated with ML/AI-enabled 5G networks in a symbiotic relationship. We focus on the State Estimation (SE) function as a key element of the energy management system and focus on two main questions. Firstly, in a tutorial fashion, we present an overview on how distributed SE can be integrated with the elements of the 5G core network and radio access network architecture. Secondly, we present and compare two powerful distributed SE methods based on: i) graphical models and belief propagation, and ii) graph neural networks. We discuss their performance and capability to support a near real-time distributed SE via 5G network, taking into account communication delays.
△ Less
Submitted 22 July, 2022;
originally announced July 2022.
-
Robust and Fast Data-Driven Power System State Estimator Using Graph Neural Networks
Authors:
Ognjen Kundacina,
Mirsad Cosovic,
Dejan Vukobratovic
Abstract:
The power system state estimation (SE) algorithm estimates the complex bus voltages based on the available set of measurements. Because phasor measurement units (PMUs) are becoming more widely employed in transmission power systems, a fast SE solver capable of exploiting PMUs' high sample rates is required. To accomplish this, we present a method for training a model based on graph neural networks…
▽ More
The power system state estimation (SE) algorithm estimates the complex bus voltages based on the available set of measurements. Because phasor measurement units (PMUs) are becoming more widely employed in transmission power systems, a fast SE solver capable of exploiting PMUs' high sample rates is required. To accomplish this, we present a method for training a model based on graph neural networks (GNNs) to learn estimates from PMU voltage and current measurements, which, once it is trained, has a linear computational complexity with respect to the number of nodes in the power system. We propose an original GNN implementation over the power system's factor graph to simplify the incorporation of various types and numbers of measurements both on power system buses and branches. Furthermore, we augment the factor graph to improve the robustness of GNN predictions. Training and test examples were generated by randomly sampling sets of power system measurements and annotated with the exact solutions of linear SE with PMUs. The numerical results demonstrate that the GNN model provides an accurate approximation of the SE solutions. Additionally, errors caused by PMU malfunctions or the communication failures that make the SE problem unobservable have a local effect and do not deteriorate the results in the rest of the power system.
△ Less
Submitted 6 June, 2022;
originally announced June 2022.
-
Realistic Video Sequences for Subjective QoE Analysis
Authors:
Kerim Hodzic,
Mirsad Cosovic,
Sasa Mrdovic,
Jason J. Quinlan,
Darijo Raca
Abstract:
Multimedia streaming over the Internet (live and on demand) is the cornerstone of modern Internet carrying more than 60% of all traffic. With such high demand, delivering outstanding user experience is a crucial and challenging task. To evaluate user QoE many researchers deploy subjective quality assessments where participants watch and rate videos artificially infused with various temporal and sp…
▽ More
Multimedia streaming over the Internet (live and on demand) is the cornerstone of modern Internet carrying more than 60% of all traffic. With such high demand, delivering outstanding user experience is a crucial and challenging task. To evaluate user QoE many researchers deploy subjective quality assessments where participants watch and rate videos artificially infused with various temporal and spatial impairments. To aid current efforts in bridging the gap between the map** of objective video QoE metrics to user experience, we developed DashReStreamer, an open-source framework for re-creating adaptively streamed video in real networks. DashReStreamer utilises a log created by a HAS algorithm run in an uncontrolled environment (i.e., wired or wireless networks), encoding visual changes and stall events in one video file. These videos are applicable for subjective QoE evaluation mimicking realistic network conditions.
To supplement DashReStreamer, we re-create 234 realistic video clips, based on video logs collected from real mobile and wireless networks. In addition our dataset contains both video logs with all decisions made by the HASalgorithm and network bandwidth profile illustrating throughput distribution. We believe this dataset and framework will permit other researchers in their pursuit for the final frontier in understanding the impact of video QoE dynamics.
△ Less
Submitted 14 April, 2022;
originally announced April 2022.
-
State Estimation in Electric Power Systems Leveraging Graph Neural Networks
Authors:
Ognjen Kundacina,
Mirsad Cosovic,
Dejan Vukobratovic
Abstract:
The goal of the state estimation (SE) algorithm is to estimate complex bus voltages as state variables based on the available set of measurements in the power system. Because phasor measurement units (PMUs) are increasingly being used in transmission power systems, there is a need for a fast SE solver that can take advantage of high sampling rates of PMUs. This paper proposes training a graph neur…
▽ More
The goal of the state estimation (SE) algorithm is to estimate complex bus voltages as state variables based on the available set of measurements in the power system. Because phasor measurement units (PMUs) are increasingly being used in transmission power systems, there is a need for a fast SE solver that can take advantage of high sampling rates of PMUs. This paper proposes training a graph neural network (GNN) to learn the estimates given the PMU voltage and current measurements as inputs, with the intent of obtaining fast and accurate predictions during the evaluation phase. GNN is trained using synthetic datasets, created by randomly sampling sets of measurements in the power system and labelling them with a solution obtained using a linear SE with PMUs solver. The presented results display the accuracy of GNN predictions in various test scenarios and tackle the sensitivity of the predictions to the missing input data.
△ Less
Submitted 12 April, 2022; v1 submitted 11 January, 2022;
originally announced January 2022.
-
Observability Analysis for Large-Scale Power Systems Using Factor Graphs
Authors:
Mirsad Cosovic,
Muhamed Delalic,
Darijo Raca,
Dejan Vukobratovic
Abstract:
The state estimation algorithm estimates the values of the state variables based on the measurement model described as the system of equations. Prior to applying the state estimation algorithm, the existence and uniqueness of the solution of the underlying system of equations is determined through the observability analysis. If a unique solution does not exist, the observability analysis defines o…
▽ More
The state estimation algorithm estimates the values of the state variables based on the measurement model described as the system of equations. Prior to applying the state estimation algorithm, the existence and uniqueness of the solution of the underlying system of equations is determined through the observability analysis. If a unique solution does not exist, the observability analysis defines observable islands and further defines an additional set of equations (measurements) needed to determine a unique solution. For the first time, we utilise factor graphs and Gaussian belief propagation algorithm to define a novel observability analysis approach. The observable islands and placement of measurements to restore observability are identified by following the evolution of variances across the iterations of the Gaussian belief propagation algorithm over the factor graph. Due to sparsity of the underlying power network, the resulting method has the linear computational complexity (assuming a constant number of iterations) making it particularly suitable for solving large-scale systems. The method can be flexibly matched to distributed computational resources, allowing for determination of observable islands and observability restoration in a distributed fashion. Finally, we discuss performances of the proposed observability analysis using power systems whose size ranges between 1354 and 70000 buses.
△ Less
Submitted 2 February, 2021; v1 submitted 24 July, 2019;
originally announced July 2019.
-
Distributed Intelligent Illumination Control in the Context of Probabilistic Graphical Models
Authors:
M. Cosovic,
T. Devaja,
D. Bajovic,
J. Machaj,
G. McCutcheon,
V. Stankovic,
L. Stankovic,
D. Vukobratovic
Abstract:
Lighting systems based on light-emitting diodes (LEDs) possess many benefits over their incandescent counterparts including longer lifespans, lower energy costs, better quality of light and no toxic elements, all without sacrificing consumer satisfaction. Their lifespan is not affected by switching frequency allowing for better illumination control and system efficiency. In this paper, we present…
▽ More
Lighting systems based on light-emitting diodes (LEDs) possess many benefits over their incandescent counterparts including longer lifespans, lower energy costs, better quality of light and no toxic elements, all without sacrificing consumer satisfaction. Their lifespan is not affected by switching frequency allowing for better illumination control and system efficiency. In this paper, we present a fully distributed energy-saving illumination dimming control strategy for the system of a lighting network which consists of a group of LEDs and user-associated devices. In order to solve the optimization problem, we are using a distributed approach that utilizes factor graphs and the belief propagation algorithm. Using probabilistic graphical models to represent and solve the system model provides for a natural description of the problem structure, where user devices and LED controllers exchange data via line-of-sight communication.
△ Less
Submitted 12 June, 2019;
originally announced June 2019.
-
Design and Analysis of Distributed State Estimation Algorithms Based on Belief Propagation and Applications in Smart Grids
Authors:
Mirsad Cosovic
Abstract:
We present a detailed study on application of factor graphs and the belief propagation (BP) algorithm to the power system state estimation (SE) problem. We start from the BP solution for the linear DC model, for which we provide a detailed convergence analysis. Using BP-based DC model we propose a fast real-time state estimator for the power system SE. The proposed estimator is easy to distribute…
▽ More
We present a detailed study on application of factor graphs and the belief propagation (BP) algorithm to the power system state estimation (SE) problem. We start from the BP solution for the linear DC model, for which we provide a detailed convergence analysis. Using BP-based DC model we propose a fast real-time state estimator for the power system SE. The proposed estimator is easy to distribute and parallelize, thus alleviating computational limitations and allowing for processing measurements in real time. The presented algorithm may run as a continuous process.
Using insights from the DC model, we use two different approaches to derive the BP algorithm for the non-linear model. The first method directly applies BP methodology, however, providing only approximate BP solution for the non-linear model. In the second approach, we make a key further step by providing the solution in which the BP is applied sequentially over the non-linear model, akin to what is done by the Gauss-Newton method. The resulting iterative Gauss-Newton belief propagation (GN-BP) algorithm can be interpreted as a distributed Gauss-Newton method with the same accuracy as the centralized SE.
△ Less
Submitted 20 November, 2018;
originally announced November 2018.
-
Linear State Estimation via 5G C-RAN Cellular Networks using Gaussian Belief Propagation
Authors:
Mirsad Cosovic,
Dejan Vukobratovic,
Vladimir Stankovic
Abstract:
Machine-type communications and large-scale information processing architectures are among key (r)evolutionary enhancements of emerging fifth-generation (5G) mobile cellular networks. Massive data acquisition and processing will make 5G network an ideal platform for large-scale system monitoring and control with applications in future smart transportation, connected industry, power grids, etc. In…
▽ More
Machine-type communications and large-scale information processing architectures are among key (r)evolutionary enhancements of emerging fifth-generation (5G) mobile cellular networks. Massive data acquisition and processing will make 5G network an ideal platform for large-scale system monitoring and control with applications in future smart transportation, connected industry, power grids, etc. In this work, we investigate a capability of such a 5G network architecture to provide the state estimate of an underlying linear system from the input obtained via large-scale deployment of measurement devices. Assuming that the measurements are communicated via densely deployed cloud radio access network (C-RAN), we formulate and solve the problem of estimating the system state from the set of signals collected at C-RAN base stations. Our solution, based on the Gaussian Belief-Propagation (GBP) framework, allows for large-scale and distributed deployment within the emerging 5G information processing architectures. The presented numerical study demonstrates the accuracy, convergence behavior and scalability of the proposed GBP-based solution to the large-scale state estimation problem.
△ Less
Submitted 2 February, 2018; v1 submitted 24 October, 2017;
originally announced October 2017.
-
Fast Real-Time DC State Estimation in Electric Power Systems Using Belief Propagation
Authors:
Mirsad Cosovic,
Dejan Vukobratovic
Abstract:
We propose a fast real-time state estimator based on the belief propagation algorithm for the power system state estimation. The proposed estimator is easy to distribute and parallelize, thus alleviating computational limitations and allowing for processing measurements in real time. The presented algorithm may run as a continuous process, with each new measurement being seamlessly processed by th…
▽ More
We propose a fast real-time state estimator based on the belief propagation algorithm for the power system state estimation. The proposed estimator is easy to distribute and parallelize, thus alleviating computational limitations and allowing for processing measurements in real time. The presented algorithm may run as a continuous process, with each new measurement being seamlessly processed by the distributed state estimator. In contrast to the matrix-based state estimation methods, the belief propagation approach is robust to ill-conditioned scenarios caused by significant differences between measurement variances, thus resulting in a solution that eliminates observability analysis. Using the DC model, we numerically demonstrate the performance of the state estimator in a realistic real-time system model with asynchronous measurements. We note that the extension to the AC state estimation is possible within the same framework.
△ Less
Submitted 11 August, 2017; v1 submitted 3 May, 2017;
originally announced May 2017.
-
5G Mobile Cellular Networks: Enabling Distributed State Estimation for Smart Grids
Authors:
Mirsad Cosovic,
Achilleas Tsitsimelis,
Dejan Vukobratovic,
Javier Matamoros,
Carles Anton-Haro
Abstract:
With transition towards 5G, mobile cellular networks are evolving into a powerful platform for ubiquitous large-scale information acquisition, communication, storage and processing. 5G will provide suitable services for mission-critical and real-time applications such as the ones envisioned in future Smart Grids. In this work, we show how emerging 5G mobile cellular network, with its evolution of…
▽ More
With transition towards 5G, mobile cellular networks are evolving into a powerful platform for ubiquitous large-scale information acquisition, communication, storage and processing. 5G will provide suitable services for mission-critical and real-time applications such as the ones envisioned in future Smart Grids. In this work, we show how emerging 5G mobile cellular network, with its evolution of Machine-Type Communications and the concept of Mobile Edge Computing, provides an adequate environment for distributed monitoring and control tasks in Smart Grids. In particular, we present in detail how Smart Grids could benefit from advanced distributed State Estimation methods placed within 5G environment. We present an overview of emerging distributed State Estimation solutions, focusing on those based on distributed optimization and probabilistic graphical models, and investigate their integration as part of the future 5G Smart Grid services.
△ Less
Submitted 20 May, 2017; v1 submitted 1 March, 2017;
originally announced March 2017.
-
Distributed Gauss-Newton Method for State Estimation Using Belief Propagation
Authors:
Mirsad Cosovic,
Dejan Vukobratovic
Abstract:
We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially over a sequence of linear approximations of the SE model, akin to what is done by the Gauss-Newton method. The resulting iterative Gauss-Newton belief propagation…
▽ More
We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially over a sequence of linear approximations of the SE model, akin to what is done by the Gauss-Newton method. The resulting iterative Gauss-Newton belief propagation (GN-BP) algorithm can be interpreted as a distributed Gauss-Newton method with the same accuracy as the centralized SE, however, introducing a number of advantages of the BP framework. The paper provides extensive numerical study of the GN-BP algorithm, provides details on its convergence behavior, and gives a number of useful insights for its implementation.
△ Less
Submitted 26 August, 2018; v1 submitted 19 February, 2017;
originally announced February 2017.
-
Distributed Gauss-Newton Method for AC State Estimation: A Belief Propagation Approach
Authors:
Mirsad Cosovic,
Dejan Vukobratovic
Abstract:
In this paper, we propose a solution to an AC state estimation problem in electric power systems using a fully distributed Gauss-Newton method. The proposed method is placed within the context of factor graphs and belief propagation algorithms and closed-form expressions for belief propagation messages exchanged along the factor graph are derived. The obtained algorithm provides the same solution…
▽ More
In this paper, we propose a solution to an AC state estimation problem in electric power systems using a fully distributed Gauss-Newton method. The proposed method is placed within the context of factor graphs and belief propagation algorithms and closed-form expressions for belief propagation messages exchanged along the factor graph are derived. The obtained algorithm provides the same solution as the conventional weighted least-squares state estimation. Using a simple example, we provide a step-by-step presentation of the proposed algorithm. Finally, we discuss the convergence behaviour using the IEEE 14 bus test case.
△ Less
Submitted 26 May, 2016;
originally announced May 2016.
-
State Estimation in Electric Power Systems Using Belief Propagation: An Extended DC Model
Authors:
Mirsad Cosovic,
Dejan Vukobratovic
Abstract:
In this paper, we model an extended DC state estimation (SE) in an electric power system as a factor graph (FG) and solve it using belief propagation (BP) algorithm. The DC model comprises bus voltage angles as state variables, while the extended DC model includes bus voltage angles and bus voltage magnitudes as state variables. By applying BP to solve the SE problem in the extended DC model, we o…
▽ More
In this paper, we model an extended DC state estimation (SE) in an electric power system as a factor graph (FG) and solve it using belief propagation (BP) algorithm. The DC model comprises bus voltage angles as state variables, while the extended DC model includes bus voltage angles and bus voltage magnitudes as state variables. By applying BP to solve the SE problem in the extended DC model, we obtain a Gaussian BP scenario for which we derive closed-form expressions for BP messages exchanged along the FG. The performance of the BP algorithm is demonstrated for the IEEE 14 bus test case. Finally, the application of BP algorithm on the extended DC scenario provides significant insights into a fundamental structure of BP equations in more complex models such as the AC model - the topic we will investigate in our follow up work. As a side-goal of this paper, we aim at thorough and detailed presentation on applying BP on the SE problem in order to make the powerful BP algorithm more accessible and applicable within the power-engineering community.
△ Less
Submitted 26 May, 2016;
originally announced May 2016.