-
Enriching Neural Network Training Dataset to Improve Worst-Case Performance Guarantees
Authors:
Rahul Nellikkath,
Spyros Chatzivasileiadis
Abstract:
Machine learning algorithms, especially Neural Networks (NNs), are a valuable tool used to approximate non-linear relationships, like the AC-Optimal Power Flow (AC-OPF), with considerable accuracy -- and achieving a speedup of several orders of magnitude when deployed for use. Often in power systems literature, the NNs are trained with a fixed dataset generated prior to the training process. In th…
▽ More
Machine learning algorithms, especially Neural Networks (NNs), are a valuable tool used to approximate non-linear relationships, like the AC-Optimal Power Flow (AC-OPF), with considerable accuracy -- and achieving a speedup of several orders of magnitude when deployed for use. Often in power systems literature, the NNs are trained with a fixed dataset generated prior to the training process. In this paper, we show that adapting the NN training dataset during training can improve the NN performance and substantially reduce its worst-case violations. This paper proposes an algorithm that identifies and enriches the training dataset with critical datapoints that reduce the worst-case violations and deliver a neural network with improved worst-case performance guarantees. We demonstrate the performance of our algorithm in four test power systems, ranging from 39-buses to 162-buses.
△ Less
Submitted 23 March, 2023;
originally announced March 2023.
-
Physics Informed Neural Networks for Phase Locked Loop Transient Stability Assessment
Authors:
Rahul Nellikkath,
Andreas Venzke,
Mohammad Kazem Bakhshizadeh,
Ilgiz Murzakhanov,
Spyros Chatzivasileiadis
Abstract:
A significant increase in renewable energy production is necessary to achieve the UN's net-zero emission targets for 2050. Using power-electronic controllers, such as Phase Locked Loops (PLLs), to keep grid-tied renewable resources in synchronism with the grid can cause fast transient behavior during grid faults leading to instability. However, assessing all the probable scenarios is impractical,…
▽ More
A significant increase in renewable energy production is necessary to achieve the UN's net-zero emission targets for 2050. Using power-electronic controllers, such as Phase Locked Loops (PLLs), to keep grid-tied renewable resources in synchronism with the grid can cause fast transient behavior during grid faults leading to instability. However, assessing all the probable scenarios is impractical, so determining the stability boundary or region of attraction (ROA) is necessary. However, using EMT simulations or Reduced-order models (ROMs) to accurately determine the ROA is computationally expensive. Alternatively, Machine Learning (ML) models have been proposed as an efficient method to predict stability. However, traditional ML algorithms require large amounts of labeled data for training, which is computationally expensive. This paper proposes a Physics-Informed Neural Network (PINN) architecture that accurately predicts the nonlinear transient dynamics of a PLL controller under fault with less labeled training data. The proposed PINN algorithm can be incorporated into conventional simulations, accelerating EMT simulations or ROMs by over 100 times. The PINN algorithm's performance is compared against a ROM and an EMT simulation in PSCAD for the CIGRE benchmark model C4.49, demonstrating its ability to accurately approximate trajectories and ROAs of a PLL controller under varying grid impedance.
△ Less
Submitted 21 March, 2023;
originally announced March 2023.
-
Minimizing Worst-Case Violations of Neural Networks
Authors:
Rahul Nellikkath,
Spyros Chatzivasileiadis
Abstract:
Machine learning (ML) algorithms are remarkably good at approximating complex non-linear relationships. Most ML training processes, however, are designed to deliver ML tools with good average performance, but do not offer any guarantees about their worst-case estimation error. For safety-critical systems such as power systems, this places a major barrier for their adoption. So far, approaches coul…
▽ More
Machine learning (ML) algorithms are remarkably good at approximating complex non-linear relationships. Most ML training processes, however, are designed to deliver ML tools with good average performance, but do not offer any guarantees about their worst-case estimation error. For safety-critical systems such as power systems, this places a major barrier for their adoption. So far, approaches could determine the worst-case violations of only trained ML algorithms. To the best of our knowledge, this is the first paper to introduce a neural network training procedure designed to achieve both a good average performance and minimum worst-case violations. Using the Optimal Power Flow (OPF) problem as a guiding application, our approach (i) introduces a framework that reduces the worst-case generation constraint violations during training, incorporating them as a differentiable optimization layer; and (ii) presents a neural network sequential learning architecture to significantly accelerate it. We demonstrate the proposed architecture on four different test systems ranging from 39 buses to 162 buses, for both AC-OPF and DC-OPF applications.
△ Less
Submitted 21 December, 2022;
originally announced December 2022.
-
Interpretable Machine Learning for Power Systems: Establishing Confidence in SHapley Additive exPlanations
Authors:
Robert I. Hamilton,
Jochen Stiasny,
Tabia Ahmad,
Samuel Chevalier,
Rahul Nellikkath,
Ilgiz Murzakhanov,
Spyros Chatzivasileiadis,
Panagiotis N. Papadopoulos
Abstract:
Interpretable Machine Learning (IML) is expected to remove significant barriers for the application of Machine Learning (ML) algorithms in power systems. This letter first seeks to showcase the benefits of SHapley Additive exPlanations (SHAP) for understanding the outcomes of ML models, which are increasingly being used. Second, we seek to demonstrate that SHAP explanations are able to capture the…
▽ More
Interpretable Machine Learning (IML) is expected to remove significant barriers for the application of Machine Learning (ML) algorithms in power systems. This letter first seeks to showcase the benefits of SHapley Additive exPlanations (SHAP) for understanding the outcomes of ML models, which are increasingly being used. Second, we seek to demonstrate that SHAP explanations are able to capture the underlying physics of the power system. To do so, we demonstrate that the Power Transfer Distribution Factors (PTDF) -- a physics-based linear sensitivity index -- can be derived from the SHAP values. To do so, we take the derivatives of SHAP values from a ML model trained to learn line flows from generator power injections, using a simple DC power flow case in the 9-bus 3-generator test network. In demonstrating that SHAP values can be related back to the physics that underpin the power system, we build confidence in the explanations SHAP can offer.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
-
Closing the Loop: A Framework for Trustworthy Machine Learning in Power Systems
Authors:
Jochen Stiasny,
Samuel Chevalier,
Rahul Nellikkath,
Brynjar Sævarsson,
Spyros Chatzivasileiadis
Abstract:
Deep decarbonization of the energy sector will require massive penetration of stochastic renewable energy resources and an enormous amount of grid asset coordination; this represents a challenging paradigm for the power system operators who are tasked with maintaining grid stability and security in the face of such changes. With its ability to learn from complex datasets and provide predictive sol…
▽ More
Deep decarbonization of the energy sector will require massive penetration of stochastic renewable energy resources and an enormous amount of grid asset coordination; this represents a challenging paradigm for the power system operators who are tasked with maintaining grid stability and security in the face of such changes. With its ability to learn from complex datasets and provide predictive solutions on fast timescales, machine learning (ML) is well-posed to help overcome these challenges as power systems transform in the coming decades. In this work, we outline five key challenges (dataset generation, data pre-processing, model training, model assessment, and model embedding) associated with building trustworthy ML models which learn from physics-based simulation data. We then demonstrate how linking together individual modules, each of which overcomes a respective challenge, at sequential stages in the machine learning pipeline can help enhance the overall performance of the training process. In particular, we implement methods that connect different elements of the learning pipeline through feedback, thus "closing the loop" between model training, performance assessments, and re-training. We demonstrate the effectiveness of this framework, its constituent modules, and its feedback connections by learning the N-1 small-signal stability margin associated with a detailed model of a proposed North Sea Wind Power Hub system.
△ Less
Submitted 14 July, 2022; v1 submitted 14 March, 2022;
originally announced March 2022.
-
Network-Aware Flexibility Requests for Distribution-Level Flexibility Markets
Authors:
Eléa Prat,
Irena Dukovska,
Lars Herre,
Rahul Nellikkath,
Malte Thoma,
Spyros Chatzivasileiadis
Abstract:
This paper proposes a method to design network-aware flexibility requests for local flexibility markets. These markets are becoming increasingly important for distribution system operators (DSOs) to ensure grid safety while minimizing costs and public opposition to new network investments. Despite extended recent literature on local flexibility markets, little attention has been paid to quantifyin…
▽ More
This paper proposes a method to design network-aware flexibility requests for local flexibility markets. These markets are becoming increasingly important for distribution system operators (DSOs) to ensure grid safety while minimizing costs and public opposition to new network investments. Despite extended recent literature on local flexibility markets, little attention has been paid to quantifying the flexibility required at each location, considering physical network constraints (e.g. line and voltage limits). The method introduced uses a chance-constrained optimization model and a LinDistFlow approximation to consider both physical network constraints and uncertainty caused by renewable production or demand fluctuations. Unlike other methods, it avoids sharing sensitive grid data with the market operator. We compare our approach against a stochastic market-clearing mechanism which serves as a benchmark, and we derive analytical conditions for the performance of our method to determine flexibility requests. We show on two case studies that our method outperforms the stochastic market-clearing benchmark in terms of computation time while achieving comparable social welfare and costs for the DSOs. One of the case studies is conducted on an actual German distribution grid, showing that the proposed method can scale well to real-sized networks.
△ Less
Submitted 24 May, 2023; v1 submitted 12 October, 2021;
originally announced October 2021.
-
Physics-Informed Neural Networks for AC Optimal Power Flow
Authors:
Rahul Nellikkath,
Spyros Chatzivasileiadis
Abstract:
This paper introduces, for the first time to our knowledge, physics-informed neural networks to accurately estimate the AC-OPF result and delivers rigorous guarantees about their performance. Power system operators, along with several other actors, are increasingly using Optimal Power Flow (OPF) algorithms for a wide number of applications, including planning and real-time operations. However, in…
▽ More
This paper introduces, for the first time to our knowledge, physics-informed neural networks to accurately estimate the AC-OPF result and delivers rigorous guarantees about their performance. Power system operators, along with several other actors, are increasingly using Optimal Power Flow (OPF) algorithms for a wide number of applications, including planning and real-time operations. However, in its original form, the AC Optimal Power Flow problem is often challenging to solve as it is non-linear and non-convex. Besides the large number of approximations and relaxations, recent efforts have also been focusing on Machine Learning approaches, especially neural networks. So far, however, these approaches have only partially considered the wide number of physical models available during training. And, more importantly, they have offered no guarantees about potential constraint violations of their output. Our approach (i) introduces the AC power flow equations inside neural network training and (ii) integrates methods that rigorously determine and reduce the worst-case constraint violations across the entire input domain, while maintaining the optimality of the prediction. We demonstrate how physics-informed neural networks achieve higher accuracy and lower constraint violations than standard neural networks, and show how we can further reduce the worst-case violations for all neural networks.
△ Less
Submitted 6 October, 2021;
originally announced October 2021.
-
Physics-Informed Neural Networks for Minimising Worst-Case Violations in DC Optimal Power Flow
Authors:
Rahul Nellikkath,
Spyros Chatzivasileiadis
Abstract:
Physics-informed neural networks exploit the existing models of the underlying physical systems to generate higher accuracy results with fewer data. Such approaches can help drastically reduce the computation time and generate a good estimate of computationally intensive processes in power systems, such as dynamic security assessment or optimal power flow. Combined with the extraction of worst-cas…
▽ More
Physics-informed neural networks exploit the existing models of the underlying physical systems to generate higher accuracy results with fewer data. Such approaches can help drastically reduce the computation time and generate a good estimate of computationally intensive processes in power systems, such as dynamic security assessment or optimal power flow. Combined with the extraction of worst-case guarantees for the neural network performance, such neural networks can be applied in safety-critical applications in power systems and build a high level of trust among power system operators. This paper takes the first step and applies, for the first time to our knowledge, Physics-Informed Neural Networks with Worst-Case Guarantees for the DC Optimal Power Flow problem. We look for guarantees related to (i) maximum constraint violations, (ii) maximum distance between predicted and optimal decision variables, and (iii) maximum sub-optimality in the entire input domain. In a range of PGLib-OPF networks, we demonstrate how physics-informed neural networks can be supplied with worst-case guarantees and how they can lead to reduced worst-case violations compared with conventional neural networks.
△ Less
Submitted 27 September, 2021; v1 submitted 28 June, 2021;
originally announced July 2021.
