Showing 1–28 of 28 results for author: Chevalier, S

Enhancing Scalability of Optimal Kron-based Reduction of Networks (Opti-KRON) via Decomposition with Community Detection

Authors: Omid Mokhtari, Samuel Chevalier, Mads Almassalkhi

Abstract: Electrical networks contain thousands of interconnected nodes and edges, which leads to computational challenges in some power system studies. To address these challenges, we contend that network reductions can serve as a framework to enable scalable computing in power systems. By building upon a prior AC "Opti-KRON" formulation, this paper presents a DC power flow formulation for finding network… ▽ More Electrical networks contain thousands of interconnected nodes and edges, which leads to computational challenges in some power system studies. To address these challenges, we contend that network reductions can serve as a framework to enable scalable computing in power systems. By building upon a prior AC "Opti-KRON" formulation, this paper presents a DC power flow formulation for finding network reductions that are optimal within the context of large transmission analysis. Opti-KRON previously formulated optimal Kron-based network reductions as a mixed integer linear program (MILP), where the number of binary variables scaled with the number of nodes. To improve the scalability of the Opti-KRON approach, we augment the MILP formulation with a community detection (CD) technique that segments a large network into smaller, disjoint, but contiguous sub-graphs (i.e., communities). For each sub-graph, we then (in parallel) apply MILP-based along with a new cutting plane constraint, thus, enhancing scalability. Ultimately, the new DC-based Opti-KRON method can achieve a 80-95\% reduction of networks (in terms of nodes) while statistically outperforming other CD- and Kron-based methods. We present simulation results for the IEEE RTS-96 and the 2383-bus Polish networks. △ Less

Submitted 2 July, 2024; originally announced July 2024.

GPU-Accelerated DCOPF using Gradient-Based Optimization

Authors: Seide Saba Rafiei, Samuel Chevalier

Abstract: DC Optimal Power Flow (DCOPF) is a key operational tool for power system operators, and it is embedded as a subproblem in many challenging optimization problems (e.g., line switching). However, traditional CPU-based solve routines (e.g., simplex) have saturated in speed and are hard to parallelize. This paper focuses on solving DCOPF problems using gradient-based routines on Graphics Processing Un… ▽ More DC Optimal Power Flow (DCOPF) is a key operational tool for power system operators, and it is embedded as a subproblem in many challenging optimization problems (e.g., line switching). However, traditional CPU-based solve routines (e.g., simplex) have saturated in speed and are hard to parallelize. This paper focuses on solving DCOPF problems using gradient-based routines on Graphics Processing Units (GPUs), which have massive parallelization capability. To formulate these problems, we pose a Lagrange dual associated with DCOPF (linear and quadratic cost curves), and then we explicitly solve the inner (primal) minimization problem with a dual norm. The resulting dual problem can be efficiently iterated using projected gradient ascent. After solving the dual problem on both CPUs and GPUs to find tight lower bounds, we benchmark against Gurobi and MOSEK, comparing convergence speed and tightness on the IEEE 2000 and 10000 bus systems. We provide reliable and tight lower bounds for these problems with, at best, 5.4x speedup over a conventional solver. △ Less

Submitted 18 June, 2024; originally announced June 2024.

A hybrid Quantum-Classical Algorithm for Mixed-Integer Optimization in Power Systems

Authors: Petros Ellinas, Samuel Chevalier, Spyros Chatzivasileiadis

Abstract: Mixed Integer Linear Programming (MILP) can be considered the backbone of the modern power system optimization process, with a large application spectrum, from Unit Commitment and Optimal Transmission Switching to verifying Neural Networks for power system applications. The main issue of these formulations is the computational complexity of the solution algorithms, as they are considered NP-Hard p… ▽ More Mixed Integer Linear Programming (MILP) can be considered the backbone of the modern power system optimization process, with a large application spectrum, from Unit Commitment and Optimal Transmission Switching to verifying Neural Networks for power system applications. The main issue of these formulations is the computational complexity of the solution algorithms, as they are considered NP-Hard problems. Quantum computing has been tested as a potential solution towards reducing the computational burden imposed by these problems, providing promising results, motivating the can be used to speedup the solution of MILPs. In this work, we present a general framework for solving power system optimization problems with a Quantum Computer (QC), which leverages mathematical tools and QCs' sampling ability to provide accelerated solutions. Our guiding applications are the optimal transmission switching and the verification of neural networks trained to solve a DC Optimal Power Flow. Specifically, using an accelerated version of Benders Decomposition , we split a given MILP into an Integer Master Problem and a linear Subproblem and solve it through a hybrid ``quantum-classical'' approach, getting the best of both worlds. We provide 2 use cases, and benchmark the developed framework against other classical and hybrid methodologies, to demonstrate the opportunities and challenges of hybrid quantum-classical algorithms for power system mixed integer optimization problems. △ Less

Submitted 16 April, 2024; originally announced April 2024.

Towards Energysheds: A Technical Definition and Cooperative Framework for Future Power System Operations

Authors: Dakota Hamilton, Samuel Chevalier, Amritanshu Pandey, Mads Almassalkhi

Abstract: There is growing interest in understanding how interactions between system-wide objectives and local community decision-making will impact the clean energy transition. The concept of energysheds has gained traction in the areas of public policy and social science as a way to study these relationships. However, development of technical definitions of energysheds that permit system analysis are stil… ▽ More There is growing interest in understanding how interactions between system-wide objectives and local community decision-making will impact the clean energy transition. The concept of energysheds has gained traction in the areas of public policy and social science as a way to study these relationships. However, development of technical definitions of energysheds that permit system analysis are still largely missing. In this work, we propose a mathematical definition for energysheds, and introduce an analytical framework for studying energyshed concepts within the context of future electric power system operations. This framework is used to develop insights into the factors that impact a community's ability to achieve energyshed policy incentives within a larger connected power grid, as well as the tradeoffs associated with different spatial policy requirements. We also propose an optimization-based energyshed policy design problem, and show that it can be solved to global optimality within arbitrary precision by employing concepts from quasi-convex optimization. Finally, we investigate how interconnected energysheds can cooperatively achieve their objectives in bulk power system operations. △ Less

Submitted 29 April, 2024; v1 submitted 27 November, 2023; originally announced November 2023.

Towards Perturbation-Induced Static Pivoting on GPU-Based Linear Solvers

Authors: Samuel Chevalier, Robert Parker

Abstract: Linear system solving is a key tool for computational power system studies, e.g., optimal power flow, transmission switching, or unit commitment. CPU-based linear system solver speeds, however, have saturated in recent years. Emerging research shows that GPU-based linear system solvers are beginning to achieve notable speedup over CPU-based alternatives in some applications. Due to the architectur… ▽ More Linear system solving is a key tool for computational power system studies, e.g., optimal power flow, transmission switching, or unit commitment. CPU-based linear system solver speeds, however, have saturated in recent years. Emerging research shows that GPU-based linear system solvers are beginning to achieve notable speedup over CPU-based alternatives in some applications. Due to the architecture of GPU memory access, numerical pivoting represents the new bottleneck which prevents GPU-based solvers from running even faster. Accordingly, this paper proposes a matrix perturbation-based method to induce static pivoting. Using this approach, a series of perturbed, well-conditioned, pivot-free linear systems are solved in parallel on GPUs. Matrix expansion routines are then used to linearly combine the results, and the true solution is recovered to an arbitrarily high degree of theoretical accuracy. We showcase the validity of our approach on distributed-slack AC power flow solve iterations associated with the PGLib 300-bus test case. △ Less

Submitted 20 March, 2024; v1 submitted 20 November, 2023; originally announced November 2023.

Comments: submitted to PESGM 2024

A Parallelized, Adam-Based Solver for Reserve and Security Constrained AC Unit Commitment

Authors: Samuel Chevalier

Abstract: Power system optimization problems which include the nonlinear AC power flow equations require powerful and robust numerical solution algorithms. Within this sub-field of nonlinear optimization, interior point methods have come to dominate the solver landscape. Over the last decade, however, a number of efficient numerical optimizers have emerged from the field of Machine Learning (ML). One algori… ▽ More Power system optimization problems which include the nonlinear AC power flow equations require powerful and robust numerical solution algorithms. Within this sub-field of nonlinear optimization, interior point methods have come to dominate the solver landscape. Over the last decade, however, a number of efficient numerical optimizers have emerged from the field of Machine Learning (ML). One algorithm in particular, Adam, has become the optimizer-of-choice for a massive percentage of ML training problems (including, e.g., the training of GPT-3), solving some of the largest unconstrained optimization problems ever conceived of. Inspired by such progress, this paper designs a parallelized Adam-based numerical solver to overcome one of the most challenging power system optimization problems: security and reserve constrained AC Unit Commitment. The resulting solver, termed QuasiGrad, recently competed in the third ARPA-E Grid Optimization (GO3) competition. In the day-ahead market clearing category (with systems ranging from 3 to 23,643 buses over 48 time periods), QuasiGrad's aggregated market surplus scores were within 5% of the winningest market surplus scores. The QuasiGrad solver is now released as an open-source Julia package: QuasiGrad.jl. The internal gradient-based solver (Adam) can easily be substituted for other ML-inspired solvers (e.g., AdaGrad, AdaDelta, RMSProp, etc.). Test results from large experiments are provided. △ Less

Submitted 19 February, 2024; v1 submitted 10 October, 2023; originally announced October 2023.

GPU-Accelerated Verification of Machine Learning Models for Power Systems

Authors: Samuel Chevalier, Ilgiz Murzakhanov, Spyros Chatzivasileiadis

Abstract: Computational tools for rigorously verifying the performance of large-scale machine learning (ML) models have progressed significantly in recent years. The most successful solvers employ highly specialized, GPU-accelerated branch and bound routines. Such tools are crucial for the successful deployment of machine learning applications in safety-critical systems, such as power systems. Despite their… ▽ More Computational tools for rigorously verifying the performance of large-scale machine learning (ML) models have progressed significantly in recent years. The most successful solvers employ highly specialized, GPU-accelerated branch and bound routines. Such tools are crucial for the successful deployment of machine learning applications in safety-critical systems, such as power systems. Despite their successes, however, barriers prevent out-of-the-box application of these routines to power system problems. This paper addresses this issue in two key ways. First, for the first time to our knowledge, we enable the simultaneous verification of multiple verification problems (e.g., checking for the violation of all line flow constraints simultaneously and not by solving individual verification problems). For that, we introduce an exact transformation that converts the "worst-case" violation across a set of potential violations to a series of ReLU-based layers that augment the original neural network. This allows verifiers to interpret them directly. Second, power system ML models often must be verified to satisfy power flow constraints. We propose a dualization procedure which encodes linear equality and inequality constraints directly into the verification problem; and in a manner which is mathematically consistent with the specialized verification tools. To demonstrate these innovations, we verify problems associated with data-driven security constrained DC-OPF solvers. We build and test our first set of innovations using the $α,β$-CROWN solver, and we benchmark against Gurobi 10.0. Our contributions achieve a speedup that can exceed 100x and allow higher degrees of verification flexibility. △ Less

Submitted 7 September, 2023; v1 submitted 18 June, 2023; originally announced June 2023.

Scalable Bilevel Optimization for Generating Maximally Representative OPF Datasets

Authors: Ignasi Ventura Nadal, Samuel Chevalier

Abstract: New generations of power systems, containing high shares of renewable energy resources, require improved data-driven tools which can swiftly adapt to changes in system operation. Many of these tools, such as ones using machine learning, rely on high-quality training datasets to construct probabilistic models. Such models should be able to accurately represent the system when operating at its limit… ▽ More New generations of power systems, containing high shares of renewable energy resources, require improved data-driven tools which can swiftly adapt to changes in system operation. Many of these tools, such as ones using machine learning, rely on high-quality training datasets to construct probabilistic models. Such models should be able to accurately represent the system when operating at its limits (i.e., operating with a high degree of ``active constraints"). However, generating training datasets that accurately represent the many possible combinations of these active constraints is a particularly challenging task, especially within the realm of nonlinear AC Optimal Power Flow (OPF), since most active constraints cannot be enforced explicitly. Using bilevel optimization, this paper introduces a data collection routine that sequentially solves for OPF solutions which are ``optimally far" from previously acquired voltage, power, and load profile data points. The routine, termed RAMBO, samples critical data close to a system's boundaries much more effectively than a random sampling benchmark. Simulated test results are collected on the 30-, 57-, and 118-bus PGLib test cases. △ Less

Submitted 11 March, 2024; v1 submitted 21 April, 2023; originally announced April 2023.

Comments: Revised and published in 2023 IEEE PES Innovative Smart Grid Technologies Europe (ISGT EUROPE)

Global Performance Guarantees for Neural Network Models of AC Power Flow

Authors: Samuel Chevalier, Spyros Chatzivasileiadis

Abstract: Machine learning, which can generate extremely fast and highly accurate black-box surrogate models, is increasingly being applied to a variety of AC power flow problems. Rigorously verifying the accuracy of the resulting black-box models, however, is computationally challenging. This paper develops a tractable neural network verification procedure which incorporates the ground truth of the non-lin… ▽ More Machine learning, which can generate extremely fast and highly accurate black-box surrogate models, is increasingly being applied to a variety of AC power flow problems. Rigorously verifying the accuracy of the resulting black-box models, however, is computationally challenging. This paper develops a tractable neural network verification procedure which incorporates the ground truth of the non-linear AC power flow equations to determine worst-case neural network prediction error. Our approach, termed Sequential Targeted Tightening (STT), leverages a loosely convexified reformulation of the original verification problem, which is an intractable mixed integer quadratic program (MIQP). Using the sequential addition of targeted cuts, we iteratively tighten our formulation until either the solution is sufficiently tight or a satisfactory performance guarantee has been generated. After learning neural network models of the 14, 57, 118, and 200-bus PGLib test cases, we compare the performance guarantees generated by our STT procedure with ones generated by a state-of-the-art MIQP solver, Gurobi 11.0. We show that STT often generates performance guarantees which are far tighter than the MIQP upper bound. △ Less

Submitted 6 May, 2024; v1 submitted 14 November, 2022; originally announced November 2022.

Comments: Submitted to IEEE IAS

Interpretable Machine Learning for Power Systems: Establishing Confidence in SHapley Additive exPlanations

Authors: Robert I. Hamilton, Jochen Stiasny, Tabia Ahmad, Samuel Chevalier, Rahul Nellikkath, Ilgiz Murzakhanov, Spyros Chatzivasileiadis, Panagiotis N. Papadopoulos

Abstract: Interpretable Machine Learning (IML) is expected to remove significant barriers for the application of Machine Learning (ML) algorithms in power systems. This letter first seeks to showcase the benefits of SHapley Additive exPlanations (SHAP) for understanding the outcomes of ML models, which are increasingly being used. Second, we seek to demonstrate that SHAP explanations are able to capture the… ▽ More Interpretable Machine Learning (IML) is expected to remove significant barriers for the application of Machine Learning (ML) algorithms in power systems. This letter first seeks to showcase the benefits of SHapley Additive exPlanations (SHAP) for understanding the outcomes of ML models, which are increasingly being used. Second, we seek to demonstrate that SHAP explanations are able to capture the underlying physics of the power system. To do so, we demonstrate that the Power Transfer Distribution Factors (PTDF) -- a physics-based linear sensitivity index -- can be derived from the SHAP values. To do so, we take the derivatives of SHAP values from a ML model trained to learn line flows from generator power injections, using a simple DC power flow case in the 9-bus 3-generator test network. In demonstrating that SHAP values can be related back to the physics that underpin the power system, we build confidence in the explanations SHAP can offer. △ Less

Submitted 13 September, 2022; originally announced September 2022.

Optimization-Based Exploration of the Feasible Power Flow Space for Rapid Data Collection

Authors: Ignasi Ventura Nadal, Samuel Chevalier

Abstract: This paper provides a systematic investigation into the various nonlinear objective functions which can be used to explore the feasible space associated with the optimal power flow problem. A total of 40 nonlinear objective functions are tested, and their results are compared to the data generated by a novel exhaustive rejection sampling routine. The Hausdorff distance, which is a min-max set diss… ▽ More This paper provides a systematic investigation into the various nonlinear objective functions which can be used to explore the feasible space associated with the optimal power flow problem. A total of 40 nonlinear objective functions are tested, and their results are compared to the data generated by a novel exhaustive rejection sampling routine. The Hausdorff distance, which is a min-max set dissimilarity metric, is then used to assess how well each nonlinear objective function performed (i.e., how well the tested objective functions were able to explore the non-convex power flow space). Exhaustive test results were collected from five PGLib test-cases and systematically analyzed. △ Less

Submitted 20 September, 2022; v1 submitted 24 June, 2022; originally announced June 2022.

Towards Optimal Kron-based Reduction Of Networks (Opti-KRON) for the Electric Power Grid

Authors: Samuel Chevalier, Mads R. Almassalkhi

Abstract: For fast timescales or long prediction horizons, the AC optimal power flow (OPF) problem becomes a computational challenge for large-scale, realistic AC networks. To overcome this challenge, this paper presents a novel network reduction methodology that leverages an efficient mixed-integer linear programming (MILP) formulation of a Kron-based reduction that is optimal in the sense that it balances… ▽ More For fast timescales or long prediction horizons, the AC optimal power flow (OPF) problem becomes a computational challenge for large-scale, realistic AC networks. To overcome this challenge, this paper presents a novel network reduction methodology that leverages an efficient mixed-integer linear programming (MILP) formulation of a Kron-based reduction that is optimal in the sense that it balances the degree of the reduction with resulting modeling errors in the reduced network. The method takes as inputs the full AC network and a pre-computed library of AC load flow data and uses the graph Laplacian to constraint nodal reductions to only be feasible for neighbors of non-reduced nodes. This results in a highly effective MILP formulation which is embedded within an iterative scheme to successively improve the Kron-based network reduction until convergence. The resulting optimal network reduction is, thus, grounded in the physics of the full network. The accuracy of the network reduction methodology is then explored for a 100+ node medium-voltage radial distribution feeder example across a wide range of operating conditions. It is finally shown that a network reduction of 25-85% can be achieved within seconds and with worst-case voltage magnitude deviation errors within any super node cluster of less than 0.01pu. These results illustrate that the proposed optimization-based approach to Kron reduction of networks is viable for larger networks and suitable for use within various power system applications. △ Less

Submitted 20 September, 2022; v1 submitted 12 April, 2022; originally announced April 2022.

Closing the Loop: A Framework for Trustworthy Machine Learning in Power Systems

Authors: Jochen Stiasny, Samuel Chevalier, Rahul Nellikkath, Brynjar Sævarsson, Spyros Chatzivasileiadis

Abstract: Deep decarbonization of the energy sector will require massive penetration of stochastic renewable energy resources and an enormous amount of grid asset coordination; this represents a challenging paradigm for the power system operators who are tasked with maintaining grid stability and security in the face of such changes. With its ability to learn from complex datasets and provide predictive sol… ▽ More Deep decarbonization of the energy sector will require massive penetration of stochastic renewable energy resources and an enormous amount of grid asset coordination; this represents a challenging paradigm for the power system operators who are tasked with maintaining grid stability and security in the face of such changes. With its ability to learn from complex datasets and provide predictive solutions on fast timescales, machine learning (ML) is well-posed to help overcome these challenges as power systems transform in the coming decades. In this work, we outline five key challenges (dataset generation, data pre-processing, model training, model assessment, and model embedding) associated with building trustworthy ML models which learn from physics-based simulation data. We then demonstrate how linking together individual modules, each of which overcomes a respective challenge, at sequential stages in the machine learning pipeline can help enhance the overall performance of the training process. In particular, we implement methods that connect different elements of the learning pipeline through feedback, thus "closing the loop" between model training, performance assessments, and re-training. We demonstrate the effectiveness of this framework, its constituent modules, and its feedback connections by learning the N-1 small-signal stability margin associated with a detailed model of a proposed North Sea Wind Power Hub system. △ Less

Submitted 14 July, 2022; v1 submitted 14 March, 2022; originally announced March 2022.

Comments: In proceedings of the 11th Bulk Power Systems Dynamics and Control Symposium (IREP 2022), July 25-30, 2022, Banff, Canada. 21 pages, 12 figures, 5 tables

Report number: IREP2022-57

Modeling the AC Power Flow Equations with Optimally Compact Neural Networks: Application to Unit Commitment

Authors: Alyssa Kody, Samuel Chevalier, Spyros Chatzivasileiadis, Daniel Molzahn

Abstract: Nonlinear power flow constraints render a variety of power system optimization problems computationally intractable. Emerging research shows, however, that the nonlinear AC power flow equations can be successfully modeled using Neural Networks (NNs). These NNs can be exactly transformed into Mixed Integer Linear Programs (MILPs) and embedded inside challenging optimization problems, thus replacing… ▽ More Nonlinear power flow constraints render a variety of power system optimization problems computationally intractable. Emerging research shows, however, that the nonlinear AC power flow equations can be successfully modeled using Neural Networks (NNs). These NNs can be exactly transformed into Mixed Integer Linear Programs (MILPs) and embedded inside challenging optimization problems, thus replacing nonlinearities that are intractable for many applications with tractable piecewise linear approximations. Such approaches, though, suffer from an explosion of the number of binary variables needed to represent the NN. Accordingly, this paper develops a technique for training an "optimally compact" NN, i.e., one that can represent the power flow equations with a sufficiently high degree of accuracy while still maintaining a tractable number of binary variables. We show that the resulting NN model is more expressive than both the DC and linearized power flow approximations when embedded inside of a challenging optimization problem (i.e., the AC unit commitment problem). △ Less

Submitted 28 October, 2021; v1 submitted 21 October, 2021; originally announced October 2021.

Comments: added acknowledgement, first two authors equally contributed, 8 pages, 3 figures, 1 table

Uncertainty Quantification in LV State Estimation Under High Shares of Flexible Resources

Authors: Nils Müller, Samuel Chevalier, Carsten Heinrich, Kai Heussen, Charalampos Ziras

Abstract: The ongoing electrification introduces new challenges to distribution system operators (DSOs). Controllable resources may simultaneously react to price signals, potentially leading to network violations. DSOs require reliable and accurate low-voltage state estimation (LVSE) to improve awareness and mitigate such events. However, the influence of flexibility activations on LVSE has not been address… ▽ More The ongoing electrification introduces new challenges to distribution system operators (DSOs). Controllable resources may simultaneously react to price signals, potentially leading to network violations. DSOs require reliable and accurate low-voltage state estimation (LVSE) to improve awareness and mitigate such events. However, the influence of flexibility activations on LVSE has not been addressed yet. It remains unclear if flexibility-induced uncertainty can be reliably quantified to enable robust DSO decision-making. In this work, uncertainty quantification in LVSE is systematically investigated for multiple scenarios of input availability and flexibility utilization, using real data. For that purpose, a Bayesian neural network (BNN) is compared to quantile regression. Results show that frequent flexibility activations can significantly deteriorate LVSE performance, unless secondary substation measurements are available. Moreover, it is demonstrated that the BNN captures flexibility-induced voltage drops by dynamically extending the prediction interval during activation periods, and that it improves interpretability regarding the cause of uncertainty. △ Less

Submitted 8 October, 2021; originally announced October 2021.

Comments: Submitted to the 22nd Power Systems Computation Conference (PSCC 2022)

Learning without Data: Physics-Informed Neural Networks for Fast Time-Domain Simulation

Authors: Jochen Stiasny, Samuel Chevalier, Spyros Chatzivasileiadis

Abstract: In order to drastically reduce the heavy computational burden associated with time-domain simulations, this paper introduces a Physics-Informed Neural Network (PINN) to directly learn the solutions of power system dynamics. In contrast to the limitations of classical model order reduction approaches, commonly used to accelerate time-domain simulations, PINNs can universally approximate any continu… ▽ More In order to drastically reduce the heavy computational burden associated with time-domain simulations, this paper introduces a Physics-Informed Neural Network (PINN) to directly learn the solutions of power system dynamics. In contrast to the limitations of classical model order reduction approaches, commonly used to accelerate time-domain simulations, PINNs can universally approximate any continuous function with an arbitrary degree of accuracy. One of the novelties of this paper is that we avoid the need for any training data. We achieve this by incorporating the governing differential equations and an implicit Runge-Kutta (RK) integration scheme directly into the training process of the PINN; through this approach, PINNs can predict the trajectory of a dynamical power system at any discrete time step. The resulting Runge-Kutta-based physics-informed neural networks (RK-PINNs) can yield up to 100 times faster evaluations of the dynamics compared to standard time-domain simulations. We demonstrate the methodology on a single-machine infinite bus system governed by the swing equation. We show that RK-PINNs can accurately and quickly predict the solution trajectories. △ Less

Submitted 30 June, 2021; originally announced June 2021.

Comments: 6 pages, 6 figures, submitted to IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids 2021(SmartGridComm)

Accelerating Dynamical System Simulations with Contracting and Physics-Projected Neural-Newton Solvers

Authors: Samuel Chevalier, Jochen Stiasny, Spyros Chatzivasileiadis

Abstract: Recent advances in deep learning have allowed neural networks (NNs) to successfully replace traditional numerical solvers in many applications, thus enabling impressive computing gains. One such application is time domain simulation, which is indispensable for the design, analysis and operation of many engineering systems. Simulating dynamical systems with implicit Newton-based solvers is a comput… ▽ More Recent advances in deep learning have allowed neural networks (NNs) to successfully replace traditional numerical solvers in many applications, thus enabling impressive computing gains. One such application is time domain simulation, which is indispensable for the design, analysis and operation of many engineering systems. Simulating dynamical systems with implicit Newton-based solvers is a computationally heavy task, as it requires the solution of a parameterized system of differential and algebraic equations at each time step. A variety of NN-based methodologies have been shown to successfully approximate the trajectories computed by numerical solvers at a fraction of the time. However, few previous works have used NNs to model the numerical solver itself. For the express purpose of accelerating time domain simulation speeds, this paper proposes and explores two complementary alternatives for modeling numerical solvers. First, we use a NN to mimic the linear transformation provided by the inverse Jacobian in a single Newton step. Using this procedure, we evaluate and project the exact, physics-based residual error onto the NN map**, thus leaving physics ``in the loop''. The resulting tool, termed the Physics-pRojected Neural-Newton Solver (PRoNNS), is able to achieve an extremely high degree of numerical accuracy at speeds which were observed to be up to 31% faster than a Newton-based solver. In the second approach, we model the Newton solver at the heart of an implicit Runge-Kutta integrator as a contracting map iteratively seeking a fixed point on a time domain trajectory. The associated recurrent NN simulation tool, termed the Contracting Neural-Newton Solver (CoNNS), is embedded with training constraints (via CVXPY Layers) which guarantee the map** provided by the NN satisfies the Banach fixed-point theorem. △ Less

Submitted 8 December, 2021; v1 submitted 4 June, 2021; originally announced June 2021.

Handling Initial Conditions in Vector Fitting for Real Time Modeling of Power System Dynamics

Authors: Tommaso Bradde, Samuel Chevalier, Marco De Stefano, Stefano Grivet-Talocia, Luca Daniel

Abstract: This paper develops a predictive modeling algorithm, denoted as Real-Time Vector Fitting (RTVF), which is capable of approximating the real-time linearized dynamics of multi-input multi-output (MIMO) dynamical systems via rational transfer function matrices. Based on a generalization of the well-known Time-Domain Vector Fitting (TDVF) algorithm, RTVF is suitable for online modeling of dynamical sy… ▽ More This paper develops a predictive modeling algorithm, denoted as Real-Time Vector Fitting (RTVF), which is capable of approximating the real-time linearized dynamics of multi-input multi-output (MIMO) dynamical systems via rational transfer function matrices. Based on a generalization of the well-known Time-Domain Vector Fitting (TDVF) algorithm, RTVF is suitable for online modeling of dynamical systems which experience both initial-state decay contributions in the measured output signals and concurrently active input signals. These adaptations were specifically contrived to meet the needs currently present in the electrical power systems community, where real-time modeling of low frequency power system dynamics is becoming an increasingly coveted tool by power system operators. After introducing and validating the RTVF scheme on synthetic test cases, this paper presents a series of numerical tests on high-order closed-loop generator systems in the IEEE 39-bus test system. △ Less

Submitted 16 April, 2021; v1 submitted 25 November, 2020; originally announced November 2020.

Network Topology Invariant Stability Certificates for DC Microgrids with Arbitrary Load Dynamics

Authors: Samuel Chevalier, Federico Martin Ibanez, Kathleen Cavanagh, Konstantin Turitsyn, Luca Daniel, Petr Vorobev

Abstract: DC microgrids are prone to small-signal instabilities due to the presence of tightly regulated loads. This paper develops a decentralized stability certificate which is capable of certifying the small-signal stability of an islanded DC network containing such loads. Utilizing a novel homotopy approach, the proposed standards ensure that no system eigenmodes are able to cross into the unstable righ… ▽ More DC microgrids are prone to small-signal instabilities due to the presence of tightly regulated loads. This paper develops a decentralized stability certificate which is capable of certifying the small-signal stability of an islanded DC network containing such loads. Utilizing a novel homotopy approach, the proposed standards ensure that no system eigenmodes are able to cross into the unstable right half plane for a continuous range of controller gain levels. The resulting "standards" can be applied to variety of grid components which meet the specified, but non-unique, criteria. These standards thus take a step towards offering plug-and-play operability of DC microgrids. The proposed theorems are explicitly illustrated and numerically validated on multiple DC microgrid test-cases containing both buck and boost converter dynamics. △ Less

Submitted 8 July, 2021; v1 submitted 12 November, 2020; originally announced November 2020.

Accelerated Probabilistic State Estimation in Distribution Grids via Model Order Reduction

Authors: Samuel Chevalier, Luca Schenato, Luca Daniel

Abstract: This paper applies a custom model order reduction technique to the distribution grid state estimation problem. Specifically, the method targets the situation where, due to pseudo-measurement uncertainty, it is advantageous to run the state estimation solver potentially thousands of times over sampled input perturbations in order to compute probabilistic bounds on the underlying system state. This… ▽ More This paper applies a custom model order reduction technique to the distribution grid state estimation problem. Specifically, the method targets the situation where, due to pseudo-measurement uncertainty, it is advantageous to run the state estimation solver potentially thousands of times over sampled input perturbations in order to compute probabilistic bounds on the underlying system state. This routine, termed the Accelerated Probabilistic State Estimator (APSE), efficiently searches for the solutions of sequential state estimation problems in a low dimensional subspace with a reduced order model (ROM). When a sufficiently accurate solution is not found, the APSE reverts to a conventional QR factorization-based Gauss-Newton solver. It then uses the resulting solution to preform a simple basis expansion of the low-dimensional subspace, thus improving the reduced model solver. Simulated test results, collected from the unbalanced three-phase 8500-node distribution grid, show the resulting algorithm to be almost an order of magnitude faster than a comparable full-order Gauss-Newton solver and thus potentially fast enough for real-time use. △ Less

Submitted 25 January, 2021; v1 submitted 10 November, 2020; originally announced November 2020.

Comments: submitted to PESGM21

Accelerated Probabilistic Power Flow in Electrical Distribution Networks via Model Order Reduction and Neumann Series Expansion

Authors: Samuel Chevalier, Luca Schenato, Luca Daniel

Abstract: This paper develops a computationally efficient algorithm which speeds up the probabilistic power flow (PPF) problem by exploiting the inherently low-rank nature of the voltage profile in electrical power distribution networks. The algorithm is accordingly termed the Accelerated-PPF (APPF), since it can accelerate "any" sampling-based PPF solver. As the APPF runs, it concurrently generates a low-d… ▽ More This paper develops a computationally efficient algorithm which speeds up the probabilistic power flow (PPF) problem by exploiting the inherently low-rank nature of the voltage profile in electrical power distribution networks. The algorithm is accordingly termed the Accelerated-PPF (APPF), since it can accelerate "any" sampling-based PPF solver. As the APPF runs, it concurrently generates a low-dimensional subspace of orthonormalized solution vectors. This subspace is used to construct and update a reduced order model (ROM) of the full nonlinear system, resulting in a highly efficient simulation for future voltage profiles. When constructing and updating the subspace, the power flow problem must still be solved on the full nonlinear system. In order to accelerate the computation of these solutions, a Neumann expansion of a modified power flow Jacobian is implemented. Applicable when load bus injections are small, this Neumann expansion allows for a considerable speed up of Jacobian system solves during the standard Newton iterations. APPF test results, from experiments run on the full IEEE 8500-node test feeder, are finally presented. △ Less

Submitted 14 October, 2021; v1 submitted 28 October, 2020; originally announced October 2020.

Dynamic Linepack Depletion Models for Natural Gas Pipeline Networks

Authors: Samuel Chevalier, Dan Wu

Abstract: Given the critical role played by natural gas in providing electricity, heat, and other essential services, better models are needed to understand the dynamics of natural gas networks during extreme events. This paper aims at establishing appropriate and fast simulation models to capture the slow dynamics of linepack depletion for ideal isothermal natural gas pipeline networks. Instead of solving… ▽ More Given the critical role played by natural gas in providing electricity, heat, and other essential services, better models are needed to understand the dynamics of natural gas networks during extreme events. This paper aims at establishing appropriate and fast simulation models to capture the slow dynamics of linepack depletion for ideal isothermal natural gas pipeline networks. Instead of solving partial differential equations (PDE) on a large scale, three alternative implicit ordinary differential equation (ODE) simulation techniques are derived and discussed. The first one is commonly used in the literature with a slack node assumption. We show that the system of equations associated with this model is degenerate when flux injections are controlled (i.e. specified) at all nodes. To recover regularity under such a condition, two novel implicit ODE models are proposed, both with different techniques for specifying boundary conditions. They are easy to derive and efficient to simulate with standard ODE solvers. More importantly, they present useful frameworks for analyzing how networks respond to system-wide mass flux imbalances. These techniques offer different alternatives for simulating system dynamics based on how sources and loads are chosen to be modeled, and they are all proven to be regular (non-degenerate) in tree-structured networks. These proposed techniques are all tested on the 20-node Belgium network. The simulation results show that the conventional model with the slack node assumption cannot effectively capture linepack depletion under long term system-wide mass flux imbalance, while the proposed models can characterize the network behavior until the linepack is completely depleted. △ Less

Submitted 30 December, 2020; v1 submitted 30 January, 2020; originally announced January 2020.

Comments: 40 pages, accepted for publication in the Applied Mathematical Modeling (AMM) Journal

A Bayesian Framework for Power System Components Identification

Authors: Artem Mikhalev, Alexander Emchinov, Samuel Chevalier, Yury Maximov, Petr Vorobev

Abstract: Having actual models for power system components (such as generators and loads or auxiliary equipment) is vital to correctly assess the power system operating state and to establish stability margins. However, power system operators often have limited information about the actual values for power system component parameters. Even when a model is available, its operating parameters and control sett… ▽ More Having actual models for power system components (such as generators and loads or auxiliary equipment) is vital to correctly assess the power system operating state and to establish stability margins. However, power system operators often have limited information about the actual values for power system component parameters. Even when a model is available, its operating parameters and control settings are time-dependent and subject to real-time identification. Ideally, these parameters should be identified from measurement data, such as phasor measurement unit (PMU) signals. However, it is challenging to do this from the ambient measurements in the absence of transient dynamics since the signal-to-noise ratio (SNR) for such signals is not necessarily large. In this paper, we design a Bayesian framework for on-line identification of power system component parameters based on ambient PMU data, which has reliable performance for SNR as low as five and for certain parameters can give good estimations even for unit SNR. We support the framework with a robust and time-efficient numerical method. We illustrate the approach efficiency on a synchronous generator example. △ Less

Submitted 18 January, 2020; originally announced January 2020.

A Passivity Interpretation of Energy-Based Forced Oscillation Source Location Methods

Authors: Samuel Chevalier, Petr Vorobev, Konstantin Turitsyn

Abstract: This paper develops a systematic framework for analyzing how low frequency forced oscillations propagate in electric power systems. Using this framework, the paper shows how to mathematically justify the so-called Dissipating Energy Flow (DEF) forced oscillation source location technique. The DEF's specific deficiencies are pinpointed, and its underlying energy function is analyzed via incremental… ▽ More This paper develops a systematic framework for analyzing how low frequency forced oscillations propagate in electric power systems. Using this framework, the paper shows how to mathematically justify the so-called Dissipating Energy Flow (DEF) forced oscillation source location technique. The DEF's specific deficiencies are pinpointed, and its underlying energy function is analyzed via incremental passivity theory. This analysis is then used to prove that there exists no passivity transformation (i.e. quadratic energy function) which can simultaneously render all components of a lossy classical power system passive. The paper goes on to develop a simulation-free algorithm for predicting the performance of the DEF method in a generalized power system, and it analyzes the passivity of three non-classical load and generation components. The proposed propagation framework and performance algorithm are both tested and illustrated on the IEEE 39-bus New England system and the WECC 179-bus system. △ Less

Submitted 3 January, 2020; v1 submitted 12 June, 2019; originally announced June 2019.

Comments: 14 pages, re-submitted to IEEE TPWRS

Using Passivity Theory to Interpret the Dissipating Energy Flow Method

Authors: Samuel Chevalier, Petr Vorobev, Konstantin Turitsyn, Bin Wang, Slava Maslennikov

Abstract: Despite wide-scale deployment of phasor measurement unit technology, locating the sources of low frequency forced oscillations in power systems is still an open research topic. The dissipating energy flow method is one source location technique which has performed remarkably well in both simulation and real time application at ISO New England. The method has several deficiencies, though, which are… ▽ More Despite wide-scale deployment of phasor measurement unit technology, locating the sources of low frequency forced oscillations in power systems is still an open research topic. The dissipating energy flow method is one source location technique which has performed remarkably well in both simulation and real time application at ISO New England. The method has several deficiencies, though, which are still poorly understood. This paper borrows the concepts of passivity and positive realness from the controls literature in order to interpret the dissipating energy flow method, pinpoint the reasons for its deficiencies, and set up a framework for improving the method. The theorems presented in this paper are then tested via simulation on a simple infinite bus power system model. △ Less

Submitted 9 November, 2018; v1 submitted 7 November, 2018; originally announced November 2018.

Comments: Submitted to PESGM19

A Bayesian Approach to Forced Oscillation Source Location Given Uncertain Generator Parameters

Authors: Samuel Chevalier, Petr Vorobev, Konstantin Turitsyn

Abstract: Since forced oscillations are exogenous to dynamic power system models, the models by themselves cannot predict when or where a forced oscillation will occur. Locating the sources of these oscillations, therefore, is a challenging problem which requires analytical methods capable of using real time power system data to trace an observed oscillation back to its source. The difficulty of this proble… ▽ More Since forced oscillations are exogenous to dynamic power system models, the models by themselves cannot predict when or where a forced oscillation will occur. Locating the sources of these oscillations, therefore, is a challenging problem which requires analytical methods capable of using real time power system data to trace an observed oscillation back to its source. The difficulty of this problem is exacerbated by the fact that the parameters associated with a given power system model can range from slightly uncertain to entirely unknown. In this paper, a Bayesian framework, via a two-stage Maximum A Posteriori optimization routine, is employed in order to locate the most probable source of a forced oscillation given an uncertain prior model. The approach leverages an equivalent circuit representation of the system in the frequency domain and employs a numerical procedure which makes the problem suitable for real time application. The derived framework lends itself to successful performance in the presence of PMU measurement noise, high generator parameter uncertainty, and multiple forced oscillations occurring simultaneously. The approach is tested on a 4-bus system with a single forced oscillation source and on the WECC 179-bus system with multiple oscillation sources. △ Less

Submitted 30 October, 2018; v1 submitted 6 July, 2018; originally announced July 2018.

Comments: 9 pages; submitted to IEEE Transactions on Power Systems

Mitigating the Risk of Voltage Collapse using Statistical Measures from PMU Data

Authors: Samuel Chevalier, Paul D. H. Hines

Abstract: With the continued deployment of synchronized Phasor Measurement Units (PMUs), high sample rate data are rapidly increasing the real time observability of power systems. Prior research has shown that the statistics of these data can provide useful information regarding network stability, but it is not yet known how this statistical information can be actionably used to improve power system stabili… ▽ More With the continued deployment of synchronized Phasor Measurement Units (PMUs), high sample rate data are rapidly increasing the real time observability of power systems. Prior research has shown that the statistics of these data can provide useful information regarding network stability, but it is not yet known how this statistical information can be actionably used to improve power system stability. To address this issue, this paper presents a method that gauges and improves the voltage stability of a system using the statistics present in PMU data streams. Leveraging an analytical solver to determine a range of "critical" bus voltage variances, the presented methods monitor raw statistical data in an observable load pocket to determine when control actions are needed to mitigate the risk of voltage collapse. A simple reactive power controller is then implemented, which acts dynamically to maintain an acceptable voltage stability margin within the system. Time domain simulations on 3-bus and 39-bus test cases demonstrate that the resulting statistical controller can out-perform more conventional feedback control systems by maintaining voltage stability margins while loads simultaneously increase and fluctuate. △ Less

Submitted 9 May, 2018; originally announced May 2018.

Comments: Submitted to IEEE Transactions on Power Systems

Using Effective Generator Impedance for Forced Oscillation Source Location

Authors: Samuel Chevalier, Petr Vorobev, Konstantin Turitsyn

Abstract: Locating the sources of forced low-frequency oscillations in power systems is an important problem. A number of proposed methods demonstrate their practical usefulness, but many of them rely on strong modeling assumptions and provide poor performance in certain cases for reasons still not well understood. This paper proposes a systematic method for locating the source of a forced oscillation by co… ▽ More Locating the sources of forced low-frequency oscillations in power systems is an important problem. A number of proposed methods demonstrate their practical usefulness, but many of them rely on strong modeling assumptions and provide poor performance in certain cases for reasons still not well understood. This paper proposes a systematic method for locating the source of a forced oscillation by considering a generator's response to fluctuations of its terminal voltages and currents. It is shown that a generator can be represented as an effective admittance matrix with respect to low-frequency oscillations, and an explicit form for this matrix, for various generator models, is derived. Furthermore, it is shown that a source generator, in addition to its effective admittance, is characterized by the presence of an effective current source thus giving a natural qualitative distinction between source and nonsource generators. Detailed descriptions are given of a source detection procedure based on this developed representation, and the method's effectiveness is confirmed by simulations on the recommended testbeds (eg. WECC 179-bus system). This method is free of strong modeling assumptions and is also shown to be robust in the presence of measurement noise and generator parameter uncertainty. △ Less

Submitted 4 May, 2018; v1 submitted 6 August, 2017; originally announced August 2017.

Comments: 13 pages