-
NSF Integrated Circuit Research, Education and Workforce Development Workshop Final Report
Authors:
M. Guthaus,
C. Batten,
E. Brunvand,
P. E. Gaillardon,
D. harris,
R. Manohar,
P. Mazumder,
L. Pileggi,
J. Stine
Abstract:
As the pace of progress that has followed Moore's law continues to diminish, it is critical that the US support Integrated Circuit (IC or chip) education and research to maintain technological innovation. Furthermore, US economic independence, security, and future international standing rely on having on-shore IC design capabilities. New devices with disparate technologies, improved design softwar…
▽ More
As the pace of progress that has followed Moore's law continues to diminish, it is critical that the US support Integrated Circuit (IC or chip) education and research to maintain technological innovation. Furthermore, US economic independence, security, and future international standing rely on having on-shore IC design capabilities. New devices with disparate technologies, improved design software toolchains and methodologies, and technologies to integrate heterogeneous systems will be needed to advance IC design capabilities. This will require rethinking both how we teach design to address the new complexity and how we inspire student interest in a hardware systems career path. The main recommendation of this workshop is that accessibility is the key issue. To this end, a National Chip Design Center (NCDC) should be established to further research and education by partnering academics and industry to train our future workforce. This should not be limited to R1 universities, but should also include R2, community college, minority serving institutions (MSI), and K-12 institutions to have the broadest effect. The NCDC should support the access, development, and maintenance of open design tools, tool flows, design kits, design components, and educational materials. Open-source options should be emphasized wherever possible to maximize accessibility. The NCDC should also provide access and support for chip fabrication, packaging and testing for both research and educational purposes.
△ Less
Submitted 3 November, 2023;
originally announced November 2023.
-
Towards Hyperparameter-Agnostic DNN Training via Dynamical System Insights
Authors:
Carmel Fiscko,
Aayushya Agarwal,
Yihan Ruan,
Soummya Kar,
Larry Pileggi,
Bruno Sinopoli
Abstract:
We present a stochastic first-order optimization method specialized for deep neural networks (DNNs), ECCO-DNN. This method models the optimization variable trajectory as a dynamical system and develops a discretization algorithm that adaptively selects step sizes based on the trajectory's shape. This provides two key insights: designing the dynamical system for fast continuous-time convergence and…
▽ More
We present a stochastic first-order optimization method specialized for deep neural networks (DNNs), ECCO-DNN. This method models the optimization variable trajectory as a dynamical system and develops a discretization algorithm that adaptively selects step sizes based on the trajectory's shape. This provides two key insights: designing the dynamical system for fast continuous-time convergence and develo** a time-step** algorithm to adaptively select step sizes based on principles of numerical integration and neural network structure. The result is an optimizer with performance that is insensitive to hyperparameter variations and that achieves comparable performance to state-of-the-art optimizers including ADAM, SGD, RMSProp, and AdaGrad. We demonstrate this in training DNN models and datasets, including CIFAR-10 and CIFAR-100 using ECCO-DNN and find that ECCO-DNN's single hyperparameter can be changed by three orders of magnitude without affecting the trained models' accuracies. ECCO-DNN's insensitivity reduces the data and computation needed for hyperparameter tuning, making it advantageous for rapid prototy** and for applications with new datasets. To validate the efficacy of our proposed optimizer, we train an LSTM architecture on a household power consumption dataset with ECCO-DNN and achieve an optimal mean-square-error without tuning hyperparameters.
△ Less
Submitted 20 October, 2023;
originally announced October 2023.
-
An Equivalent Circuit Approach to Distributed Optimization
Authors:
Aayushya Agarwal,
Larry Pileggi
Abstract:
Distributed optimization is an essential paradigm to solve large-scale optimization problems in modern applications where big-data and high-dimensionality creates a computational bottleneck. Distributed optimization algorithms that exhibit fast convergence allow us to fully utilize computing resources and effectively scale to larger optimization problems in a myriad of areas ranging from machine l…
▽ More
Distributed optimization is an essential paradigm to solve large-scale optimization problems in modern applications where big-data and high-dimensionality creates a computational bottleneck. Distributed optimization algorithms that exhibit fast convergence allow us to fully utilize computing resources and effectively scale to larger optimization problems in a myriad of areas ranging from machine learning to power systems. In this work, we introduce a new centralized distributed optimization algorithm (ECADO) inspired by an equivalent circuit model of the distributed problem. The equivalent circuit (EC) model provides a physical analogy to derive new insights to develop a fast-convergent algorithm. The main contributions of this approach are: 1) a weighting scheme based on a circuit-inspired aggregate sensitivity analysis, and 2) an adaptive step-sizing derived from a stable, Backward-Euler numerical integration. We demonstrate that ECADO exhibits faster convergence compared to state-of-the art distributed optimization methods and provably converges for nonconvex problems. We leverage the ECADO features to solve convex and nonconvex optimization problems with large datasets such as: distributing data for logistic regression, training a deep neural network model for classification, and solving a high-dimensional problem security-constrained optimal power flow problem. Compared to state-of-the-art centralized methods, including ADMM, centralized gradient descent, and DANE, this new ECADO approach is shown to converge in fewer iterations.
△ Less
Submitted 23 May, 2023;
originally announced May 2023.
-
An Equivalent Circuit Workflow for Unconstrained Optimization
Authors:
Aayushya Agarwal,
Carmel Fiscko,
Soummya Kar,
Larry Pileggi,
Bruno Sinopoli
Abstract:
We introduce a new workflow for unconstrained optimization whereby objective functions are mapped onto a physical domain to more easily design algorithms that are robust to hyperparameters and achieve fast convergence rates. Specifically, we represent optimization problems as an equivalent circuit that are then solved solely as nonlinear circuits using robust solution methods. The equivalent circu…
▽ More
We introduce a new workflow for unconstrained optimization whereby objective functions are mapped onto a physical domain to more easily design algorithms that are robust to hyperparameters and achieve fast convergence rates. Specifically, we represent optimization problems as an equivalent circuit that are then solved solely as nonlinear circuits using robust solution methods. The equivalent circuit models the trajectory of component-wise scaled gradient flow problem as the transient response of the circuit for which the steady-state coincides with a critical point of the objective function. The equivalent circuit model leverages circuit domain knowledge to methodically design new optimization algorithms that would likely not be developed without a physical model. We incorporate circuit knowledge into optimization methods by 1) enhancing the underlying circuit model for fast numerical analysis, 2) controlling the optimization trajectory by designing the nonlinear circuit components, and 3) solving for step sizes using well-known methods from the circuit simulation. We first establish the necessary conditions that the controls must fulfill for convergence. We show that existing descent algorithms can be re-derived as special cases of this approach and derive new optimization algorithms that are developed with insights from a circuit-based model. The new algorithms can be designed to be robust to hyperparameters, achieve convergence rates comparable or faster than state of the art methods, and are applicable to optimizing a variety of both convex and nonconvex problems.
△ Less
Submitted 23 May, 2023;
originally announced May 2023.
-
Power Grid Behavioral Patterns and Risks of Generalization in Applied Machine Learning
Authors:
Shimiao Li,
Jan Drgona,
Shrirang Abhyankar,
Larry Pileggi
Abstract:
Recent years have seen a rich literature of data-driven approaches designed for power grid applications. However, insufficient consideration of domain knowledge can impose a high risk to the practicality of the methods. Specifically, ignoring the grid-specific spatiotemporal patterns (in load, generation, and topology, etc.) can lead to outputting infeasible, unrealizable, or completely meaningles…
▽ More
Recent years have seen a rich literature of data-driven approaches designed for power grid applications. However, insufficient consideration of domain knowledge can impose a high risk to the practicality of the methods. Specifically, ignoring the grid-specific spatiotemporal patterns (in load, generation, and topology, etc.) can lead to outputting infeasible, unrealizable, or completely meaningless predictions on new inputs. To address this concern, this paper investigates real-world operational data to provide insights into power grid behavioral patterns, including the time-varying topology, load, and generation, as well as the spatial differences (in peak hours, diverse styles) between individual loads and generations. Then based on these observations, we evaluate the generalization risks in some existing ML works causedby ignoring these grid-specific patterns in model design and training.
△ Less
Submitted 1 June, 2023; v1 submitted 20 April, 2023;
originally announced April 2023.
-
Contingency Analyses with Warm Starter using Probabilistic Graphical Model
Authors:
Shimiao Li,
Amritanshu Pandey,
Larry Pileggi
Abstract:
Cyberthreats are an increasingly common risk to the power grid and can thwart secure grid operations. We propose to extend contingency analysis to include cyberthreat evaluations. However, unlike the traditional N-1 or N-2 contingencies, cyberthreats (e.g., MadIoT) require simulating hard-to-solve N-k (with k >> 2) contingencies in a practical amount of time. Purely physics-based power flow solver…
▽ More
Cyberthreats are an increasingly common risk to the power grid and can thwart secure grid operations. We propose to extend contingency analysis to include cyberthreat evaluations. However, unlike the traditional N-1 or N-2 contingencies, cyberthreats (e.g., MadIoT) require simulating hard-to-solve N-k (with k >> 2) contingencies in a practical amount of time. Purely physics-based power flow solvers, while being accurate, are slow and may not solve N-k contingencies in a timely manner, whereas the emerging data-driven alternatives are fast but not sufficiently generalizable, interpretable, and scalable. To address these challenges, we propose a novel conditional Gaussian Random Field-based data-driven method that performs fast and accurate evaluation of cyberthreats. It achieves speedup of contingency analysis by warm-starting simulations, i.e., improving starting points, for the physical solvers. To improve the physical interpretability and generalizability, the proposed method incorporates domain knowledge by considering the graphical nature of the grid topology. To improve scalability, the method applies physics-informed regularization that reduces model complexity. Experiments validate that simulating MadIoT-induced attacks with our warm starter becomes approximately 5x faster on a realistic 2000-bus system.
△ Less
Submitted 19 March, 2024; v1 submitted 10 April, 2023;
originally announced April 2023.
-
Actionable Three-Phase Infeasibility Optimization with Varying Slack Sources
Authors:
Elizabeth Foster,
Timothy McNamara,
Amritanshu Pandey,
Larry Pileggi
Abstract:
Modern distribution grids that include numerous distributed energy resources (DERs) and battery electric vehicles (BEVs) will require simulation and optimization methods that can capture behavior under infeasible operating scenarios to assess reliability. A three-phase infeasibility analysis (TPIA) localizes and identifies power deficient areas in distribution feeders via a non-convex optimization…
▽ More
Modern distribution grids that include numerous distributed energy resources (DERs) and battery electric vehicles (BEVs) will require simulation and optimization methods that can capture behavior under infeasible operating scenarios to assess reliability. A three-phase infeasibility analysis (TPIA) localizes and identifies power deficient areas in distribution feeders via a non-convex optimization that injects and subsequently minimizes slack sources, subject to AC network constraints. In this paper, we extend the TPIA framework by introducing operational bounds to ensure realistic, actionable solutions. We incorporate current, reactive power, and susceptance slack sources to model real-world assets, and discuss their potential use cases.
We show that the voltage-bounded TPIA formulations provide actionable solutions for realistic networks of up to 5360 nodes where power flow simulations either fail or return low-voltage solutions. We demonstrate reactive power compensation using the slack susceptance formulation on an infeasible test case.
△ Less
Submitted 16 February, 2023; v1 submitted 6 December, 2022;
originally announced December 2022.
-
ECCO: Equivalent Circuit Controlled Optimization
Authors:
Aayushya Agarwal,
Carmel Fiscko,
Soummya Kar,
Larry Pileggi,
Bruno Sinopoli
Abstract:
We propose an adaptive optimization algorithm for solving unconstrained scaled gradient flow problems that achieves fast convergence by controlling the optimization trajectory shape and the discretization step sizes. Under a broad class of scaling functions, we establish convergence of the proposed approach to critical points of smooth objective functions, while demonstrating its flexibility and r…
▽ More
We propose an adaptive optimization algorithm for solving unconstrained scaled gradient flow problems that achieves fast convergence by controlling the optimization trajectory shape and the discretization step sizes. Under a broad class of scaling functions, we establish convergence of the proposed approach to critical points of smooth objective functions, while demonstrating its flexibility and robustness with respect to hyperparameter tuning. First, we prove convergence of component-wise scaled gradient flow to a critical point under regularity conditions. We show that this controlled gradient flow dynamics is equivalent to the transient response of an electrical circuit, allowing for circuit theory concepts to solve the problem. Based on this equivalence, we develop two optimization trajectory control schemes based on minimizing the charge stored in the circuit: a second order method that uses the true Hessian and an alternate first order method that approximates the optimization trajectory with only gradient information. While the control schemes are derived from circuit concepts, no circuit knowledge is needed to implement the algorithms. To find the value of the critical point, we propose a time step search routine for Forward Euler discretization that controls the local truncation error, a method adapted from circuit simulation ideas. In simulation we find that the trajectory control outperforms uncontrolled gradient flow, and the error-aware discretization out-performs line search with the Armijo condition. Our algorithms are evaluated on convex and non-convex test functions, including neural networks, with convergence speeds comparable to or exceeding Adam.
△ Less
Submitted 19 February, 2023; v1 submitted 15 November, 2022;
originally announced November 2022.
-
Towards Practical Physics-Informed ML Design and Evaluation for Power Grid
Authors:
Shimiao Li,
Amritanshu Pandey,
Larry Pileggi
Abstract:
When applied to a real-world safety critical system like the power grid, general machine learning methods suffer from expensive training, non-physical solutions, and limited interpretability. To address these challenges for power grids, many recent works have explored the inclusion of grid physics (i.e., domain expertise) into their method design, primarily through including system constraints and…
▽ More
When applied to a real-world safety critical system like the power grid, general machine learning methods suffer from expensive training, non-physical solutions, and limited interpretability. To address these challenges for power grids, many recent works have explored the inclusion of grid physics (i.e., domain expertise) into their method design, primarily through including system constraints and technical limits, reducing search space and defining meaningful features in latent space. Yet, there is no general methodology to evaluate the practicality of these approaches in power grid tasks, and limitations exist regarding scalability, generalization, interpretability, etc. This work formalizes a new concept of physical interpretability which assesses how a ML model makes predictions in a physically meaningful way and introduces an evaluation methodology that identifies a set of attributes that a practical method should satisfy. Inspired by the evaluation attributes, the paper further develops a novel contingency analysis warm starter for MadIoT cyberattack, based on a conditional Gaussian random field. This method serves as an instance of an ML model that can incorporate diverse domain knowledge and improve on these identified attributes. Experiments validate that the warm starter significantly boosts the efficiency of contingency analysis for MadIoT attack even with shallow NN architectures.
△ Less
Submitted 24 May, 2022; v1 submitted 7 May, 2022;
originally announced May 2022.
-
Circuit-theoretic Line Outage Distribution Factor
Authors:
Shimiao Li,
Amritanshu Pandey,
Larry Pileggi
Abstract:
This work presents the design of AC line outage distribution factor created from the circuit-theoretic power flow models. Experiment results are shown to demonstrate its efficacy in quantifying the impact of line outages on the grid, and its resulting potential for fast contingency screening.
This work presents the design of AC line outage distribution factor created from the circuit-theoretic power flow models. Experiment results are shown to demonstrate its efficacy in quantifying the impact of line outages on the grid, and its resulting potential for fast contingency screening.
△ Less
Submitted 15 April, 2022;
originally announced April 2022.
-
Equivalent Circuit Programming for Power Flow Analysis and Optimization
Authors:
Marko Jereminov,
Larry Pileggi
Abstract:
The utility of domain-specific knowledge for modeling, simulation, and optimization has been demonstrated for various research problem domains, including power systems. The concept of Equivalent Circuit Programming was previously developed and facilitated for robust, efficient, and scalable solution of network simulation and optimization problems. This paper extends the theoretical foundation of E…
▽ More
The utility of domain-specific knowledge for modeling, simulation, and optimization has been demonstrated for various research problem domains, including power systems. The concept of Equivalent Circuit Programming was previously developed and facilitated for robust, efficient, and scalable solution of network simulation and optimization problems. This paper extends the theoretical foundation of Equivalent Circuit Programming to enable the fusion of optimization theory and algorithms with the numerical methods that utilize the domain-specific knowledge of power flow models. The generality, scalability, and numerical robustness of the resulting framework are demonstrated on realistic AC power flow (ACPF) models of up to 70k buses with proper enforcement of industry-required operational and security constraints.
△ Less
Submitted 2 December, 2021;
originally announced December 2021.
-
A Risk-Managed Steady-State Analysis to Assess the Impact of Power Grid Uncertainties
Authors:
Naeem Turner-Bandele,
Amritanshu Pandey,
Larry Pileggi
Abstract:
Electricity systems are experiencing increased effects of randomness and variability due to emerging stochastic assets. The increased effects introduce new uncertainties into power systems that can impact system operability and reliability. Existing steady-state methods for assessing system-level operability and reliability are primarily deterministic, therefore, ill-suited to capture randomness a…
▽ More
Electricity systems are experiencing increased effects of randomness and variability due to emerging stochastic assets. The increased effects introduce new uncertainties into power systems that can impact system operability and reliability. Existing steady-state methods for assessing system-level operability and reliability are primarily deterministic, therefore, ill-suited to capture randomness and variability. This work introduces a probabilistic steady-state analysis inspired by statistical worst-case circuit analysis to evaluate the risk of operational violations due to stochastic resources. Compared to parallelized Monte Carlo analyses (MCS), we have seen up to 24x improvement in runtime speed using our approach without significant loss of probabilistic accuracy for a Texas7k low-wind day test system.
△ Less
Submitted 8 November, 2022; v1 submitted 19 November, 2021;
originally announced November 2021.
-
Adversarially Robust Learning for Security-Constrained Optimal Power Flow
Authors:
Priya L. Donti,
Aayushya Agarwal,
Neeraj Vijay Bedmutha,
Larry Pileggi,
J. Zico Kolter
Abstract:
In recent years, the ML community has seen surges of interest in both adversarially robust learning and implicit layers, but connections between these two areas have seldom been explored. In this work, we combine innovations from these areas to tackle the problem of N-k security-constrained optimal power flow (SCOPF). N-k SCOPF is a core problem for the operation of electrical grids, and aims to s…
▽ More
In recent years, the ML community has seen surges of interest in both adversarially robust learning and implicit layers, but connections between these two areas have seldom been explored. In this work, we combine innovations from these areas to tackle the problem of N-k security-constrained optimal power flow (SCOPF). N-k SCOPF is a core problem for the operation of electrical grids, and aims to schedule power generation in a manner that is robust to potentially k simultaneous equipment outages. Inspired by methods in adversarially robust training, we frame N-k SCOPF as a minimax optimization problem - viewing power generation settings as adjustable parameters and equipment outages as (adversarial) attacks - and solve this problem via gradient-based techniques. The loss function of this minimax problem involves resolving implicit equations representing grid physics and operational decisions, which we differentiate through via the implicit function theorem. We demonstrate the efficacy of our framework in solving N-3 SCOPF, which has traditionally been considered as prohibitively expensive to solve given that the problem size depends combinatorially on the number of potential outages.
△ Less
Submitted 12 November, 2021;
originally announced November 2021.
-
Three-Phase Infeasibility Analysis for Distribution Grid Studies
Authors:
Elizabeth Foster,
Amritanshu Pandey,
Larry Pileggi
Abstract:
With the increase of distributed energy resources in the distribution grid, planning to ensure sufficient infrastructure and resources becomes critical. Planning at the distribution level is limited by the complexities of optimizing unbalanced systems. In this paper we develop a three-phase infeasibility analysis that identifies weak locations in a distribution network. This optimization is formul…
▽ More
With the increase of distributed energy resources in the distribution grid, planning to ensure sufficient infrastructure and resources becomes critical. Planning at the distribution level is limited by the complexities of optimizing unbalanced systems. In this paper we develop a three-phase infeasibility analysis that identifies weak locations in a distribution network. This optimization is formulated by adding slack current sources at nodes in the system and minimizing their norm subject to distribution power flow constraints. Through this analysis we solve instances of power flow that would otherwise be infeasible and diverge. Under conditions when power flow is feasible, our approach is equivalent to standard three-phase power flow; however, for cases where power flow fails, the nonzero slack injection currents compensate for missing power to make the grid feasible. Since an uncountable number of injected currents can provide feasibility, we further explore the optimization formulation that best fits the solution objective through use of both a least squares and an L1 norm objective. Our L1 norm formulation localizes power deficient locations through its inherent sparsity. We show the efficacy of this approach on realistic unbalanced testcases up to 8500 nodes and for a scenario with a high penetration of electric vehicles.
△ Less
Submitted 5 May, 2022; v1 submitted 21 October, 2021;
originally announced October 2021.
-
Two-Stage Homotopy Method to Incorporate Discrete Control Variables into AC-OPF
Authors:
Timothy McNamara,
Amritanshu Pandey,
Aayushya Agarwal,
Larry Pileggi
Abstract:
Alternating-Current Optimal Power Flow (AC-OPF) is an optimization problem critical for planning and operating the power grid. The problem is traditionally formulated using only continuous variables. Typically, control devices with discrete-valued settings, which provide valuable flexibility to the network and improve resilience, are omitted from AC-OPF formulations due to the difficulty of integr…
▽ More
Alternating-Current Optimal Power Flow (AC-OPF) is an optimization problem critical for planning and operating the power grid. The problem is traditionally formulated using only continuous variables. Typically, control devices with discrete-valued settings, which provide valuable flexibility to the network and improve resilience, are omitted from AC-OPF formulations due to the difficulty of integrality constraints. We propose a two-stage homotopy algorithm to solve the AC-OPF problem with discrete-valued control settings. This method does not rely on prior knowledge of control settings or other initial conditions. The first stage relaxes the discrete settings to continuous variables and solves the optimization using a robust homotopy technique. Once the solution has been obtained using relaxed models, second homotopy problem gradually transforms the relaxed settings to their nearest feasible discrete values. We test the proposed algorithm on several large networks with switched shunts and adjustable transformers and show it can outperform a similar state-of-the-art solver.
△ Less
Submitted 14 October, 2021;
originally announced October 2021.
-
A Convex Method of Generalized State Estimation using Circuit-theoretic Node-breaker Model
Authors:
Shimiao Li,
Amritanshu Pandey,
Larry Pileggi
Abstract:
An accurate and up-to-date topology is critical for situational awareness of a power grid; however, wrong switch statuses due to physical damage, communication error, or cyber-attack, can often result in topology errors. To maintain situation awareness under the possible topology errors and bad data, this paper develops ckt-GSE, a circuit-theoretic generalized state estimation method using node-br…
▽ More
An accurate and up-to-date topology is critical for situational awareness of a power grid; however, wrong switch statuses due to physical damage, communication error, or cyber-attack, can often result in topology errors. To maintain situation awareness under the possible topology errors and bad data, this paper develops ckt-GSE, a circuit-theoretic generalized state estimation method using node-breaker (NB) model. Ckt- GSE is a convex and scalable model that jointly estimates AC state variables and network topology, with robustness against different data errors. The method first constructs an equivalent circuit representation of the AC power grid by develo** and aggregating linear circuit models of SCADA meters, phasor measurement units(PMUs), and switching devices. Then based on this circuit, ckt-GSE defines a constrained optimization problem using weighted least absolute value (WLAV) objective to form a robust estimator. The problem is a Linear Programming (LP) problem whose solution includes accurate AC states and a sparse vector of noise terms to identify topology errors and bad data.This paper is the first to explore a circuit-theoretic approach for an AC-network constrained GSE algorithm that is: 1) applicable to the real-world data setting, 2) convex without relaxation, scalable with our circuit-based solver; and 3) robust with the ability to identify and reject different data errors
△ Less
Submitted 20 September, 2023; v1 submitted 29 September, 2021;
originally announced September 2021.
-
Analytical Inverter-Based Distributed Generator Model for Power Flow Analysis
Authors:
Naeem Turner-Bandele,
Amritanshu Pandey,
Larry Pileggi
Abstract:
Quantifying the impact of inverter-based distributed generation (DG) sources on power-flow distribution system cases is arduous. Existing distribution system tools predominately model distributed generation sources as either negative PQ loads or as a PV generator and then employed a PV-PQ switching algorithm to mimic Volt/VAR support. These models neglect the unique characteristics of inverter-bas…
▽ More
Quantifying the impact of inverter-based distributed generation (DG) sources on power-flow distribution system cases is arduous. Existing distribution system tools predominately model distributed generation sources as either negative PQ loads or as a PV generator and then employed a PV-PQ switching algorithm to mimic Volt/VAR support. These models neglect the unique characteristics of inverter-based distributed generation sources, have scalability and convergence issues, and are ill-suited for increasing solar penetration scenarios. This work proposes an inverter-based DG model accounting for the inverter's topology, sensing position, and control strategies. The model extends recently introduced analytical positive sequence generator models for three-phase studies. The use of circuit-simulation based heuristics help achieve robust convergence. Simulation of the PG&E prototypical feeders using a prototype solver demonstrate the model's accuracy and efficacy.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
Combined Transmission and Distribution State-Estimation for Future Electric Grids
Authors:
Amritanshu Pandey,
Shimiao Li,
Larry Pileggi
Abstract:
Proliferation of grid resources on the distribution network along with the inability to forecast them accurately will render the existing methodology of grid operation and control untenable in the future. Instead, a more distributed yet coordinated approach for grid operation and control will emerge that models and analyzes the grid with a larger footprint and deeper hierarchy to unify control of…
▽ More
Proliferation of grid resources on the distribution network along with the inability to forecast them accurately will render the existing methodology of grid operation and control untenable in the future. Instead, a more distributed yet coordinated approach for grid operation and control will emerge that models and analyzes the grid with a larger footprint and deeper hierarchy to unify control of disparate T&D grid resources under a common framework. Such approach will require AC state-estimation (ACSE) of joint T&D networks. Today, no practical method for realizing combined T&D ACSE exists. This paper addresses that gap from circuit-theoretic perspective through realizing a combined T&D ACSE solution methodology that is fast, convex and robust against bad-data. To address daunting challenges of problem size (million+ variables) and data-privacy, the approach is distributed both in memory and computing resources. To ensure timely convergence, the approach constructs a distributed circuit model for combined T&D networks and utilizes node-tearing techniques for efficient parallelism. To demonstrate the efficacy of the approach, combined T&D ACSE algorithm is run on large test networks that comprise of multiple T&D feeders. The results reflect the accuracy of the estimates in terms of root mean-square error and algorithm scalability in terms of wall-clock time.
△ Less
Submitted 20 September, 2021; v1 submitted 14 May, 2021;
originally announced May 2021.
-
Fast AC Steady-State Power Grid Simulation and Optimization Using Prior Knowledge
Authors:
Aayushya Agarwal,
Amritanshu Pandey,
Larry Pileggi
Abstract:
Fast and accurate optimization and simulation is widely becoming a necessity for large scale transmission resiliency and planning studies such as N-1 SCOPF, batch contingency solvers, and stochastic power flow. Current commercial tools, however, prioritize speed of convergence over accuracy by relying on initial conditions that are taken from the steady state solution of similar network configurat…
▽ More
Fast and accurate optimization and simulation is widely becoming a necessity for large scale transmission resiliency and planning studies such as N-1 SCOPF, batch contingency solvers, and stochastic power flow. Current commercial tools, however, prioritize speed of convergence over accuracy by relying on initial conditions that are taken from the steady state solution of similar network configurations that are not guaranteed to lie within a convex region of a valid solution. In this paper we introduce a globally convergent algorithm to facilitate fast and accurate AC steady state simulation and optimization based on prior knowledge from similar networks. The approach uses a homotopy method that gradually and efficiently translates a previously known network configuration to the current network configuration. The proposed formulation is highly scalable, and its efficacy is demonstrated for resiliency study and optimization of large networks up to 70k buses.
△ Less
Submitted 28 March, 2021; v1 submitted 17 March, 2021;
originally announced March 2021.
-
Quantifying the Efficacy of Logic Locking Methods
Authors:
Joseph Sweeney,
Deepali Garg,
Lawrence Pileggi
Abstract:
The outsourced manufacturing of integrated circuits has increased the risk of intellectual property theft. In response, logic locking techniques have been developed for protecting designs by adding programmable elements to the circuit. These techniques differ significantly in both overhead and resistance to various attacks, leaving designers unable to discern their efficacy. To overcome this criti…
▽ More
The outsourced manufacturing of integrated circuits has increased the risk of intellectual property theft. In response, logic locking techniques have been developed for protecting designs by adding programmable elements to the circuit. These techniques differ significantly in both overhead and resistance to various attacks, leaving designers unable to discern their efficacy. To overcome this critical impediment for the adoption of logic locking, we propose two metrics, key corruption and minimum corruption, that capture the goals of locking under different attack scenarios. We develop a flow for approximating these metrics on generic locked circuits and evaluate several locking techniques.
△ Less
Submitted 11 March, 2021;
originally announced March 2021.
-
FuzzSplore: Visualizing Feedback-Driven Fuzzing Techniques
Authors:
Andrea Fioraldi,
Luigi Paolo Pileggi
Abstract:
Fuzz Testing techniques are the state of the art in software testing for security issues nowadays. Their great effectiveness attracted the attention of researchers and hackers and involved them in develo** a lot of new techniques to improve Fuzz Testing. The evaluation and the cross-comparison of these techniques is an almost open problem. In this paper, we propose a human-driven approach to thi…
▽ More
Fuzz Testing techniques are the state of the art in software testing for security issues nowadays. Their great effectiveness attracted the attention of researchers and hackers and involved them in develo** a lot of new techniques to improve Fuzz Testing. The evaluation and the cross-comparison of these techniques is an almost open problem. In this paper, we propose a human-driven approach to this problem based on information visualization. We developed a prototype upon the AFL++ fuzzing framework, FuzzSplore, that an analyst can use to get useful insights about different fuzzing configurations applied to a specific target in order to choose or tune the best technique during a fuzzing campaign.
△ Less
Submitted 6 February, 2021; v1 submitted 4 February, 2021;
originally announced February 2021.
-
Dynamic Graph-Based Anomaly Detection in the Electrical Grid
Authors:
Shimiao Li,
Amritanshu Pandey,
Bryan Hooi,
Christos Faloutsos,
Larry Pileggi
Abstract:
Given sensor readings over time from a power grid, how can we accurately detect when an anomaly occurs? A key part of achieving this goal is to use the network of power grid sensors to quickly detect, in real-time, when any unusual events, whether natural faults or malicious, occur on the power grid. Existing bad-data detectors in the industry lack the sophistication to robustly detect broad types…
▽ More
Given sensor readings over time from a power grid, how can we accurately detect when an anomaly occurs? A key part of achieving this goal is to use the network of power grid sensors to quickly detect, in real-time, when any unusual events, whether natural faults or malicious, occur on the power grid. Existing bad-data detectors in the industry lack the sophistication to robustly detect broad types of anomalies, especially those due to emerging cyber-attacks, since they operate on a single measurement snapshot of the grid at a time. New ML methods are more widely applicable, but generally do not consider the impact of topology change on sensor measurements and thus cannot accommodate regular topology adjustments in historical data. Hence, we propose DYNWATCH, a domain knowledge based and topology-aware algorithm for anomaly detection using sensors placed on a dynamic grid. Our approach is accurate, outperforming existing approaches by 20% or more (F-measure) in experiments; and fast, running in less than 1.7ms on average per time tick per sensor on a 60K+ branch case using a laptop computer, and scaling linearly in the size of the graph.
△ Less
Submitted 2 December, 2021; v1 submitted 29 December, 2020;
originally announced December 2020.
-
A WLAV-based Robust Hybrid State Estimation using Circuit-theoretic Approach
Authors:
Shimiao Li,
Amritanshu Pandey,
Larry Pileggi
Abstract:
For reliable and secure power grid operation, AC state-estimation (ACSE) must provide certain guarantees of convergence while being resilient against bad-data. This paper develops a circuit-theoretic weighted least absolute value (WLAV) based hybrid ACSE that satisfies these needs to overcome some of the limitations of existing ACSE methods. Hybrid refers to the inclusion of RTU and PMU measuremen…
▽ More
For reliable and secure power grid operation, AC state-estimation (ACSE) must provide certain guarantees of convergence while being resilient against bad-data. This paper develops a circuit-theoretic weighted least absolute value (WLAV) based hybrid ACSE that satisfies these needs to overcome some of the limitations of existing ACSE methods. Hybrid refers to the inclusion of RTU and PMU measurement data, and the use of the LAV objective function enables automatic rejection of bad data while providing clear identification of suspicious measurements from the sparse residual vector. Taking advantage of linear construction of the measurement models in circuit-theoretic approach, the proposed hybrid SE is formulated as a LP problem with guaranteed convergence. To address efficiency, we further develop problem-specific heuristics for fast convergence. To validate the efficacy of the proposed approach, we run ACSE on large cases and compare the results against WLS-based algorithms. We further demonstrate the advantages of our solution methodology over standard commercial LP solvers through comparison of runtime and convergence performance.
△ Less
Submitted 28 February, 2021; v1 submitted 11 November, 2020;
originally announced November 2020.
-
Incremental Model Building Homotopy Approach for Solving Exact AC-Constrained Optimal Power Flow
Authors:
Amritanshu Pandey,
Aayushya Agarwal,
Larry Pileggi
Abstract:
Alternating-Current Optimal Power Flow (AC-OPF) is framed as a NP-hard non-convex optimization problem that solves for the most economical dispatch of grid generation given the AC-network and device constraints. Although there are no standard methodologies for obtaining the global optimum for the problem, there is considerable interest from planning and operational engineers in finding a local opt…
▽ More
Alternating-Current Optimal Power Flow (AC-OPF) is framed as a NP-hard non-convex optimization problem that solves for the most economical dispatch of grid generation given the AC-network and device constraints. Although there are no standard methodologies for obtaining the global optimum for the problem, there is considerable interest from planning and operational engineers in finding a local optimum. Nonetheless, solving for the local optima of a large AC-OPF problem is challenging and time-intensive, as none of the leading non-linear optimization toolboxes can provide any timely guarantees of convergence. To provide robust local convergence for large complex systems, we introduce a homotopy-based approach that solves a sequence of primal-dual interior point problems. We utilize the physics of the grid to develop the proposed homotopy method and demonstrate the efficacy of this approach on U.S. Eastern Interconnection sized test networks.
△ Less
Submitted 1 November, 2020;
originally announced November 2020.
-
Modeling Techniques for Logic Locking
Authors:
Joseph Sweeney,
Marijn J. H. Heule,
Lawrence Pileggi
Abstract:
Logic locking is a method to prevent intellectual property (IP) piracy. However, under a reasonable attack model, SAT-based methods have proven to be powerful in obtaining the secret key. In response, many locking techniques have been developed to specifically resist this form of attack. In this paper, we demonstrate two SAT modeling techniques that can provide many orders of magnitude speed up in…
▽ More
Logic locking is a method to prevent intellectual property (IP) piracy. However, under a reasonable attack model, SAT-based methods have proven to be powerful in obtaining the secret key. In response, many locking techniques have been developed to specifically resist this form of attack. In this paper, we demonstrate two SAT modeling techniques that can provide many orders of magnitude speed up in discovering the correct key. Specifically, we consider relaxed encodings and symmetry breaking. To demonstrate their impact, we model and attack a state-of-the-art logic locking technique, Full-Lock. We show that circuits previously unbreakable within 15 days of run time can be solved in seconds. Consequently, in assessing the strength of any given locking, it is imperative that these modeling techniques be considered. To remedy this vulnerability in the considered locking technique, we demonstrate an extended version, logic-enhanced Banyan locking, that is resistant to our proposed modeling techniques.
△ Less
Submitted 21 September, 2020;
originally announced September 2020.
-
Latch-Based Logic Locking
Authors:
Joseph Sweeney,
Mohammed Zackriya V,
Samuel Pagliarini,
Lawrence Pileggi
Abstract:
Globalization of IC manufacturing has led to increased security concerns, notably IP theft. Several logic locking techniques have been developed for protecting designs, but they typically display very large overhead, and are generally susceptible to deciphering attacks. In this paper, we propose latch-based logic locking, which manipulates both the flow of data and logic in the design. This method…
▽ More
Globalization of IC manufacturing has led to increased security concerns, notably IP theft. Several logic locking techniques have been developed for protecting designs, but they typically display very large overhead, and are generally susceptible to deciphering attacks. In this paper, we propose latch-based logic locking, which manipulates both the flow of data and logic in the design. This method converts an interconnected subset of existing flip-flops to pairs of latches with programmable phase. In tandem, decoy latches and logic are added, inhibiting an attacker from determining the actual design functionality. To validate this technique, we developed and verified a locking insertion flow, analyzed PPA and ATPG overhead on benchmark circuits and industry cores, extended existing attacks to account for the technique, and taped out a demonstration chip. Importantly, we show that the design overhead with this approach is significantly less than with previous logic locking schemes, while resisting model checker-based, oracle-driven attacks. With minimal delay overhead, large numbers of decoy latches can be added, cheaply increasing attack resistance.
△ Less
Submitted 21 May, 2020;
originally announced May 2020.
-
Securing Digital Systems via Split-Chip Obfuscation
Authors:
Joseph Sweeney,
Samuel Pagliarini,
Lawrence Pileggi
Abstract:
Security is an important facet of integrated circuit design for many applications. IP privacy and Trojan insertion are growing threats as circuit fabrication in advanced nodes almost inevitably relies on untrusted foundries. A proposed solution is Split-Chip Obfuscation that uses a combination trusted and untrusted IC fabrication scheme. By utilizing two CMOS processes, a system is endowed with th…
▽ More
Security is an important facet of integrated circuit design for many applications. IP privacy and Trojan insertion are growing threats as circuit fabrication in advanced nodes almost inevitably relies on untrusted foundries. A proposed solution is Split-Chip Obfuscation that uses a combination trusted and untrusted IC fabrication scheme. By utilizing two CMOS processes, a system is endowed with the stronger security guaranties of a trusted legacy node while also leveraging the performance and density of an advanced untrusted node. Critical to the effectiveness of Split-Chip Obfuscation is finding an optimum partitioning of a system between the two ICs. In this paper, we develop a design flow for the Split-Chip Obfuscation scheme, defining the essential system metrics and creating a tool to rapidly assess the large design space. We demonstrate the concept of such a tool and show its application on an example SoC.
△ Less
Submitted 20 May, 2020;
originally announced May 2020.
-
A Circuit-Theoretic Approach to State Estimation
Authors:
Shimiao Li,
Amritanshu Pandey,
Soummya Kar,
Larry Pileggi
Abstract:
Traditional state estimation (SE) methods that are based on nonlinear minimization of the sum of localized measurement error functionals are known to suffer from non-convergence and large residual errors. In this paper we propose an equivalent circuit formulation (ECF)-based SE approach that inherently considers the complete network topology and associated physical constraints. We analyze the math…
▽ More
Traditional state estimation (SE) methods that are based on nonlinear minimization of the sum of localized measurement error functionals are known to suffer from non-convergence and large residual errors. In this paper we propose an equivalent circuit formulation (ECF)-based SE approach that inherently considers the complete network topology and associated physical constraints. We analyze the mathematical differences between the two approaches and show that our approach produces a linear state-estimator that is mathematically a quadratic programming (QP) problem with closed-form solution. Furthermore, this formulation imposes additional topology-based constraints that provably shrink the feasible region and promote convergence to a more physically meaningful solution. From a probabilistic viewpoint, we show that our method applies prior knowledge into the estimate, thus converging to a more physics-based estimate than the traditional observation-driven maximum likelihood estimator (MLE). Importantly, incorporation of the entire system topology and underlying physics, while being linear, makes ECF-based SE advantageous for large-scale systems.
△ Less
Submitted 29 August, 2020; v1 submitted 12 November, 2019;
originally announced November 2019.
-
A LASSO-Inspired Approach for Localizing Power System Infeasibility
Authors:
Shimiao Li,
Amritanshu Pandey,
Aayushya Agarwal,
Marko Jereminov,
Larry Pileggi
Abstract:
A method is proposed to identify and localize the cause of network collapse with augmented power flow analysis for a grid model with insufficient resources. Owing to heavy network loading, insufficient generation, component failures and unavoidable disturbances, power grid models can sometimes fail to converge to a feasible solution for a steady-state power flow study. For applications such as sys…
▽ More
A method is proposed to identify and localize the cause of network collapse with augmented power flow analysis for a grid model with insufficient resources. Owing to heavy network loading, insufficient generation, component failures and unavoidable disturbances, power grid models can sometimes fail to converge to a feasible solution for a steady-state power flow study. For applications such as system expansion planning, it is desirable to locate the system buses that are contributing to network infeasibilities to facilitate corrective actions. This paper proposes a novel LASSO-inspired regularization of the power flow matrix that enforces sparsity to localize and quantify infeasibilities in the network. One of the examples demonstrates how the proposed method is capable of localizing a source of blackout to a single dominant bus on an 80k+ bus eastern interconnection model.
△ Less
Submitted 12 November, 2019;
originally announced November 2019.
-
SUGAR-R: Robust Online Restoration Platform for SCADA-Absent Grid
Authors:
Amritanshu Pandey,
Aayushya Agrawal,
Marko Jereminov,
Larry Pileggi
Abstract:
Secure and fast grid restoration from a collapsed state is increasingly critical as blackouts are becoming more prevalent around the globe. Generally, the restoration of grid during a blackout is achieved with the help of Supervisory Control and Data Acquisition System (SCADA) based central control; however, with the threat of cyber-blackouts, this presumption of an available and secure SCADA syst…
▽ More
Secure and fast grid restoration from a collapsed state is increasingly critical as blackouts are becoming more prevalent around the globe. Generally, the restoration of grid during a blackout is achieved with the help of Supervisory Control and Data Acquisition System (SCADA) based central control; however, with the threat of cyber-blackouts, this presumption of an available and secure SCADA system is not valid. This is also true for grids in develo** countries as well as for many distribution and micro grids that lack SCADA. In this paper, we introduce an online framework for localized grid restoration that validates and updates a pre-defined crank path in real-time based on the vital grid states of voltages, currents and frequency. The proposed framework maintains an online network topology of the localized grid that can continuously sample local measurements and update the grid model, thereby circumventing SCADA based central control. In the results section we demonstrate the efficacy of this framework for blackstart by ensuring a feasible crank path with voltage and frequency states within bounds, while further assisting in synchronization of two disconnected sub-grids during the re-energization process using a distributed framework.
△ Less
Submitted 4 June, 2020; v1 submitted 8 October, 2019;
originally announced October 2019.
-
Implicitly Modeling Frequency Control within Power Flow
Authors:
Aayushya Agarwal,
Amritanshu Pandey,
Marko Jereminov,
Larry Pileggi
Abstract:
In this paper, we extend a circuit-based, current-voltage power flow formulation to include frequency deviations and implicitly model generator primary and secondary control actions as a function of their temporal dependence. This includes extending the slack bus generator model(s) to better represents its true behavior with frequency controls. These implicit models obviate the need for outer iter…
▽ More
In this paper, we extend a circuit-based, current-voltage power flow formulation to include frequency deviations and implicitly model generator primary and secondary control actions as a function of their temporal dependence. This includes extending the slack bus generator model(s) to better represents its true behavior with frequency controls. These implicit models obviate the need for outer iteration loops and improve the robustness of the simulation convergence when frequency deviations are considered. The simulation framework is highly scalable and is demonstrated on 85k+ bus systems.
△ Less
Submitted 30 August, 2019;
originally announced August 2019.
-
Steady-State Simulation for Combined Transmission and Distribution Systems
Authors:
Amritanshu Pandey,
Larry Pileggi
Abstract:
The future electric grid will consist of significant penetration of renewable and distributed generation that is likely to create a homogenous transmission and distribution (T&D) system, requiring tools that can model and robustly simulate the combined T&D networks. Existing tools use disparate models and formulations for simulation of transmission versus distribution grids and solving for the ste…
▽ More
The future electric grid will consist of significant penetration of renewable and distributed generation that is likely to create a homogenous transmission and distribution (T&D) system, requiring tools that can model and robustly simulate the combined T&D networks. Existing tools use disparate models and formulations for simulation of transmission versus distribution grids and solving for the steady-state solution of the combined T&D networks often lacks convergence robustness and scalability to large systems. In this paper, we show that modeling both the T&D grid elements in terms of currents and voltages using an equivalent circuit framework enables simulation of combined positive sequence networks of the transmission grids with three-phase networks of the distribution grids without loss of generality. We further demonstrate that we can ensure robust convergence for these resulting large-scale complex T&D systems when the circuit simulation methods are applied to them. Our results illustrate robust convergence of combined T&D networks using a direct Newton-Raphson solver on a single machine for smaller sized systems and using a parallel Gauss-Seidel-Newton solver on multiple machines for larger sized systems with greater than million nodes.
△ Less
Submitted 29 July, 2019;
originally announced July 2019.
-
Enhanced Modelling Framework for Equivalent Circuit-Based Power System State Estimation
Authors:
Aleksandar Jovicic,
Marko Jereminov,
Larry Pileggi,
Gabriela Hug
Abstract:
The equivalent split-circuit formulation is a novel approach that has recently been applied to a range of power system related problems. As a result, a linear and a nonlinear method for power system state estimation with simultaneous treatment of the conventional and synchrophasor measurements have been proposed. In this paper, new circuit models are introduced for different combinations of conven…
▽ More
The equivalent split-circuit formulation is a novel approach that has recently been applied to a range of power system related problems. As a result, a linear and a nonlinear method for power system state estimation with simultaneous treatment of the conventional and synchrophasor measurements have been proposed. In this paper, new circuit models are introduced for different combinations of conventional measurements, thus providing a complete modelling framework for these methods. Additionally, handling cases of null injections and buses with no measurements are included. Simulations are performed on several test systems in order to evaluate the performance of both methods with the enhanced modelling framework and to compare them to a hybrid constrained estimator based on the conventional WLS approach.
△ Less
Submitted 23 July, 2019;
originally announced July 2019.
-
Improving Voltage Profile of the Nigerian Power Grid
Authors:
Amritanshu Pandey,
Aayushya Agarwal,
Marko Jereminov,
Tochi Nwachuku,
Barry G. Rawn,
Larry Pileggi
Abstract:
Extreme voltages at the system nodes are one of the primary causes for total and partial collapse of the Nigerian grid. In this paper, we develop a framework to re-dispatch the voltage set-points of committed generators in the grid to improve the voltage profile of the system nodes thus lowering the likelihood of a grid collapse. This framework is an extension of circuit-theoretic formulation that…
▽ More
Extreme voltages at the system nodes are one of the primary causes for total and partial collapse of the Nigerian grid. In this paper, we develop a framework to re-dispatch the voltage set-points of committed generators in the grid to improve the voltage profile of the system nodes thus lowering the likelihood of a grid collapse. This framework is an extension of circuit-theoretic formulation that can robustly solve general-purpose grid optimization problems. In the results section, we re-dispatch the voltage setpoints for committed generators in real-life Nigerian grid operation and planning test cases to improve the overall voltage profile of the grid. We further demonstrate that the re-dispatched grid is more resilient and secure than the base case through running contingency analyses.
△ Less
Submitted 16 June, 2019; v1 submitted 30 May, 2019;
originally announced May 2019.
-
A Probabilistic Approach to Power System State Estimation using a Linear Algorithm
Authors:
Martin R. Wagner,
Marko Jereminov,
Amritanshu Pandey,
Larry Pileggi
Abstract:
An equivalent circuit formulation for power system analysis was demonstrated to improve robustness of Power Flow and enable more generalized modeling, including that for RTUs (Remote Terminal Units) and PMUs (Phasor Measurement Units). These measurement device models, together with an adjoint circuit based optimization framework, enable an alternative formulation to Power System State Estimation (…
▽ More
An equivalent circuit formulation for power system analysis was demonstrated to improve robustness of Power Flow and enable more generalized modeling, including that for RTUs (Remote Terminal Units) and PMUs (Phasor Measurement Units). These measurement device models, together with an adjoint circuit based optimization framework, enable an alternative formulation to Power System State Estimation (SE) that can be solved within the equivalent circuit formulation. In this paper, we utilize a linear RTU model to create a fully linear SE algorithm that includes PMU and RTU measurements to enable a probabilistic approach to SE. Results demonstrate that this is a practical approach that is well suited for real-world applications.
△ Less
Submitted 1 May, 2019;
originally announced May 2019.
-
Robust Sequential Steady-State Analysis of Cascading Outages
Authors:
Amritanshu Pandey,
Aayushya Agarwal,
Marko Jereminov,
Martin R. Wagner,
David M. Bromberg,
Larry Pileggi
Abstract:
Simulating potential cascading failures can be useful for avoiding or mitigating such events. Currently, existing steady-state analysis tools are ill-suited for simulating cascading outages as they do not model frequency dependencies, they require good initial conditions to converge, and they are unable to distinguish between a collapsed grid state from a hard-to-solve test case. In this paper, we…
▽ More
Simulating potential cascading failures can be useful for avoiding or mitigating such events. Currently, existing steady-state analysis tools are ill-suited for simulating cascading outages as they do not model frequency dependencies, they require good initial conditions to converge, and they are unable to distinguish between a collapsed grid state from a hard-to-solve test case. In this paper, we extend a circuit-theoretic approach for simulating the steady-state of a power grid to incorporate frequency deviations and implicit models for underfrequency and undervoltage load shedding. Using these models, we introduce a framework capable of robustly solving cascading outages of large-scale systems that can also locate infeasible regions. We demonstrate the efficacy of our approach by simulating entire cascading outages on more than 8000 nodes sample testcase.
△ Less
Submitted 21 November, 2019; v1 submitted 24 April, 2019;
originally announced April 2019.
-
Robust and Efficient Power Flow Convergence with G-min Step** Homotopy Method
Authors:
Marko Jereminov,
Athanasios Terzakis,
Martin Wagner,
Amritanshu Pandey,
Larry Pileggi
Abstract:
Recent advances have shown that the circuit simulation algorithms that allow for solving highly nonlinear circuits of over one billion variables can be applicable to power system simulation and optimization problems through the use of an equivalent circuit formulation. It was demonstrated that large-scale (80k+ buses) power flow simulations can be robustly solved, independent of the initial starti…
▽ More
Recent advances have shown that the circuit simulation algorithms that allow for solving highly nonlinear circuits of over one billion variables can be applicable to power system simulation and optimization problems through the use of an equivalent circuit formulation. It was demonstrated that large-scale (80k+ buses) power flow simulations can be robustly solved, independent of the initial starting point. In this paper, we extend the electronic circuit-based G-min step** homotopy method to power flow simulations. Preliminary results indicate that the proposed algorithm results in significantly better simulation runtime performance when compared to existing homotopy methods.
△ Less
Submitted 9 April, 2019;
originally announced April 2019.
-
Equivalent Circuit Programming for Estimating the State of a Power System
Authors:
Marko Jereminov,
Aleksandar Jovicic,
Martin R. Wagner,
Gabriela Hug,
Larry Pileggi
Abstract:
An Equivalent Circuit Programming (ECP) approach that expresses the optimality conditions of an optimization problem in terms of an equivalent circuit model and uses circuit simulation techniques to solve for an optimal solution, is applied to the state estimation problem for power systems. The benefits of using an equivalent circuit formulation for incorporating both Phasor Measurement Units (PMU…
▽ More
An Equivalent Circuit Programming (ECP) approach that expresses the optimality conditions of an optimization problem in terms of an equivalent circuit model and uses circuit simulation techniques to solve for an optimal solution, is applied to the state estimation problem for power systems. The benefits of using an equivalent circuit formulation for incorporating both Phasor Measurement Units (PMU) and Remote Terminal Units (RTU), as well as for reducing the nonlinearities of the state estimation problem was previously demonstrated. In this paper we further exploit the circuit nature of the state estimation problem to formulate not only the model but also the optimality conditions as an ECP problem. The efficiency and accuracy of our approach are demonstrated by estimating the states of large-scale power grids (80k+ buses).
△ Less
Submitted 9 April, 2019;
originally announced April 2019.
-
Impact of Load Models on Power Flow Optimization
Authors:
Marko Jereminov,
Bryan Hooi,
Amritanshu Pandey,
Hyun-Ah Song,
Christos Faloutsos,
Larry Pileggi
Abstract:
Aggregated load models, such as PQ and ZIP, are used to represent the approximated load demand at specific buses in grid simulation and optimization problems. In this paper we examine the impact of model choice on the optimal power flow solution and demonstrate that it is possible for different load models to represent the same amount of real and reactive power at the optimal solution yet correspo…
▽ More
Aggregated load models, such as PQ and ZIP, are used to represent the approximated load demand at specific buses in grid simulation and optimization problems. In this paper we examine the impact of model choice on the optimal power flow solution and demonstrate that it is possible for different load models to represent the same amount of real and reactive power at the optimal solution yet correspond to completely different grid operating points. We introduce the metric derived from the maximum power transfer theorem to identify the behavior of an aggregated model in the OPF formulation to indicate its possible limitations. A dataset from the Carnegie Mellon campus is used to characterize three types of load models using a time-series machine learning algorithm, from which the optimal power flow results demonstrate that the choice of load model type has a significant impact on the solution set points. For example, our results show that the PQ load accurately characterizes the CMU data behavior correctly for only 16.7% of the cases.
△ Less
Submitted 9 April, 2019; v1 submitted 11 February, 2019;
originally announced February 2019.
-
An Equivalent Circuit Formulation for Power System State Estimation including PMUs
Authors:
Aleksandar Jovicic,
Marko Jereminov,
Larry Pileggi,
Gabriela Hug
Abstract:
In this paper, a novel formulation for the power system state estimation is proposed, based on the recently introduced equivalent split-circuit formulation of the power flow problem. The formulation models the conventional and time synchronized measurements simultaneously and contains a significantly lower level of nonlinearity compared to the available hybrid state estimators. The appropriate cir…
▽ More
In this paper, a novel formulation for the power system state estimation is proposed, based on the recently introduced equivalent split-circuit formulation of the power flow problem. The formulation models the conventional and time synchronized measurements simultaneously and contains a significantly lower level of nonlinearity compared to the available hybrid state estimators. The appropriate circuit models are derived for different types of measurements and integrated into the existing circuit framework for the power flow problem. A constrained optimization problem is then formulated to estimate the states of the system in rectangular coordinates, while satisfying the circuit equations and bounds on the measurement data. To further prove the concept and validate the accuracy of the proposed formulation, several test cases are solved and the results are presented and discussed.
△ Less
Submitted 17 December, 2018;
originally announced December 2018.
-
Linear Power Grid State Estimation with Modeling Uncertainties
Authors:
Martin R. Wagner,
Marko Jereminov,
Larry Pileggi
Abstract:
Recent advances in power system State Estimation (SE) have included equivalent circuit models for representing measurement data that allows incorporation of both PMU and RTU measurements within the state estimator. In this paper, we introduce a probabilistic framework with a new RTU model that renders the complete SE problem linear while not affecting its accuracy. It is demonstrated that the prob…
▽ More
Recent advances in power system State Estimation (SE) have included equivalent circuit models for representing measurement data that allows incorporation of both PMU and RTU measurements within the state estimator. In this paper, we introduce a probabilistic framework with a new RTU model that renders the complete SE problem linear while not affecting its accuracy. It is demonstrated that the probabilistic state of a system can be efficiently and accurately estimated not only with the uncertainties from the measurement data, but also while including variations from transmission network models. To demonstrate accuracy and scalability we present probabilistic state estimation results for the 82k test case that represents the transmission level grid of the entire USA. It is shown that the estimated state distributions include the true grid state, while their mean exactly corresponds to the estimated deterministic state obtained from the nonlinear state estimator.
△ Less
Submitted 12 December, 2018;
originally announced December 2018.
-
A Linear Formulation for Power System State Estimation including RTU and PMU Measurements
Authors:
Aleksandar Jovicic,
Marko Jereminov,
Larry Pileggi,
Gabriela Hug
Abstract:
In this paper, a novel linear formulation for power system state estimation that simultaneously treats conventional and synchrophasor measurements is proposed. A linear circuit model for conventional measurements is introduced to enable a fully linear equivalent circuit representation of the power system. The estimated system state is then obtained by formulating the optimization problem to minimi…
▽ More
In this paper, a novel linear formulation for power system state estimation that simultaneously treats conventional and synchrophasor measurements is proposed. A linear circuit model for conventional measurements is introduced to enable a fully linear equivalent circuit representation of the power system. The estimated system state is then obtained by formulating the optimization problem to minimize the measurement errors and solving the resulting linear set of optimality conditions. To evaluate the accuracy of the proposed method, simulations are performed on several test cases of various sizes and the results are presented and discussed.
△ Less
Submitted 30 November, 2018;
originally announced December 2018.
-
Continuously Differentiable Analytical Models for Implicit Control within Power Flow
Authors:
Aayushya Agarwal,
Amritanshu Pandey,
Marko Jereminov,
Larry Pileggi
Abstract:
Achieving robust and scalable convergence for simulation of realistic power flow cases can be challenging. One specific issue relates to the disconnected solution space that is created by the use of piecewise-discontinuous models of power grid devices that perform control mechanisms. These models are generally resolved by outer iteration loops around power flow, which can result in solution oscill…
▽ More
Achieving robust and scalable convergence for simulation of realistic power flow cases can be challenging. One specific issue relates to the disconnected solution space that is created by the use of piecewise-discontinuous models of power grid devices that perform control mechanisms. These models are generally resolved by outer iteration loops around power flow, which can result in solution oscillations, increased iteration count, divergence or even convergence to a solution in an unstable operational region. This paper introduces a continuously differentiable model for device control mechanisms that is incorporated within the power flow formulation. To ensure robust power flow convergence properties, recently introduced homotopy methods are extended to include these continuous models. The scalability and efficacy of the proposed formulation is demonstrated on several large-scale test cases that represent the US Eastern Interconnect network, the Synthetic USA, and the Nigerian grid.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
Evaluating Feasibility within Power Flow
Authors:
Marko Jereminov,
David M. Bromberg,
Amritanshu Pandey,
Martin R. Wagner,
Larry Pileggi
Abstract:
Recent development of techniques that improve the convergence properties of power flow simulation have been demonstrated to facilitate scaling to large system sizes (80k+ buses). However, the problem remains to reliably identify cases that are infeasible, system configurations that have no solution. In this paper, we use the circuit theoretic approach based on adjoint networks to evaluate the feas…
▽ More
Recent development of techniques that improve the convergence properties of power flow simulation have been demonstrated to facilitate scaling to large system sizes (80k+ buses). However, the problem remains to reliably identify cases that are infeasible, system configurations that have no solution. In this paper, we use the circuit theoretic approach based on adjoint networks to evaluate the feasibility of a power flow test case and further locate and quantify the source of infeasibility in the cases operating beyond the tip of the nose curve. By creating infeasibility current source models that are added to each node of the system model and further coupling each source to its corresponding node of the adjoint network, any locations of insufficient real or reactive power are captured by a non-zero response of the adjoint network. Furthermore, it is shown that the proposed joint simulation of power flow and its adjoint network models provide the optimally minimized currents that can be later utilized to inform corrective actions to restore the feasibility of power flow problems.
△ Less
Submitted 7 December, 2019; v1 submitted 5 September, 2018;
originally announced September 2018.
-
Unified power system analyses and models using equivalent circuit formulation
Authors:
Amritanshu Pandey,
Marko Jereminov,
Xin Li,
Gabriela Hug,
Larry Pileggi
Abstract:
In this paper we propose and demonstrate the potential for unifying models and algorithms for the steady state and transient simulation of single-phase and three-phase power systems. At present, disparate algorithms and models are used for the different analyses, which can lead to inconsistencies such as the transient analysis as time approaches infinity not matching the steady state analysis of t…
▽ More
In this paper we propose and demonstrate the potential for unifying models and algorithms for the steady state and transient simulation of single-phase and three-phase power systems. At present, disparate algorithms and models are used for the different analyses, which can lead to inconsistencies such as the transient analysis as time approaches infinity not matching the steady state analysis of the same conditions. Using our equivalent circuit formulation of the power system, we propose a methodology for forming physics-based models that can facilitate transient, balanced power flow, and three-phase power flow in one simulation environment. The approach is demonstrated on a three-phase induction motor. Existing industry tools are used to validate the model and simulation results for the different analyses.
△ Less
Submitted 10 August, 2018;
originally announced August 2018.
-
Robust Probabilistic Analysis of Transmission Power Systems based on Equivalent Circuit Formulation
Authors:
Martin R. Wagner,
Amritanshu Pandey,
Marko Jereminov,
Larry Pileggi
Abstract:
Recent advances in steady-state analysis of power systems have introduced the equivalent split-circuit approach and corresponding continuation methods that can reliably find the correct physical solution of large-scale power system problems. The improvement in robustness provided by these developments are the basis for improvements in other fields of power system research. Probabilistic Power Flow…
▽ More
Recent advances in steady-state analysis of power systems have introduced the equivalent split-circuit approach and corresponding continuation methods that can reliably find the correct physical solution of large-scale power system problems. The improvement in robustness provided by these developments are the basis for improvements in other fields of power system research. Probabilistic Power Flow studies are one of the areas of impact. This paper will describe a Simple Random Sampling Monte Carlo approach for probabilistic contingency analyses of transmission line power systems. The results are compared with those from Monte Carlo simulations using a standard power flow tool. Lastly, probabilistic contingency studies on two publicly available power system cases are presented.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
Robust Power Flow and Three-Phase Power Flow Analyses
Authors:
Amritanshu Pandey,
Marko Jereminov,
Martin R. Wagner,
David M. Bromberg,
Gabriela Hug,
Larry Pileggi
Abstract:
Robust simulation is essential for reliable operation and planning of transmission and distribution power grids. At present, disparate methods exist for steady-state analysis of the transmission (power flow) and distribution power grid (three-phase power flow). Due to the non-linear nature of the problem, it is difficult for alternating current (AC) power flow and three-phase power flow analyses t…
▽ More
Robust simulation is essential for reliable operation and planning of transmission and distribution power grids. At present, disparate methods exist for steady-state analysis of the transmission (power flow) and distribution power grid (three-phase power flow). Due to the non-linear nature of the problem, it is difficult for alternating current (AC) power flow and three-phase power flow analyses to ensure convergence to the correct physical solution, particularly from arbitrary initial conditions, or when evaluating a change (e.g. contingency) in the grid. In this paper, we describe our equivalent circuit formulation approach with current and voltage variables that models both the positive sequence network of the transmission grid and three-phase network of the distribution grid without loss of generality. The proposed circuit models and formalism enable the extension and application of circuit simulation techniques to solve for the steady-state solution with excellent robustness of convergence. Examples for positive sequence transmission and three-phase distribution systems, including actual 75k+ nodes Eastern Interconnection transmission test cases and 8k+ nodes taxonomy distribution test cases, are solved from arbitrary initial guesses to demonstrate the efficacy of our approach.
△ Less
Submitted 8 August, 2018; v1 submitted 3 March, 2018;
originally announced March 2018.
-
Aggregated Load and Generation Equivalent Circuit Models with Semi-Empirical Data Fitting
Authors:
Amritanshu Pandey,
Marko Jereminov,
Xin Li,
Gabriela Hug,
Larry Pileggi
Abstract:
In this paper we propose a semi-empirical modeling framework for aggregated electrical load and generation using an equivalent circuit formulation. The proposed models are based on complex rectangular voltage and current state variables that provide a generalized form for accurately representing any transmission and distribution components. The model is based on the split equivalent circuit formul…
▽ More
In this paper we propose a semi-empirical modeling framework for aggregated electrical load and generation using an equivalent circuit formulation. The proposed models are based on complex rectangular voltage and current state variables that provide a generalized form for accurately representing any transmission and distribution components. The model is based on the split equivalent circuit formulation that was previously shown to unify power flow, three phase power flow, harmonic power flow, and transient analyses. Importantly, this formulation establishes variables that are analytical and are compatible with model fitting and machine learning approaches. The parameters for the proposed semi-empirical load and generation models are synthesized from measurement data and can enable real-time simulations for time varying aggregated loads and generation.
△ Less
Submitted 18 November, 2017;
originally announced November 2017.
-
Improving Power Flow Robustness via Circuit Simulation Methods
Authors:
Amritanshu Pandey,
Marko Jereminov,
Gabriela Hug,
Larry Pileggi
Abstract:
Recent advances in power system simulation have included the use of complex rectangular current and voltage (I-V) variables for solving the power flow and three-phase power flow problems. This formulation has demonstrated superior convergence properties over conventional polar coordinate based formulations for three-phase power flow, but has failed to replicate the same advantages for power flow i…
▽ More
Recent advances in power system simulation have included the use of complex rectangular current and voltage (I-V) variables for solving the power flow and three-phase power flow problems. This formulation has demonstrated superior convergence properties over conventional polar coordinate based formulations for three-phase power flow, but has failed to replicate the same advantages for power flow in general due to convergence issues with systems containing PV buses. In this paper, we demonstrate how circuit simulation techniques can provide robust convergence for any complex I-V formulation that is derived from our split equivalent circuit representation. Application to power grid test systems with up to 10000 buses demonstrates consistent global convergence to the correct physical solution from arbitrary initial conditions.
△ Less
Submitted 5 November, 2017;
originally announced November 2017.
-
Robust Convergence of Power Flow using Tx Step** Method with Equivalent Circuit Formulation
Authors:
Amritanshu Pandey,
Marko Jereminov,
Martin R. Wagner,
Gabriela Hug,
Larry Pileggi
Abstract:
Robust solving of critical large power flow cases (with 50k or greater buses) forms the backbone of planning and operation of any large connected power grid. At present, reliable convergence with applications of existing power flow tools to large power systems is contingent upon a good initial guess for the system state. To enable robust convergence for large scale systems starting with an arbitra…
▽ More
Robust solving of critical large power flow cases (with 50k or greater buses) forms the backbone of planning and operation of any large connected power grid. At present, reliable convergence with applications of existing power flow tools to large power systems is contingent upon a good initial guess for the system state. To enable robust convergence for large scale systems starting with an arbitrary initial guess, we extend our equivalent circuit formulation for power flow analysis to include a novel continuation method based on transmission line (Tx) step**. While various continuation methods have been proposed for use with the traditional PQV power flow formulation, these methods have either failed to completely solve the problem or have resulted in convergence to a low voltage solution. The proposed Tx Step** method in this paper demonstrates robust convergence to the high voltage solution from an arbitrary initial guess. Example systems, including 75k+ bus test cases representing different loading and operating conditions for Eastern Interconnection of the U.S. power grid, are solved from arbitrary initial guesses.Interconnection of the U.S. power grid, are solved from arbitrary initial guesses.
△ Less
Submitted 4 November, 2017;
originally announced November 2017.