Showing 1–50 of 56 results for author: Deka, D

Contributions of Individual Generators to Nodal Carbon Emissions

Authors: Yize Chen, Deepjyoti Deka, Yuanyuan Shi

Abstract: Recent shifts toward sustainable energy systems have witnessed the fast deployment of carbon-free and carbon-efficient generations across the power networks. However, the benefits of carbon reduction are not experienced evenly throughout the grid. Each generator can have distinct carbon emission rates. Due to the existence of physical power flows, nodal power consumption is met by a combination of… ▽ More Recent shifts toward sustainable energy systems have witnessed the fast deployment of carbon-free and carbon-efficient generations across the power networks. However, the benefits of carbon reduction are not experienced evenly throughout the grid. Each generator can have distinct carbon emission rates. Due to the existence of physical power flows, nodal power consumption is met by a combination of a set of generators, while such combination is determined by network topology, generators' characteristics and power demand. This paper describes a technique based on physical power flow model, which can efficiently compute the nodal carbon emissions contributed by each single generator given the generation and power flow information. We also extend the technique to calculate both the nodal average carbon emission and marginal carbon emission rates. Simulation results validate the effectiveness of the calculations, while our technique provides a fundamental tool for applications such as carbon auditing, carbon-oriented demand management and future carbon-oriented capacity expansion. △ Less

Submitted 7 November, 2023; v1 submitted 6 November, 2023; originally announced November 2023.

Comments: Accepted at ACM e-Energy 2024. Code available at https://github.com/chennnnnyize/Carbon_Emission_Power_Grids

Fairly Extreme: Minimizing Outages Equitably

Authors: Kaarthik Sundar, Deepjyoti Deka, Russell Bent

Abstract: This paper focuses on the problem of minimizing the outages due to extreme events on the power grid equitably among all customers of the grid. The paper presents two ways of incorporating fairness into the existing formulations that seek to minimize the total outage in the power grid. The first method is motivated by existing literature on incorporating fairness in optimization problems and this i… ▽ More This paper focuses on the problem of minimizing the outages due to extreme events on the power grid equitably among all customers of the grid. The paper presents two ways of incorporating fairness into the existing formulations that seek to minimize the total outage in the power grid. The first method is motivated by existing literature on incorporating fairness in optimization problems and this is done by modifying the problem's objective function. The second method introduces a novel notion of fairness, termed $\varepsilon$-fairness, that can be incorporated into existing problem formulations through a single second-order cone constraint. Both these methods are very general and can be used to incorporate fairness in existing planning and operational optimization problems in the power grid and beyond. Extensive computational case studies that examine the effectiveness of both these methods to characterize fairness is presented followed by conclusions and ways forward. △ Less

Submitted 2 October, 2023; originally announced October 2023.

Comments: 8 pages

Report number: LA-UR-23-31124

Data-Efficient Strategies for Probabilistic Voltage Envelopes under Network Contingencies

Authors: Parikshit Pareek, Deepjyoti Deka, Sidhant Misra

Abstract: This work presents an efficient data-driven method to construct probabilistic voltage envelopes (PVE) using power flow learning in grids with network contingencies. First, a network-aware Gaussian process (GP) termed Vertex-Degree Kernel (VDK-GP), developed in prior work, is used to estimate voltage-power functions for a few network configurations. The paper introduces a novel multi-task vertex de… ▽ More This work presents an efficient data-driven method to construct probabilistic voltage envelopes (PVE) using power flow learning in grids with network contingencies. First, a network-aware Gaussian process (GP) termed Vertex-Degree Kernel (VDK-GP), developed in prior work, is used to estimate voltage-power functions for a few network configurations. The paper introduces a novel multi-task vertex degree kernel (MT-VDK) that amalgamates the learned VDK-GPs to determine power flows for unseen networks, with a significant reduction in the computational complexity and hyperparameter requirements compared to alternate approaches. Simulations on the IEEE 30-Bus network demonstrate the retention and transfer of power flow knowledge in both N-1 and N-2 contingency scenarios. The MT-VDK-GP approach achieves over 50% reduction in mean prediction error for novel N-1 contingency network configurations in low training data regimes (50-250 samples) over VDK-GP. Additionally, MT-VDK-GP outperforms a hyper-parameter based transfer learning approach in over 75% of N-2 contingency network structures, even without historical N-2 outage data. The proposed method demonstrates the ability to achieve PVEs using sixteen times fewer power flow solutions compared to Monte-Carlo sampling-based methods. △ Less

Submitted 3 April, 2024; v1 submitted 1 October, 2023; originally announced October 2023.

Comments: 10 Pages

Information Theoretically Optimal Sample Complexity of Learning Dynamical Directed Acyclic Graphs

Authors: Mishfad Shaikh Veedu, Deepjyoti Deka, Murti V. Salapaka

Abstract: In this article, the optimal sample complexity of learning the underlying interactions or dependencies of a Linear Dynamical System (LDS) over a Directed Acyclic Graph (DAG) is studied. We call such a DAG underlying an LDS as dynamical DAG (DDAG). In particular, we consider a DDAG where the nodal dynamics are driven by unobserved exogenous noise sources that are wide-sense stationary (WSS) in time… ▽ More In this article, the optimal sample complexity of learning the underlying interactions or dependencies of a Linear Dynamical System (LDS) over a Directed Acyclic Graph (DAG) is studied. We call such a DAG underlying an LDS as dynamical DAG (DDAG). In particular, we consider a DDAG where the nodal dynamics are driven by unobserved exogenous noise sources that are wide-sense stationary (WSS) in time but are mutually uncorrelated, and have the same {power spectral density (PSD)}. Inspired by the static DAG setting, a metric and an algorithm based on the PSD matrix of the observed time series are proposed to reconstruct the DDAG. It is shown that the optimal sample complexity (or length of state trajectory) needed to learn the DDAG is $n=Θ(q\log(p/q))$, where $p$ is the number of nodes and $q$ is the maximum number of parents per node. To prove the sample complexity upper bound, a concentration bound for the PSD estimation is derived, under two different sampling strategies. A matching min-max lower bound using generalized Fano's inequality also is provided, thus showing the order optimality of the proposed algorithm. △ Less

Submitted 31 March, 2024; v1 submitted 31 August, 2023; originally announced August 2023.

Comments: 21 pages. Accepted for publication in AISTATS 2024

Graph-Structured Kernel Design for Power Flow Learning using Gaussian Processes

Authors: Parikshit Pareek, Deepjyoti Deka, Sidhant Misra

Abstract: This paper presents a physics-inspired graph-structured kernel designed for power flow learning using Gaussian Process (GP). The kernel, named the vertex-degree kernel (VDK), relies on latent decomposition of voltage-injection relationship based on the network graph or topology. Notably, VDK design avoids the need to solve optimization problems for kernel search. To enhance efficiency, we also exp… ▽ More This paper presents a physics-inspired graph-structured kernel designed for power flow learning using Gaussian Process (GP). The kernel, named the vertex-degree kernel (VDK), relies on latent decomposition of voltage-injection relationship based on the network graph or topology. Notably, VDK design avoids the need to solve optimization problems for kernel search. To enhance efficiency, we also explore a graph-reduction approach to obtain a VDK representation with lesser terms. Additionally, we propose a novel network-swipe active learning scheme, which intelligently selects sequential training inputs to accelerate the learning of VDK. Leveraging the additive structure of VDK, the active learning algorithm performs a block-descent type procedure on GP's predictive variance, serving as a proxy for information gain. Simulations demonstrate that the proposed VDK-GP achieves more than two fold sample complexity reduction, compared to full GP on medium scale 500-Bus and large scale 1354-Bus power systems. The network-swipe algorithm outperforms mean performance of 500 random trials on test predictions by two fold for medium-sized 500-Bus systems and best performance of 25 random trials for large-scale 1354-Bus systems by 10%. Moreover, we demonstrate that the proposed method's performance for uncertainty quantification applications with distributionally shifted testing data sets. △ Less

Submitted 15 August, 2023; originally announced August 2023.

Comments: 10 pages

Optimal Power System Topology Control Under Uncertain Wildfire Risk

Authors: Yuqi Zhou, Kaarthik Sundar, Deepjyoti Deka, Hao Zhu

Abstract: Wildfires pose a significant threat to the safe and reliable operation of electric power systems. They can quickly spread and cause severe damage to power infrastructure. To reduce the risk, public safety power shutoffs are often used to restore power balance and prevent widespread blackouts. However, the unpredictability of wildfires makes it challenging to implement effective counter-measures in… ▽ More Wildfires pose a significant threat to the safe and reliable operation of electric power systems. They can quickly spread and cause severe damage to power infrastructure. To reduce the risk, public safety power shutoffs are often used to restore power balance and prevent widespread blackouts. However, the unpredictability of wildfires makes it challenging to implement effective counter-measures in a timely manner. This paper proposes an optimization-based topology control problem as a solution to mitigate the impact of wildfires. The goal is to find the optimal network topology that minimizes total operating costs and prevents load shedding during power shutoffs under uncertain line shutoff scenarios caused by uncertain spreading wildfires. The solution involves solving two-stage stochastic mixed-integer linear programs, with preventive and corrective control actions taken when the risk of a wildfire and corresponding outage line scenarios are known with low and high confidence, respectively. The Progressive Hedging algorithm is used to solve both problems. The effectiveness of the proposed approach is demonstrated using data from the RTS-GMLC system that is artificially geo-located in Southern California, including actual wildfire incidents and risk maps. Our work provides a crucial study of the comparative benefits due to accurate risk forecast and corresponding preventive control over real-time corrective control that may not be realistic. △ Less

Submitted 13 March, 2023; originally announced March 2023.

Comments: 10 pages, 6 figures

Ranking-Based Physics-Informed Line Failure Detection in Power Grids

Authors: Aleksandra Burashnikova, Wenting Li, Massih Amini, Deepjoyti Deka, Yury Maximov

Abstract: Climate change increases the number of extreme weather events (wind and snowstorms, heavy rains, wildfires) that compromise power system reliability and lead to multiple equipment failures. Real-time and accurate detecting of potential line failures is the first step to mitigating the extreme weather impact and activating emergency controls. Power balance equations nonlinearity, increased uncertai… ▽ More Climate change increases the number of extreme weather events (wind and snowstorms, heavy rains, wildfires) that compromise power system reliability and lead to multiple equipment failures. Real-time and accurate detecting of potential line failures is the first step to mitigating the extreme weather impact and activating emergency controls. Power balance equations nonlinearity, increased uncertainty in generation during extreme events, and lack of grid observability compromise the efficiency of traditional data-driven failure detection methods. At the same time, modern problem-oblivious machine learning methods based on neural networks require a large amount of data to detect an accident, especially in a time-changing environment. This paper proposes a Physics-InformEd Line failure Detector (FIELD) that leverages grid topology information to reduce sample and time complexities and improve localization accuracy. Finally, we illustrate the superior empirical performance of our approach compared to state-of-the-art methods over various test cases. △ Less

Submitted 31 August, 2022; originally announced September 2022.

Data-Driven Chance Constrained AC-OPF using Hybrid Sparse Gaussian Processes

Authors: Mile Mitrovic, Aleksandr Lukashevich, Petr Vorobev, Vladimir Terzija, Yury Maximov, Deepjyoti Deka

Abstract: The alternating current (AC) chance-constrained optimal power flow (CC-OPF) problem addresses the economic efficiency of electricity generation and delivery under generation uncertainty. The latter is intrinsic to modern power grids because of the high amount of renewables. Despite its academic success, the AC CC-OPF problem is highly nonlinear and computationally demanding, which limits its pract… ▽ More The alternating current (AC) chance-constrained optimal power flow (CC-OPF) problem addresses the economic efficiency of electricity generation and delivery under generation uncertainty. The latter is intrinsic to modern power grids because of the high amount of renewables. Despite its academic success, the AC CC-OPF problem is highly nonlinear and computationally demanding, which limits its practical impact. For improving the AC-OPF problem complexity/accuracy trade-off, the paper proposes a fast data-driven setup that uses the sparse and hybrid Gaussian processes (GP) framework to model the power flow equations with input uncertainty. We advocate the efficiency of the proposed approach by a numerical study over multiple IEEE test cases showing up to two times faster and more accurate solutions compared to the state-of-the-art methods. △ Less

Submitted 30 August, 2022; originally announced August 2022.

Comments: 7 pages, 3 figures

Data-Driven Stochastic AC-OPF using Gaussian Processes

Authors: Mile Mitrovic, Aleksandr Lukashevich, Petr Vorobev, Vladimir Terzija, Semen Budenny, Yury Maximov, Deepjyoti Deka

Abstract: In recent years, electricity generation has been responsible for more than a quarter of the greenhouse gas emissions in the US. Integrating a significant amount of renewables into a power grid is probably the most accessible way to reduce carbon emissions from power grids and slow down climate change. Unfortunately, the most accessible renewable power sources, such as wind and solar, are highly fl… ▽ More In recent years, electricity generation has been responsible for more than a quarter of the greenhouse gas emissions in the US. Integrating a significant amount of renewables into a power grid is probably the most accessible way to reduce carbon emissions from power grids and slow down climate change. Unfortunately, the most accessible renewable power sources, such as wind and solar, are highly fluctuating and thus bring a lot of uncertainty to power grid operations and challenge existing optimization and control policies. The chance-constrained alternating current (AC) optimal power flow (OPF) framework finds the minimum cost generation dispatch maintaining the power grid operations within security limits with a prescribed probability. Unfortunately, the AC-OPF problem's chance-constrained extension is non-convex, computationally challenging, and requires knowledge of system parameters and additional assumptions on the behavior of renewable distribution. Known linear and convex approximations to the above problems, though tractable, are too conservative for operational practice and do not consider uncertainty in system parameters. This paper presents an alternative data-driven approach based on Gaussian process (GP) regression to close this gap. The GP approach learns a simple yet non-convex data-driven approximation to the AC power flow equations that can incorporate uncertainty inputs. The latter is then used to determine the solution of CC-OPF efficiently, by accounting for both input and parameter uncertainty. The practical efficiency of the proposed approach using different approximations for GP-uncertainty propagation is illustrated over numerous IEEE test cases. △ Less

Submitted 21 July, 2022; originally announced July 2022.

Comments: 29 pages, 5 figures

Can locational disparity of prosumer energy optimization due to inverter rules be limited?

Authors: Md Umar Hashmi, Deepjyoti Deka, Ana Bušić, Dirk Van Hertem

Abstract: To mitigate issues related to the growth of variable smart loads and distributed generation, distribution system operators (DSO) now make it binding for prosumers with inverters to operate under pre-set rules. In particular, the maximum active and reactive power set points for prosumers are based on local voltage measurements to ensure that inverter output does not cause voltage violations. Howeve… ▽ More To mitigate issues related to the growth of variable smart loads and distributed generation, distribution system operators (DSO) now make it binding for prosumers with inverters to operate under pre-set rules. In particular, the maximum active and reactive power set points for prosumers are based on local voltage measurements to ensure that inverter output does not cause voltage violations. However, such actions, as observed in this work, restrict the range available for local energy management, with more adverse losses on arbitrage profits for prosumers located farther away from the substation. The goal of the paper is three-fold: (a) to develop an optimal local energy optimization algorithm for activation of load flexibility and inverter-interfaced solar PV and energy storage under time-varying electricity prices; (b) to quantify the locational impact on prosumer arbitrage gains due to inverter injection rules prevalent in different energy markets; (c) to propose a computationally efficient hybrid inverter control policy which provides voltage regulation while substantially reducing locational disparity. Using numerical simulations on three identical prosumers located at different parts of a radial feeder, we show that our control policy is able to minimize locational disparity in arbitrage gains between customers at the beginning and end of the feeder to 1.4%, while PV curtailment is reduced by 91.7% compared to the base case with restrictive volt-Var and volt-watt policy. △ Less

Submitted 18 November, 2022; v1 submitted 20 July, 2022; originally announced July 2022.

Learning Distribution Grid Topologies: A Tutorial

Authors: Deepjyoti Deka, Vassilis Kekatos, Guido Cavraro

Abstract: Unveiling feeder topologies from data is of paramount importance to advance situational awareness and proper utilization of smart resources in power distribution grids. This tutorial summarizes, contrasts, and establishes useful links between recent works on topology identification and detection schemes that have been proposed for power distribution grids. The primary focus is to highlight methods… ▽ More Unveiling feeder topologies from data is of paramount importance to advance situational awareness and proper utilization of smart resources in power distribution grids. This tutorial summarizes, contrasts, and establishes useful links between recent works on topology identification and detection schemes that have been proposed for power distribution grids. The primary focus is to highlight methods that overcome the limited availability of measurement devices in distribution grids, while enhancing topology estimates using conservation laws of power-flow physics and structural properties of feeders. Grid data from phasor measurement units or smart meters can be collected either passively in the traditional way, or actively, upon actuating grid resources and measuring the feeder's voltage response. Analytical claims on feeder identifiability and detectability are reviewed under disparate meter placement scenarios. Such topology learning claims can be attained exactly or approximately so via algorithmic solutions with various levels of computational complexity, ranging from least-squares fits to convex optimization problems, and from polynomial-time searches over graphs to mixed-integer programs. Although the emphasis is on radial single-phase feeders, extensions to meshed and/or multiphase circuits are sometimes possible and discussed. This tutorial aspires to provide researchers and engineers with knowledge of the current state-of-the-art in tractable distribution grid learning and insights into future directions of work. △ Less

Submitted 27 April, 2023; v1 submitted 22 June, 2022; originally announced June 2022.

Comments: 15 pages, 6 figures

Markovian Decentralized Ensemble Control for Demand Response

Authors: Guanze Peng, Robert Mieth, Deepjyoti Deka, Yury Dvorkin

Abstract: With the advancement in smart grid and smart energy devices, demand response becomes one of the most economic and feasible solutions to ease the load stress of the power grids during peak hours. In this work, we propose a fully decentralized ensemble control framework with consensus for demand response (DR) events and compatible control methods based on random policies. We show that under the cons… ▽ More With the advancement in smart grid and smart energy devices, demand response becomes one of the most economic and feasible solutions to ease the load stress of the power grids during peak hours. In this work, we propose a fully decentralized ensemble control framework with consensus for demand response (DR) events and compatible control methods based on random policies. We show that under the consensus that is tailored to DR, our proposed decentralized control method yields the same optimality as the centralized control method in both myopic and multistage settings. △ Less

Submitted 4 June, 2022; originally announced June 2022.

Detecting Anomalies using Overlap** Electrical Measurements in Smart Power Grids

Authors: Sina Sontowski, Nigel Lawrence, Deepjyoti Deka, Maanak Gupta

Abstract: As cyber-attacks against critical infrastructure become more frequent, it is increasingly important to be able to rapidly identify and respond to these threats. This work investigates two independent systems with overlap** electrical measurements with the goal to more rapidly identify anomalies. The independent systems include HIST, a SCADA historian, and ION, an automatic meter reading system (… ▽ More As cyber-attacks against critical infrastructure become more frequent, it is increasingly important to be able to rapidly identify and respond to these threats. This work investigates two independent systems with overlap** electrical measurements with the goal to more rapidly identify anomalies. The independent systems include HIST, a SCADA historian, and ION, an automatic meter reading system (AMR). While prior research has explored the benefits of fusing measurements, the possibility of overlap** measurements from an existing electrical system has not been investigated. To that end, we explore the potential benefits of combining overlap** measurements both to improve the speed/accuracy of anomaly detection and to provide additional validation of the collected measurements. In this paper, we show that merging overlap** measurements provide a more holistic picture of the observed systems. By applying Dynamic Time War** more anomalies were found -- specifically, an average of 349 times more anomalies, when considering anomalies from both overlap** measurements. When merging the overlap** measurements, a percent change of anomalies of up to 785\% can be achieved compared to a non-merge of the data as reflected by experimental results. △ Less

Submitted 6 January, 2022; originally announced January 2022.

PPGN: Physics-Preserved Graph Networks for Real-Time Fault Location in Distribution Systems with Limited Observation and Labels

Authors: Wenting Li, Deepjyoti Deka

Abstract: Electrical faults may trigger blackouts or wildfires without timely monitoring and control strategy. Traditional solutions for locating faults in distribution systems are not real-time when network observability is low, while novel black-box machine learning methods are vulnerable to stochastic environments. We propose a novel Physics-Preserved Graph Network (PPGN) architecture to accurately locat… ▽ More Electrical faults may trigger blackouts or wildfires without timely monitoring and control strategy. Traditional solutions for locating faults in distribution systems are not real-time when network observability is low, while novel black-box machine learning methods are vulnerable to stochastic environments. We propose a novel Physics-Preserved Graph Network (PPGN) architecture to accurately locate faults at the node level with limited observability and labeled training data. PPGN has a unique two-stage graph neural network architecture. The first stage learns the graph embedding to represent the entire network using a few measured nodes. The second stage finds relations between the labeled and unlabeled data samples to further improve the location accuracy. We explain the benefits of the two-stage graph configuration through a random walk equivalence. We numerically validate the proposed method in the IEEE 123-node and 37-node test feeders, demonstrating the superior performance over three baseline classifiers when labeled training data is limited, and loads and topology are allowed to vary. △ Less

Submitted 12 November, 2022; v1 submitted 5 July, 2021; originally announced July 2021.

Comments: 10 pages, 4 figure

Journal ref: Proceedings of the 56th Hawaii International Conference on System Sciences, 2023, 2776-2786

Privacy-Aware Load Ensemble Control: A Linearly-Solvable MDP Approach

Authors: Ali Hassan, Deepjyoti Deka, Yury Dvorkin

Abstract: Demand response (DR) programs engage distributed demand-side resources, e.g., controllable residential and commercial loads, in providing ancillary services for electric power systems. Ensembles of these resources can help reducing system load peaks and meeting operational limits by adjusting their electric power consumption. To equip utilities or load aggregators with adequate decision-support to… ▽ More Demand response (DR) programs engage distributed demand-side resources, e.g., controllable residential and commercial loads, in providing ancillary services for electric power systems. Ensembles of these resources can help reducing system load peaks and meeting operational limits by adjusting their electric power consumption. To equip utilities or load aggregators with adequate decision-support tools for ensemble dispatch, we develop a Markov Decision Process (MDP) approach to optimally control load ensembles in a privacy-preserving manner. To this end, the concept of differential privacy is internalized into the MDP routine to protect transition probabilities and, thus, privacy of DR participants. The proposed approach also provides a trade-off between solution optimality and privacy guarantees, and is analyzed using real-world data from DR events in the New York University microgrid in New York, NY. △ Less

Submitted 30 July, 2021; v1 submitted 19 March, 2021; originally announced March 2021.

Topology Learning in Radial Dynamical Systems with Unreliable Data

Authors: Venkat Ram Subramanian, Deepjyoti Deka, Saurav Talukdar, Andy Lamperski, Murti Salapaka

Abstract: Many complex engineering systems admit bidirectional and linear couplings between their agents. Blind and passive methods to identify such influence pathways/couplings from data are central to many applications. However, dynamically related data-streams originating at different sources are prone to corruption caused by asynchronous time-stamps of different streams, packet drops and noise. Such imp… ▽ More Many complex engineering systems admit bidirectional and linear couplings between their agents. Blind and passive methods to identify such influence pathways/couplings from data are central to many applications. However, dynamically related data-streams originating at different sources are prone to corruption caused by asynchronous time-stamps of different streams, packet drops and noise. Such imperfect information may be present in the entire observation period, and hence not detected by change-detection algorithms that require an initial clean observation period. Prior work has shown that spurious links are inferred in the graph structure due to the corrupted data-streams, which prevents consistent learning. In this article, we provide a novel approach to detect the location of corrupt agents as well as present an algorithm to learn the structure of radial dynamical systems despite corrupted data streams. In particular, we show that our approach provably learns the true radial structure if the unknown corrupted nodes are at least three hops away from each other. Our theoretical results are further validated in test dynamical network. △ Less

Submitted 28 September, 2020; originally announced September 2020.

Comments: Under review in IEEE TCNS

Physics-Informed Learning for High Impedance Faults Detection

Authors: Wenting Li, Deepjyoti Deka

Abstract: High impedance faults (HIFs) in distribution grids may cause wildfires and threaten human lives. Conventional protection relays at substations fail to detect more than 10\% HIFs since over-currents are low and the signatures of HIFs are local. With more $μ$PMU being installed in the distribution system, high-resolution $μ$PMU datasets provide the opportunity of detecting HIFs from multiple points.… ▽ More High impedance faults (HIFs) in distribution grids may cause wildfires and threaten human lives. Conventional protection relays at substations fail to detect more than 10\% HIFs since over-currents are low and the signatures of HIFs are local. With more $μ$PMU being installed in the distribution system, high-resolution $μ$PMU datasets provide the opportunity of detecting HIFs from multiple points. Still, the main obstacle in applying the $μ$PMU datasets is the lack of labels. To address this issue, we construct a physics-informed convolutional auto-encoder (PICAE) to detect HIFs without labeled HIFs for training. The significance of our PICAE is a physical regularization, derived from the elliptical trajectory of voltages-current characteristics, to distinguish HIFs from other abnormal events even in highly noisy situations. We formulate a system-wide detection framework that merges multiple nodes' local detection results to improve the detection accuracy and reliability. The proposed approaches are validated in the IEEE 34-node test feeder simulated through PSCAD/EMTDC. Our PICAE outperforms the existing works in various scenarios and is robust to different observability and noise. △ Less

Submitted 15 March, 2021; v1 submitted 5 August, 2020; originally announced August 2020.

Comments: 7 pages, 6 figures

Guaranteed Phase & Topology Identification in Three Phase Distribution Grids

Authors: Mohini Bariya, Deepjyoti Deka, Alexandra von Meier

Abstract: We present a method for joint phase identification and topology recovery in unbalanced three phase radial networks using only voltage measurements. By recovering phases and topology jointly, we utilize all three phase voltage measurements and can handle networks where some buses have a subset of three phases. Our method is theoretically justified by a novel linearized formulation of unbalanced thr… ▽ More We present a method for joint phase identification and topology recovery in unbalanced three phase radial networks using only voltage measurements. By recovering phases and topology jointly, we utilize all three phase voltage measurements and can handle networks where some buses have a subset of three phases. Our method is theoretically justified by a novel linearized formulation of unbalanced three phase power flow and makes precisely defined and reasonable assumptions on line impedances and load statistics. We validate our method on three IEEE test networks simulated under realistic conditions in OpenDSS, comparing our performance to the state of the art. In addition to providing a new method for phase and topology recovery, our intuitively structured linearized model will provide a foundation for future work in this and other applications. △ Less

Submitted 19 February, 2021; v1 submitted 3 August, 2020; originally announced August 2020.

Comments: 8 pages, 6 figures

A Hierarchical Approach to Multi-Energy Demand Response: From Electricity to Multi-Energy Applications

Authors: Ali Hassan, Samrat Acharya, Michael Chertkov, Deepjyoti Deka, Yury Dvorkin

Abstract: Due to proliferation of energy efficiency measures and availability of the renewable energy resources, traditional energy infrastructure systems (electricity, heat, gas) can no longer be operated in a centralized manner under the assumption that consumer behavior is inflexible, i.e. cannot be adjusted in return for an adequate incentive. To allow for a less centralized operating paradigm, consumer… ▽ More Due to proliferation of energy efficiency measures and availability of the renewable energy resources, traditional energy infrastructure systems (electricity, heat, gas) can no longer be operated in a centralized manner under the assumption that consumer behavior is inflexible, i.e. cannot be adjusted in return for an adequate incentive. To allow for a less centralized operating paradigm, consumer-end perspective and abilities should be integrated in current dispatch practices and accounted for in switching between different energy sources not only at the system but also at the individual consumer level. Since consumers are confined within different built environments, this paper looks into an opportunity to control energy consumption of an aggregation of many residential, commercial and industrial consumers, into an ensemble. This ensemble control becomes a modern demand response contributor to the set of modeling tools for multi-energy infrastructure systems. △ Less

Submitted 5 May, 2020; originally announced May 2020.

Tractable learning in under-excited power grids

Authors: Deepjyoti Deka, Harish Doddi, Sidhant Misra, Murti Salapaka

Abstract: Estimating the structure of physical flow networks such as power grids is critical to secure delivery of energy. This paper discusses statistical structure estimation in power grids in the "under-excited" regime, where a subset of internal nodes do not have external injection. Prior estimation algorithms based on nodal potentials or voltages fail in the under-excited regime. We propose a novel top… ▽ More Estimating the structure of physical flow networks such as power grids is critical to secure delivery of energy. This paper discusses statistical structure estimation in power grids in the "under-excited" regime, where a subset of internal nodes do not have external injection. Prior estimation algorithms based on nodal potentials or voltages fail in the under-excited regime. We propose a novel topology learning algorithm for learning underexcited general (non-radial) networks based on physics-informed conservation laws. We prove the asymptotic correctness of our algorithm for grids with non-adjacent under-excited internal nodes. More importantly, we theoretically analyze our algorithm's efficacy under noisy measurements, and determine bounds on maximum noise under which asymptotically correct recovery is guaranteed. Our approach is validated through simulations with non-linear voltage samples generated on test grids with real injection data △ Less

Submitted 4 May, 2020; originally announced May 2020.

Comments: 10 pages, 8 figures

Data-Driven Learning and Load Ensemble Control

Authors: Ali Hassan, Deepjyoti Deka, Michael Chertkov, Yury Dvorkin

Abstract: Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant of the traditional MDP, is used to model aggregated TCLs. Then, a model-free reinforcement learning technique called Z-learning is applied to learn the value fu… ▽ More Demand response (DR) programs aim to engage distributed small-scale flexible loads, such as thermostatically controllable loads (TCLs), to provide various grid support services. Linearly Solvable Markov Decision Process (LS-MDP), a variant of the traditional MDP, is used to model aggregated TCLs. Then, a model-free reinforcement learning technique called Z-learning is applied to learn the value function and derive the optimal policy for the DR aggregator to control TCLs. The learning process is robust against uncertainty that arises from estimating the passive dynamics of the aggregated TCLs. The efficiency of this data-driven learning is demonstrated through simulations on Heating, Cooling & Ventilation (HVAC) units in a testbed neighborhood of residential houses. △ Less

Submitted 20 April, 2020; originally announced April 2020.

Energy Storage Optimization for Grid Reliability

Authors: Md Umar Hashmi, Deepjyoti Deka, Lucas Pereira, Ana Busic

Abstract: Large scale renewable energy integration is being planned for multiple power grids around the world. To achieve secure and stable grid operations, additional resources/reserves are needed to mitigate the inherent intermittency of renewable energy sources (RES). In this paper, we present formulations to understand the effect of fast storage reserves in improving grid reliability under different cos… ▽ More Large scale renewable energy integration is being planned for multiple power grids around the world. To achieve secure and stable grid operations, additional resources/reserves are needed to mitigate the inherent intermittency of renewable energy sources (RES). In this paper, we present formulations to understand the effect of fast storage reserves in improving grid reliability under different cost functions. Our formulations and solution schemes not only aim to minimize imbalance but also maintain state-of-charge (SoC) of storage. In particular, we show that accounting for system response due to inertia and local governor response enables a more realistic quantification of storage requirements for dam** net load fluctuations. The storage requirement is significantly lower than values determined when such traditional response are not accounted for. We demonstrate the performance of our designed policies through studies using real data from the Elia TSO in Belgium and BPA agency in the USA. The numerical results enable us to benchmark the marginal effect on reliability due to increasing storage size under different system responses and associated cost functions. △ Less

Submitted 19 April, 2020; originally announced April 2020.

Stochastic and Distributionally Robust Load Ensemble Control

Authors: Ali Hassan, Robert Mieth, Deepjyoti Deka, Yury Dvorkin

Abstract: Demand response (DR) programs aim to engage distributed demand-side resources in providing ancillary services for electric power systems. Previously, aggregated thermostatically controlled loads (TCLs) have been demonstrated as a technically viable and economically valuable provider of such services that can effectively compete with conventional generation resources in reducing load peaks and smoo… ▽ More Demand response (DR) programs aim to engage distributed demand-side resources in providing ancillary services for electric power systems. Previously, aggregated thermostatically controlled loads (TCLs) have been demonstrated as a technically viable and economically valuable provider of such services that can effectively compete with conventional generation resources in reducing load peaks and smoothing demand fluctuations. Yet, to provide these services at scale, a large number of TCLs must be accurately aggregated and operated in sync. This paper describes a Markov Decision Process (MDP) that aggregates and models an ensemble of TCLs. Using the MDP framework, we propose to internalize the exogenous uncertain dynamics of TCLs by means of stochastic and distributionally robust optimization. First, under mild assumptions on the underlying uncertainty, we derive analytical stochastic and distributionally robust control policies for dispatching a given TCL ensemble. Second, we further relax these mild assumptions to allow for a more delicate treatment of uncertainty, which leads to distributionally robust MDP formulations with moment- and Wasserstein-based ambiguity sets that can be efficiently solved numerically. The case study compares the analytical and numerical control policies using a simulated ensemble of 1,000 air conditioners. △ Less

Submitted 27 March, 2020; v1 submitted 12 December, 2019; originally announced December 2019.

Real-time Anomaly Detection and Classification in Streaming PMU Data

Authors: Christopher Hannon, Deepjyoti Deka, Dong **, Marc Vuffray, Andrey Y. Lokhov

Abstract: Ensuring secure and reliable operations of the power grid is a primary concern of system operators. Phasor measurement units (PMUs) are rapidly being deployed in the grid to provide fast-sampled operational data that should enable quicker decision-making. This work presents a general interpretable framework for analyzing real-time PMU data, and thus enabling grid operators to understand the curren… ▽ More Ensuring secure and reliable operations of the power grid is a primary concern of system operators. Phasor measurement units (PMUs) are rapidly being deployed in the grid to provide fast-sampled operational data that should enable quicker decision-making. This work presents a general interpretable framework for analyzing real-time PMU data, and thus enabling grid operators to understand the current state and to identify anomalies on the fly. Applying statistical learning tools on the streaming data, we first learn an effective dynamical model to describe the current behavior of the system. Next, we use the probabilistic predictions of our learned model to define in a principled way an efficient anomaly detection tool. Finally, the last module of our framework produces on-the-fly classification of the detected anomalies into common occurrence classes using features that grid operators are familiar with. We demonstrate the efficacy of our interpretable approach through extensive numerical experiments on real PMU data collected from a transmission operator in the USA. △ Less

Submitted 14 November, 2019; originally announced November 2019.

Comments: 9 pages, 12 figures

Stochastic AC Optimal Power Flow: A Data-Driven Approach

Authors: Ilyes Mezghani, Sidhant Misra, Deepjyoti Deka

Abstract: There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow ({AC-}OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. This paper presents a highly scalable data-driven algorithm for stochastic AC-OPF that has extremely low sample requirement. The novelty behind the algorithm's performance involves an iterati… ▽ More There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow ({AC-}OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. This paper presents a highly scalable data-driven algorithm for stochastic AC-OPF that has extremely low sample requirement. The novelty behind the algorithm's performance involves an iterative scenario design approach that merges information regarding constraint violations in the system with data-driven sparse regression. Compared to conventional methods with random scenario sampling, our approach is able to provide feasible operating points for realistic systems with much lower sample requirements. Furthermore, multiple sub-tasks in our approach can be easily paralleled and based on historical data to enhance its performance and application. We demonstrate the computational improvements of our approach through simulations on different test cases in the IEEE PES PGLib-OPF benchmark library. △ Less

Submitted 8 June, 2020; v1 submitted 21 October, 2019; originally announced October 2019.

Comments: a version of this paper will appear in the proceedings of the 21st Power Systems Computation Conference (PSCC 2020)

An Adversarial Model for Attack Vector Vulnerability Analysis on Power and Gas Delivery Operations

Authors: Ignacio Losada Carreno, Anna Scaglione, Anatoly Zlotnik, Deepjyoti Deka, Kaarthik Sundar

Abstract: Power systems often rely on natural gas pipeline networks to supply fuel for gas-fired generation. Market inefficiencies and a lack of formal coordination between the wholesale power and gas delivery infrastructures may magnify the broader impact of a cyber-attack on a natural gas pipeline. In this study we present a model that can be used to quantify the impact of cyber-attacks on electricity and… ▽ More Power systems often rely on natural gas pipeline networks to supply fuel for gas-fired generation. Market inefficiencies and a lack of formal coordination between the wholesale power and gas delivery infrastructures may magnify the broader impact of a cyber-attack on a natural gas pipeline. In this study we present a model that can be used to quantify the impact of cyber-attacks on electricity and gas delivery operations. We model activation of cyber-attack vectors that attempt to gain access to pipeline gas compressor controls using a continuous-time Markov chain over a state space based on the gas operator Industrial Control System firewall zone partition. Our approach evaluates the operating states and decision-making in the networks using physically realistic and operationally representative models. We summarize these models, the sequence of analyses used to quantify the impacts of a cyber-incident, and propose a Monte Carlo simulation approach to quantify the resulting effect on the reliability of the bulk power system by the increase in operational cost. The methodology is applied to a case study of interacting power, gas, and cyber test networks. △ Less

Submitted 8 October, 2019; originally announced October 2019.

Graphical Models in Meshed Distribution Grids: Topology estimation, change detection and limitations

Authors: Deepjyoti Deka, Saurav Talukdar, Michael Chertkov, Murti Salapaka

Abstract: Graphical models are a succinct way to represent the structure in probability distributions. This article analyzes the graphical model of nodal voltages in non-radial power distribution grids. Using algebraic and structural properties of graphical models, algorithms exactly determining topology and detecting line changes for distribution grids are presented along with their theoretical limitations… ▽ More Graphical models are a succinct way to represent the structure in probability distributions. This article analyzes the graphical model of nodal voltages in non-radial power distribution grids. Using algebraic and structural properties of graphical models, algorithms exactly determining topology and detecting line changes for distribution grids are presented along with their theoretical limitations. We show that if distribution grids have cycles/loops of size greater than three, then nodal voltages are sufficient for efficient topology estimation without additional assumptions on system parameters. In contrast, line failure or change detection using nodal voltages does not require any structural assumption. Under noisy measurements, we provide the first non-trivial bounds on the maximum noise that the system can tolerate for asymptotically correct topology recovery. The performance of the designed algorithms is validated with nonlinear AC power flow samples generated by Matpower on test grids, including scenarios with injection correlations and system noise. △ Less

Submitted 26 February, 2020; v1 submitted 16 May, 2019; originally announced May 2019.

Comments: 12 pages, 9 figures, IEEE Transactions on Smart Grid

Exact Topology Learning in a Network of Cyclostationary Processes

Authors: Harish Doddi, Saurav Talukdar, Deepjyoti Deka, Murti Salapaka

Abstract: Learning the structure of a network from time series data, in particular cyclostationary data, is of significant interest in many disciplines such as power grids, biology and finance. In this article, an algorithm is presented for reconstruction of the topology of a network of cyclostationary processes. To the best of our knowledge, this is the first work to guarantee exact recovery without any as… ▽ More Learning the structure of a network from time series data, in particular cyclostationary data, is of significant interest in many disciplines such as power grids, biology and finance. In this article, an algorithm is presented for reconstruction of the topology of a network of cyclostationary processes. To the best of our knowledge, this is the first work to guarantee exact recovery without any assumptions on the underlying structure. The method is based on a lifting technique by which cyclostationary processes are mapped to vector wide sense stationary processes and further on semi-definite properties of matrix Wiener filters for the said processes.We demonstrate the performance of the proposed algorithm on a Resistor-Capacitor network and present the accuracy of reconstruction for varying sample sizes. △ Less

Submitted 19 September, 2019; v1 submitted 21 March, 2019; originally announced March 2019.

Comments: 6 pages, 3 figures, A version of this paper will appear in American Control Conference 2019

Arbitrage with Power Factor Correction using Energy Storage

Authors: Md Umar Hashmi, Deepjyoti Deka, Ana Busic, Lucas Pereira, Scott Backhaus

Abstract: The importance of reactive power compensation for power factor (PF) correction will significantly increase with the large-scale integration of distributed generation interfaced via inverters producing only active power. In this work, we focus on co-optimizing energy storage for performing energy arbitrage as well as local power factor correction. The joint optimization problem is non-convex, but c… ▽ More The importance of reactive power compensation for power factor (PF) correction will significantly increase with the large-scale integration of distributed generation interfaced via inverters producing only active power. In this work, we focus on co-optimizing energy storage for performing energy arbitrage as well as local power factor correction. The joint optimization problem is non-convex, but can be solved efficiently using a McCormick relaxation along with penalty-based schemes. Using numerical simulations on real data and realistic storage profiles, we show that energy storage can correct PF locally without reducing arbitrage profit. It is observed that active and reactive power control is largely decoupled in nature for performing arbitrage and PF correction (PFC). Furthermore, we consider a real-time implementation of the problem with uncertain load, renewable and pricing profiles. We develop a model predictive control based storage control policy using auto-regressive forecast for the uncertainty. We observe that PFC is primarily governed by the size of the converter and therefore, look-ahead in time in the online setting does not affect PFC noticeably. However, arbitrage profit are more sensitive to uncertainty for batteries with faster ramp rates compared to slow ram** batteries. △ Less

Submitted 11 January, 2020; v1 submitted 14 March, 2019; originally announced March 2019.

Comments: 10 pages, 8 figures

Learning for DC-OPF: Classifying active sets using neural nets

Authors: Deepjyoti Deka, Sidhant Misra

Abstract: The optimal power flow is an optimization problem used in power systems operational planning to maximize economic efficiency while satisfying demand and maintaining safety margins. Due to uncertainty and variability in renewable energy generation and demand, the optimal solution needs to be updated in response to observed uncertainty realizations or near real-time forecast updates. To address the… ▽ More The optimal power flow is an optimization problem used in power systems operational planning to maximize economic efficiency while satisfying demand and maintaining safety margins. Due to uncertainty and variability in renewable energy generation and demand, the optimal solution needs to be updated in response to observed uncertainty realizations or near real-time forecast updates. To address the challenge of computing such frequent real-time updates to the optimal solution, recent literature has proposed the use of machine learning to learn the map** between the uncertainty realization and the optimal solution. Further, learning the active set of constraints at optimality, as opposed to directly learning the optimal solution, has been shown to significantly simplify the machine learning task, and the learnt model can be used to predict optimal solutions in real-time. In this paper, we propose the use of classification algorithms to learn the map** between the uncertainty realization and the active set of constraints at optimality, thus further enhancing the computational efficiency of the real-time prediction. We employ neural net classifiers for this task and demonstrate the excellent performance of this approach on a number of systems in the IEEE PES PGLib-OPF benchmark library. △ Less

Submitted 14 February, 2019; originally announced February 2019.

Data-driven identification of a thermal network in multi-zone building

Authors: Harish Doddi, Saurav Talukdar, Deepjyoti Deka, Murti Salapaka

Abstract: System identification of smart buildings is necessary for their optimal control and application in demand response. The thermal response of a building around an operating point can be modeled using a network of interconnected resistors with capacitors at each node/zone called RC network. The development of the RC network involves two phases: obtaining the network topology, and estimating thermal r… ▽ More System identification of smart buildings is necessary for their optimal control and application in demand response. The thermal response of a building around an operating point can be modeled using a network of interconnected resistors with capacitors at each node/zone called RC network. The development of the RC network involves two phases: obtaining the network topology, and estimating thermal resistances and capacitance's. In this article, we present a provable method to reconstruct the interaction topology of thermal zones of a building solely from temperature measurements. We demonstrate that our learning algorithm accurately reconstructs the interaction topology for a $5$ zone office building in EnergyPlus with real-world conditions. We show that our learning algorithm is able to recover the network structure in scenarios where prior research prove insufficient. △ Less

Submitted 17 October, 2018; originally announced October 2018.

Comments: 6 pages, 12 figures, 57th IEEE Conference on Decision and Control

Real-time Faulted Line Localization and PMU Placement in Power Systems through Convolutional Neural Networks

Authors: Wenting Li, Deepjyoti Deka, Michael Chertkov, Meng Wang

Abstract: Diverse fault types, fast re-closures, and complicated transient states after a fault event make real-time fault location in power grids challenging. Existing localization techniques in this area rely on simplistic assumptions, such as static loads, or require much higher sampling rates or total measurement availability. This paper proposes a faulted line localization method based on a Convolution… ▽ More Diverse fault types, fast re-closures, and complicated transient states after a fault event make real-time fault location in power grids challenging. Existing localization techniques in this area rely on simplistic assumptions, such as static loads, or require much higher sampling rates or total measurement availability. This paper proposes a faulted line localization method based on a Convolutional Neural Network (CNN) classifier using bus voltages. Unlike prior data-driven methods, the proposed classifier is based on features with physical interpretations that improve the robustness of the location performance. The accuracy of our CNN based localization tool is demonstrably superior to other machine learning classifiers in the literature. To further improve the location performance, a joint phasor measurement units (PMU) placement strategy is proposed and validated against other methods. A significant aspect of our methodology is that under very low observability (7% of buses), the algorithm is still able to localize the faulted line to a small neighborhood with high probability. The performance of our scheme is validated through simulations of faults of various types in the IEEE 39-bus and 68-bus power systems under varying uncertain conditions, system observability, and measurement quality. △ Less

Submitted 16 May, 2019; v1 submitted 11 October, 2018; originally announced October 2018.

Comments: 11 pages, 8 figures

Physics Informed Topology Learning in Networks of Linear Dynamical Systems

Authors: Saurav Talukdar, Deepjyoti Deka, Harish Doddi, Donatello Materassi, Misha Chertkov, Murti V. Salapaka

Abstract: Learning influence pathways of a network of dynamically related processes from observations is of considerable importance in many disciplines. In this article, influence networks of agents which interact dynamically via linear dependencies are considered. An algorithm for the reconstruction of the topology of interaction based on multivariate Wiener filtering is analyzed. It is shown that for a va… ▽ More Learning influence pathways of a network of dynamically related processes from observations is of considerable importance in many disciplines. In this article, influence networks of agents which interact dynamically via linear dependencies are considered. An algorithm for the reconstruction of the topology of interaction based on multivariate Wiener filtering is analyzed. It is shown that for a vast and important class of interactions, that respect flow conservation, the topology of the interactions can be exactly recovered. The class of problems where reconstruction is guaranteed to be exact includes power distribution networks, dynamic thermal networks and consensus networks. The efficacy of the approach is illustrated through simulation and experiments on consensus networks, IEEE power distribution networks and thermal dynamics of buildings. △ Less

Submitted 27 September, 2018; originally announced September 2018.

Comments: 14 pages, 10 figures

Is Machine Learning in Power Systems Vulnerable?

Authors: Yize Chen, Yushi Tan, Deepjyoti Deka

Abstract: Recent advances in Machine Learning(ML) have led to its broad adoption in a series of power system applications, ranging from meter data analytics, renewable/load/price forecasting to grid security assessment. Although these data-driven methods yield state-of-the-art performances in many tasks, the robustness and security of applying such algorithms in modern power grids have not been discussed. I… ▽ More Recent advances in Machine Learning(ML) have led to its broad adoption in a series of power system applications, ranging from meter data analytics, renewable/load/price forecasting to grid security assessment. Although these data-driven methods yield state-of-the-art performances in many tasks, the robustness and security of applying such algorithms in modern power grids have not been discussed. In this paper, we attempt to address the issues regarding the security of ML applications in power systems. We first show that most of the current ML algorithms proposed in power systems are vulnerable to adversarial examples, which are maliciously crafted input data. We then adopt and extend a simple yet efficient algorithm for finding subtle perturbations, which could be used for generating adversaries for both categorical(e.g., user load profile classification) and sequential applications(e.g., renewables generation forecasting). Case studies on classification of power quality disturbances and forecast of building loads demonstrate the vulnerabilities of current ML algorithms in power networks under our adversarial designs. These vulnerabilities call for design of robust and secure ML algorithms for real world applications. △ Less

Submitted 27 August, 2018; v1 submitted 24 August, 2018; originally announced August 2018.

Comments: Accepted to IEEE SmartGridComm2018

Optimal Load Ensemble Control in Chance-Constrained Optimal Power Flow

Authors: Ali Hassan, Robert Mieth, Michael Chertkov, Deepjyoti Deka, Yury Dvorkin

Abstract: Distribution system operators (DSO) world-wide foresee a rapid roll-out of distributed energy resources. From the system perspective, their reliable and cost effective integration requires accounting for their physical properties in operating tools used by the DSO. This paper describes an approach to leverage the dispatch flexibility of thermostatically controlled loads (TCLs) for operating distri… ▽ More Distribution system operators (DSO) world-wide foresee a rapid roll-out of distributed energy resources. From the system perspective, their reliable and cost effective integration requires accounting for their physical properties in operating tools used by the DSO. This paper describes an approach to leverage the dispatch flexibility of thermostatically controlled loads (TCLs) for operating distribution systems with a high penetration level of photovoltaic resources. Each TCL ensemble is modeled using the Markov Decision Process (MDP). The MDP model is then integrated with the chance-constrained optimal power flow that accounts for the uncertainty of PV resources. Since the integrated optimization model cannot be solved efficiently by existing dynamic programming methods or off-the-shelf solvers, this paper proposes an iterative Spatio-Temporal Dual Decomposition algorithm (ST-D2). We demonstrate the usefulness of the proposed integrated optimization and ST-D2 algorithm on the IEEE 33-bus test system. △ Less

Submitted 30 October, 2018; v1 submitted 23 May, 2018; originally announced May 2018.

Comments: 8 pages, 9 figures, 29 references

Joint Estimation of Topology and Injection Statistics in Distribution Grids with Missing Nodes

Authors: Deepjyoti Deka, Michael Chertkov, Scott Backhaus

Abstract: Optimal operation of distribution grid resources relies on accurate estimation of its state and topology. Practical estimation of such quantities is complicated by the limited presence of real-time meters. This paper discusses a theoretical framework to jointly estimate the operational topology and statistics of injections in radial distribution grids under limited availability of nodal voltage me… ▽ More Optimal operation of distribution grid resources relies on accurate estimation of its state and topology. Practical estimation of such quantities is complicated by the limited presence of real-time meters. This paper discusses a theoretical framework to jointly estimate the operational topology and statistics of injections in radial distribution grids under limited availability of nodal voltage measurements. In particular we show that our proposed algorithms are able to provably learn the exact grid topology and injection statistics at all unobserved nodes as long as they are not adjacent. The algorithm design is based on novel ordered trends in voltage magnitude fluctuations at node groups, that are independently of interest for radial physical flow networks. The complexity of the designed algorithms is theoretically analyzed and their performance validated using both linearized and non-linear AC power flow samples in test distribution grids. △ Less

Submitted 2 January, 2020; v1 submitted 12 April, 2018; originally announced April 2018.

Comments: 12 pages, 13 figures

Topology Estimation using Graphical Models in Multi-Phase Power Distribution Grids

Authors: Deepjyoti Deka, Michael Chertkov, Scott Backhaus

Abstract: Distribution grid is the medium and low voltage part of a large power system. Structurally, the majority of distribution networks operate radially, such that energized lines form a collection of trees, i.e. forest, with a substation being at the root of any tree. The operational topology/forest may change from time to time, however tracking these changes, even though important for the distribution… ▽ More Distribution grid is the medium and low voltage part of a large power system. Structurally, the majority of distribution networks operate radially, such that energized lines form a collection of trees, i.e. forest, with a substation being at the root of any tree. The operational topology/forest may change from time to time, however tracking these changes, even though important for the distribution grid operation and control, is hindered by limited real-time monitoring. This paper develops a learning framework to reconstruct radial operational structure of the distribution grid from synchronized voltage measurements in the grid subject to the exogenous fluctuations in nodal power consumption. To detect operational lines our learning algorithm uses conditional independence tests for continuous random variables that is applicable to a wide class of probability distributions of the nodal consumption and Gaussian injections in particular. Moreover, our algorithm applies to the practical case of unbalanced three-phase power flow. Algorithm performance is validated on AC power flow simulations over IEEE distribution grid test cases. △ Less

Submitted 11 July, 2018; v1 submitted 17 March, 2018; originally announced March 2018.

Comments: 12 pages 9 figures

Learning with End-Users in Distribution Grids: Topology and Parameter Estimation

Authors: Sejun Park, Deepjyoti Deka, Scott Backhaus, Michael Chertkov

Abstract: Efficient operation of distribution grids in the smart-grid era is hindered by the limited presence of real-time nodal and line meters. In particular, this prevents the easy estimation of grid topology and associated line parameters that are necessary for control and optimization efforts in the grid. This paper studies the problems of topology and parameter estimation in radial balanced distributi… ▽ More Efficient operation of distribution grids in the smart-grid era is hindered by the limited presence of real-time nodal and line meters. In particular, this prevents the easy estimation of grid topology and associated line parameters that are necessary for control and optimization efforts in the grid. This paper studies the problems of topology and parameter estimation in radial balanced distribution grids where measurements are restricted to only the leaf nodes and all intermediate nodes are unobserved/hidden. To this end, we propose two exact learning algorithms that use balanced voltage and injection measured only at the end-users. The first algorithm requires time-stamped voltage samples, statistics of nodal power injections and permissible line impedances to recover the true topology. The second and improved algorithm requires only time-stamped voltage and complex power samples to recover both the true topology and impedances without any additional input (e.g., number of grid nodes, statistics of injections at hidden nodes, permissible line impedances). We prove the correctness of both learning algorithms for grids where unobserved buses/nodes have a degree greater than three and discuss extensions to regimes where that assumption doesn't hold. Further, we present computational and, more importantly, the sample complexity of our proposed algorithm for joint topology and impedance estimation. We illustrate the performance of the designed algorithms through numerical experiments on the IEEE and custom power distribution models. △ Less

Submitted 1 March, 2020; v1 submitted 11 March, 2018; originally announced March 2018.

Topology Learning of Radial Dynamical Systems with Latent Nodes

Authors: Saurav Talukdar, Deepjyoti Deka, Michael Chertkov, Murti Salapaka

Abstract: In this article, we present a method to reconstruct the topology of a partially observed radial network of linear dynamical systems with bi-directional interactions. Our approach exploits the structure of the inverse power spectral density matrix and recovers edges involving nodes up to four hops away in the underlying topology. We then present an algorithm with provable guarantees, which eliminat… ▽ More In this article, we present a method to reconstruct the topology of a partially observed radial network of linear dynamical systems with bi-directional interactions. Our approach exploits the structure of the inverse power spectral density matrix and recovers edges involving nodes up to four hops away in the underlying topology. We then present an algorithm with provable guarantees, which eliminates the spurious links obtained and also identifies the location of the unobserved nodes in the inferred topology. The algorithm recovers the exact topology of the network by using only time-series of the states at the observed nodes. The effectiveness of the method developed is demonstrated by applying it on a typical distribution system of the electric grid. △ Less

Submitted 12 July, 2018; v1 submitted 7 March, 2018; originally announced March 2018.

Comments: 6 pages

Exact Topology and Parameter Estimation in Distribution Grids with Minimal Observability

Authors: Sejun Park, Deepjyoti Deka, Michael Chertkov

Abstract: Limited presence of nodal and line meters in distribution grids hinders their optimal operation and participation in real-time markets. In particular lack of real-time information on the grid topology and infrequently calibrated line parameters (impedances) adversely affect the accuracy of any operational power flow control. This paper suggests a novel algorithm for learning the topology of distri… ▽ More Limited presence of nodal and line meters in distribution grids hinders their optimal operation and participation in real-time markets. In particular lack of real-time information on the grid topology and infrequently calibrated line parameters (impedances) adversely affect the accuracy of any operational power flow control. This paper suggests a novel algorithm for learning the topology of distribution grid and estimating impedances of the operational lines with minimal observational requirements - it provably reconstructs topology and impedances using voltage and injection measured only at the terminal (end-user) nodes of the distribution grid. All other (intermediate) nodes in the network may be unobserved/hidden. Furthermore no additional input (e.g., number of grid nodes, historical information on injections at hidden nodes) is needed for the learning to succeed. Performance of the algorithm is illustrated in numerical experiments on the IEEE and custom power distribution models. △ Less

Submitted 11 March, 2018; v1 submitted 29 October, 2017; originally announced October 2017.

Online Learning of Power Transmission Dynamics

Authors: Andrey Y. Lokhov, Marc Vuffray, Dmitry Shemetov, Deepjyoti Deka, Michael Chertkov

Abstract: We consider the problem of reconstructing the dynamic state matrix of transmission power grids from time-stamped PMU measurements in the regime of ambient fluctuations. Using a maximum likelihood based approach, we construct a family of convex estimators that adapt to the structure of the problem depending on the available prior information. The proposed method is fully data-driven and does not as… ▽ More We consider the problem of reconstructing the dynamic state matrix of transmission power grids from time-stamped PMU measurements in the regime of ambient fluctuations. Using a maximum likelihood based approach, we construct a family of convex estimators that adapt to the structure of the problem depending on the available prior information. The proposed method is fully data-driven and does not assume any knowledge of system parameters. It can be implemented in near real-time and requires a small amount of data. Our learning algorithms can be used for model validation and calibration, and can also be applied to related problems of system stability, detection of forced oscillations, generation re-dispatch, as well as to the estimation of the system state. △ Less

Submitted 27 October, 2017; originally announced October 2017.

Comments: 7 pages, 4 figures

Optimal Ensemble Control of Loads in Distribution Grids with Network Constraints

Authors: Michael Chertkov, Deepjyoti Deka, Yury Dvorkin

Abstract: Flexible loads, e.g. thermostatically controlled loads (TCLs), are technically feasible to participate in demand response (DR) programs. On the other hand, there is a number of challenges that need to be resolved before it can be implemented in practice en masse. First, individual TCLs must be aggregated and operated in sync to scale DR benefits. Second, the uncertainty of TCLs needs to be account… ▽ More Flexible loads, e.g. thermostatically controlled loads (TCLs), are technically feasible to participate in demand response (DR) programs. On the other hand, there is a number of challenges that need to be resolved before it can be implemented in practice en masse. First, individual TCLs must be aggregated and operated in sync to scale DR benefits. Second, the uncertainty of TCLs needs to be accounted for. Third, exercising the flexibility of TCLs needs to be coordinated with distribution system operations to avoid unnecessary power losses and compliance with power flow and voltage limits. This paper addresses these challenges. We propose a network-constrained, open-loop, stochastic optimal control formulation. The first part of this formulation represents ensembles of collocated TCLs modelled by an aggregated Markov Process (MP), where each MP state is associated with a given power consumption or production level. The second part extends MPs to a multi-period distribution power flow optimization. In this optimization, the control of TCL ensembles is regulated by transition probability matrices and physically enabled by local active and reactive power controls at TCL locations. The optimization is solved with a Spatio-Temporal Dual Decomposition (ST-D2) algorithm. The performance of the proposed formulation and algorithm is demonstrated on the IEEE 33-bus distribution model. △ Less

Submitted 13 March, 2018; v1 submitted 26 October, 2017; originally announced October 2017.

Comments: 7 pages, 6 figures, accepted PSCC 2018

Report number: LA-UR-17-29831

Chance-Constrained ADMM Approach for Decentralized Control of Distributed Energy Resources

Authors: Ali Hassan, Yury Dvorkin, Deepjyoti Deka, Michael Chertkov

Abstract: Distribution systems are undergoing a dramatic transition from a passive circuit that routinely disseminates electric power among downstream nodes to the system with distributed energy resources. The distributed energy resources come in a variety of technologies and typically include photovoltaic (PV) arrays, thermostatically controlled loads, energy storage units. Often these resources are interf… ▽ More Distribution systems are undergoing a dramatic transition from a passive circuit that routinely disseminates electric power among downstream nodes to the system with distributed energy resources. The distributed energy resources come in a variety of technologies and typically include photovoltaic (PV) arrays, thermostatically controlled loads, energy storage units. Often these resources are interfaced with the system via inverters that can adjust active and reactive power injections, thus supporting the operational performance of the system. This paper designs a control policy for such inverters using the local power flow measurements. The control actuates active and reactive power injections of the inverter-based distributed energy resources. This strategy is then incorporated into a chance-constrained, decentralized optimal power flow formulation to maintain voltage levels and power flows within their limits and to mitigate the volatility of (PV) resources. △ Less

Submitted 9 March, 2018; v1 submitted 26 October, 2017; originally announced October 2017.

Learning the Exact Topology of Undirected Consensus Networks

Authors: Saurav Talukdar, Deepjyoti Deka, Sandeep Attree, Donatello Materassi, Murti V. Salapaka

Abstract: In this article, we present a method to learn the interaction topology of a network of agents undergoing linear consensus updates in a non invasive manner. Our approach is based on multivariate Wiener filtering, which is known to recover spurious edges apart from the true edges in the topology. The main contribution of this work is to show that in the case of undirected consensus networks, all spu… ▽ More In this article, we present a method to learn the interaction topology of a network of agents undergoing linear consensus updates in a non invasive manner. Our approach is based on multivariate Wiener filtering, which is known to recover spurious edges apart from the true edges in the topology. The main contribution of this work is to show that in the case of undirected consensus networks, all spurious links obtained using Wiener filtering can be identified using frequency response of the Wiener filters. Thus, the exact interaction topology of the agents is unveiled. The method presented requires time series measurements of the state of the agents and does not require any knowledge of link weights. To the best of our knowledge this is the first approach that provably reconstructs the structure of undirected consensus networks with correlated noise. We illustrate the effectiveness of the method developed through numerical simulations as well as experiments on a five node network of Raspberry Pis. △ Less

Submitted 29 September, 2017; originally announced October 2017.

Comments: 6 pages

Structure- & Physics- Preserving Reductions of Power Grid Models

Authors: Colin Grudzien, Deepjyoti Deka, Michael Chertkov, Scott N Backhaus

Abstract: The large size of multiscale, distribution and transmission, power grids hinder fast system-wide estimation and real-time control and optimization of operations. This paper studies graph reduction methods of power grids that are favorable for fast simulations and follow-up applications. While the classical Kron reduction has been successful in reduced order modeling of power grids with traditional… ▽ More The large size of multiscale, distribution and transmission, power grids hinder fast system-wide estimation and real-time control and optimization of operations. This paper studies graph reduction methods of power grids that are favorable for fast simulations and follow-up applications. While the classical Kron reduction has been successful in reduced order modeling of power grids with traditional, hierarchical design, the selection of reference nodes for the reduced model in a multiscale, distribution and transmission, network becomes ambiguous. In this work we extend the use of the iterative Kron reduction by utilizing the electric grid's graph topology for the selection of reference nodes, consistent with the design features of multiscale networks. Additionally, we propose further reductions by aggregation of coherent subnetworks of triangular meshes, based on the graph topology and network characteristics, in order to preserve currents and build another power-flow equivalent network. Our reductions are achieved through the use of iterative aggregation of sub-graphs that include general tree structures, lines, and triangles. Important features of our reduction algorithms include that: (i) the reductions are, either, equivalent to the Kron reduction, or otherwise produce a power-flow equivalent network; (ii) due to the former mentioned power-flow equivalence, the reduced network can model the dynamic of the swing equations for a lossless, inductive, steady state network; (iii) the algorithms efficiently utilize hash-tables to store the sequential reduction steps. △ Less

Submitted 4 October, 2018; v1 submitted 10 July, 2017; originally announced July 2017.

Topology Estimation in Bulk Power Grids: Guarantees on Exact Recovery

Authors: Deepjyoti Deka, Saurav Talukdar, Michael Chertkov, Murti Salapaka

Abstract: The topology of a power grid affects its dynamic operation and settlement in the electricity market. Real-time topology identification can enable faster control action following an emergency scenario like failure of a line. This article discusses a graphical model framework for topology estimation in bulk power grids (both loopy transmission and radial distribution) using measurements of voltage c… ▽ More The topology of a power grid affects its dynamic operation and settlement in the electricity market. Real-time topology identification can enable faster control action following an emergency scenario like failure of a line. This article discusses a graphical model framework for topology estimation in bulk power grids (both loopy transmission and radial distribution) using measurements of voltage collected from the grid nodes. The graphical model for the probability distribution of nodal voltages in linear power flow models is shown to include additional edges along with the operational edges in the true grid. Our proposed estimation algorithms first learn the graphical model and subsequently extract the operational edges using either thresholding or a neighborhood counting scheme. For grid topologies containing no three-node cycles (two buses do not share a common neighbor), we prove that an exact extraction of the operational topology is theoretically guaranteed. This includes a majority of distribution grids that have radial topologies. For grids that include cycles of length three, we provide sufficient conditions that ensure existence of algorithms for exact reconstruction. In particular, for grids with constant impedance per unit length and uniform injection covariances, this observation leads to conditions on geographical placement of the buses. The performance of algorithms is demonstrated in test case simulations. △ Less

Submitted 15 July, 2017; v1 submitted 5 July, 2017; originally announced July 2017.

Comments: 10 pages, 8 figures. A version of this paper will appear in IREP 2017

Exact Topology Reconstruction of Radial Dynamical Systems with Applications to Distribution System of the Power Grid

Authors: Saurav Talukdar, Deepjyoti Deka, Donatello Materassi, Murti V. Salapaka

Abstract: In this article we present a method to reconstruct the interconnectedness of dynamically related stochastic processes, where the interactions are bi-directional and the underlying topology is a tree. Our approach is based on multivariate Wiener filtering which recovers spurious edges apart from the true edges in the topology reconstruction. The main contribution of this work is to show that all sp… ▽ More In this article we present a method to reconstruct the interconnectedness of dynamically related stochastic processes, where the interactions are bi-directional and the underlying topology is a tree. Our approach is based on multivariate Wiener filtering which recovers spurious edges apart from the true edges in the topology reconstruction. The main contribution of this work is to show that all spurious links obtained using Wiener filtering can be eliminated if the underlying topology is a tree based on which we present a three stage network reconstruction procedure for trees. We illustrate the effectiveness of the method developed by applying it on a typical distribution system of the electric grid. △ Less

Submitted 2 March, 2017; originally announced March 2017.

Comments: 6 pages

Optimal Topology Design for Disturbance Minimization in Power Grids

Authors: Deepjyoti Deka, Harsha Nagarajan, Scott Backhaus

Abstract: The transient response of power grids to external disturbances influences their stable operation. This paper studies the effect of topology in linear time-invariant dynamics of different power grids. For a variety of objective functions, a unified framework based on $H_2$ norm is presented to analyze the robustness to ambient fluctuations. Such objectives include loss reduction, weighted consensus… ▽ More The transient response of power grids to external disturbances influences their stable operation. This paper studies the effect of topology in linear time-invariant dynamics of different power grids. For a variety of objective functions, a unified framework based on $H_2$ norm is presented to analyze the robustness to ambient fluctuations. Such objectives include loss reduction, weighted consensus of phase angle deviations, oscillations in nodal frequency, and other graphical metrics. The framework is then used to study the problem of optimal topology design for robust control goals of different grids. For radial grids, the problem is shown as equivalent to the hard "optimum communication spanning tree" problem in graph theory and a combinatorial topology construction is presented with bounded approximation gap. Extended to loopy (meshed) grids, a greedy topology design algorithm is discussed. The performance of the topology design algorithms under multiple control objectives are presented on both loopy and radial test grids. Overall, this paper analyzes topology design algorithms on a broad class of control problems in power grid by exploring their combinatorial and graphical properties. △ Less

Submitted 1 March, 2017; originally announced March 2017.

Comments: 6 pages, 3 figures, a version of this work will appear in ACC 2017

Ensemble Control of Cycling Energy Loads: Markov Decision Approach

Authors: Michael Chertkov, Vladimir Y. Chernyak, Deepjyoti Deka

Abstract: A Markov decision process (MDP) framework is adopted to represent ensemble control of devices with cyclic energy consumption patterns, e.g., thermostatically controlled loads. Specifically we utilize and develop the class of MDP models previously coined linearly solvable MDPs, that describe optimal dynamics of the probability distribution of an ensemble of many cycling devices. Two principally dif… ▽ More A Markov decision process (MDP) framework is adopted to represent ensemble control of devices with cyclic energy consumption patterns, e.g., thermostatically controlled loads. Specifically we utilize and develop the class of MDP models previously coined linearly solvable MDPs, that describe optimal dynamics of the probability distribution of an ensemble of many cycling devices. Two principally different settings are discussed. First, we consider optimal strategy of the ensemble aggregator balancing between minimization of the cost of operations and minimization of the ensemble welfare penalty, where the latter is represented as a KL-divergence between actual and normal probability distributions of the ensemble. Then, second, we shift to the demand response setting modeling the aggregator's task to minimize the welfare penalty under the condition that the aggregated consumption matches the targeted time-varying consumption requested by the system operator. We discuss a modification of both settings aimed at encouraging or constraining the transitions between different states. The dynamic programming feature of the resulting modified MDPs is always preserved; however, `linear solvability' is lost fully or partially, depending on the type of modification. We also conducted some (limited in scope) numerical experimentation using the formulations of the first setting. We conclude by discussing future generalizations and applications. △ Less

Submitted 23 October, 2017; v1 submitted 17 January, 2017; originally announced January 2017.

Comments: 21 pages, 3 figures; to appear in Springer, Series: Institute of Mathematics and Applications, Title of book: Energy Markets and Responsive Grids: Modeling, Control and Optimization, editors: S. Meyn, T. Samad, S. Glavaski, I. Hiskens, J. Stoustrup

Report number: LA-UR-17-20284

Tractable Structure Learning in Radial Physical Flow Networks

Authors: Deepjyoti Deka, Scott Backhaus, Michael Chertkov

Abstract: Physical Flow Networks are different infrastructure networks that allow the flow of physical commodities through edges between its constituent nodes. These include power grid, natural gas transmission network, water pipelines etc. In such networks, the flow on each edge is characterized by a function of the nodal potentials on either side of the edge. Further the net flow in and out of each node i… ▽ More Physical Flow Networks are different infrastructure networks that allow the flow of physical commodities through edges between its constituent nodes. These include power grid, natural gas transmission network, water pipelines etc. In such networks, the flow on each edge is characterized by a function of the nodal potentials on either side of the edge. Further the net flow in and out of each node is conserved. Learning the structure and state of physical networks is necessary for optimal control as well as to quantify its privacy needs. We consider radial flow networks and study the problem of learning the operational network from a loopy graph of candidate edges using statistics of nodal potentials. Based on the monotonic properties of the flow functions, the key result in this paper shows that if variance of the difference of nodal potentials is used to weight candidate edges, the operational edges form the minimum spanning tree in the loopy graph. Under realistic conditions on the statistics of nodal injection (consumption or production), we provide a greedy structure learning algorithm with quasilinear computational complexity in the number of candidate edges in the network. Our learning framework is very general due to two significant attributes. First it is independent of the specific marginal distributions of nodal potentials and only uses order properties in their second moments. Second, the learning algorithm is agnostic to exact flow functions that relate edge flows to corresponding potential differences and is applicable for a broad class of networks with monotonic flow functions. We demonstrate the efficacy of our work through realistic simulations on diverse physical flow networks and discuss possible extensions of our work to other regimes. △ Less

Submitted 17 August, 2016; originally announced August 2016.

Comments: A version of this paper will appear in IEEE CDC 2016 (8 pages, 5 figures)