-
Stability for Nash Equilibrium Problems
Authors:
Ruoyu Diao,
Yu-Hong Dai,
Liwei Zhang
Abstract:
This paper is devoted to studying the stability properties of the Karush-Kuhn-Tucker (KKT) solution map** $S_{\rm KKT}$ for Nash equilibrium problems (NEPs) with canonical perturbations. Firstly, we obtain an exact characterization of the strong regularity of $S_{\rm KKT}$ and a sufficient condition that is easy to verify. Secondly, we propose equivalent conditions for the continuously different…
▽ More
This paper is devoted to studying the stability properties of the Karush-Kuhn-Tucker (KKT) solution map** $S_{\rm KKT}$ for Nash equilibrium problems (NEPs) with canonical perturbations. Firstly, we obtain an exact characterization of the strong regularity of $S_{\rm KKT}$ and a sufficient condition that is easy to verify. Secondly, we propose equivalent conditions for the continuously differentiable single-valued localization of $S_{\rm KKT}$. Thirdly, the isolated calmness of $S_{\rm KKT}$ is studied based on two conditions: Property A and Property B, and Property B proves to be sufficient for the robustness of both $E(p)$ and $S_{\rm KKT}$ under the convex assumptions, where $E(p)$ denotes the Nash equilibria at perturbation $p$. Furthermore, we establish that studying the stability properties of the NEP with canonical perturbations is equivalent to studying those of the NEP with only tilt perturbations based on the prior discussions. Finally, we provide detailed characterizations of stability for NEPs whose each individual player solves a quadratic programming (QP) problem.
△ Less
Submitted 18 May, 2024;
originally announced May 2024.
-
On Training Effective Reinforcement Learning Agents for Real-time Power Grid Operation and Control
Authors:
Ruisheng Diao,
Di Shi,
Bei Zhang,
Siqi Wang,
Haifeng Li,
Chunlei Xu,
Tu Lan,
Desong Bian,
Jiajun Duan
Abstract:
Deriving fast and effectively coordinated control actions remains a grand challenge affecting the secure and economic operation of today's large-scale power grid. This paper presents a novel artificial intelligence (AI) based methodology to achieve multi-objective real-time power grid control for real-world implementation. State-of-the-art off-policy reinforcement learning (RL) algorithm, soft act…
▽ More
Deriving fast and effectively coordinated control actions remains a grand challenge affecting the secure and economic operation of today's large-scale power grid. This paper presents a novel artificial intelligence (AI) based methodology to achieve multi-objective real-time power grid control for real-world implementation. State-of-the-art off-policy reinforcement learning (RL) algorithm, soft actor-critic (SAC) is adopted to train AI agents with multi-thread offline training and periodic online training for regulating voltages and transmission losses without violating thermal constraints of lines. A software prototype was developed and deployed in the control center of SGCC Jiangsu Electric Power Company that interacts with their Energy Management System (EMS) every 5 minutes. Massive numerical studies using actual power grid snapshots in the real-time environment verify the effectiveness of the proposed approach. Well-trained SAC agents can learn to provide effective and subsecond control actions in regulating voltage profiles and reducing transmission losses.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
Evaluating Load Models and Their Impacts on Power Transfer Limits
Authors:
Xinan Wang,
Yishen Wang,
Di Shi,
Jianhui Wang,
Siqi Wang,
Ruisheng Diao,
Zhiwei Wang
Abstract:
Power transfer limits or transfer capability (TC) directly relate to the system operation and control as well as electricity markets. As a consequence, their assessment has to comply with static constraints, such as line thermal limits, and dynamic constraints, such as transient stability limits, voltage stability limits and small-signal stability limits. Since the load dynamics have substantial i…
▽ More
Power transfer limits or transfer capability (TC) directly relate to the system operation and control as well as electricity markets. As a consequence, their assessment has to comply with static constraints, such as line thermal limits, and dynamic constraints, such as transient stability limits, voltage stability limits and small-signal stability limits. Since the load dynamics have substantial impacts on power system transient stability, load models are one critical factor that affects the power transfer limits. Currently, multiple load models have been proposed and adopted in the industry and academia, including the ZIP model, ZIP plus induction motor composite model (ZIP + IM) and WECC composite load model (WECC CLM). Each of them has its unique advantages, but their impacts on the power transfer limits are not yet adequately addressed. One existing challenge is fitting the high-order nonlinear models such as WECC CLM. In this study, we innovatively adopt double deep Q-learning Network (DDQN) agent as a general load modeling tool in the dynamic assessment procedure and fit the same transient field measurements into different load models. A comprehensive evaluation is then conducted to quantify the load models' impacts on the power transfer limits. The simulation environment is the IEEE-39 bus system constructed in Transient Security Assessment Tool (TSAT).
△ Less
Submitted 7 August, 2020;
originally announced August 2020.
-
A Deep Reinforcement Learning Based Approach for Optimal Active Power Dispatch
Authors:
Jiajun Duan,
Haifeng Li,
Xiaohu Zhang,
Ruisheng Diao,
Bei Zhang,
Di Shi,
Xiao Lu,
Zhiwei Wang,
Siqi Wang
Abstract:
The stochastic and dynamic nature of renewable energy sources and power electronic devices are creating unique challenges for modern power systems. One such challenge is that the conventional mathematical systems models-based optimal active power dispatch (OAPD) method is limited in its ability to handle uncertainties caused by renewables and other system contingencies. In this paper, a deep reinf…
▽ More
The stochastic and dynamic nature of renewable energy sources and power electronic devices are creating unique challenges for modern power systems. One such challenge is that the conventional mathematical systems models-based optimal active power dispatch (OAPD) method is limited in its ability to handle uncertainties caused by renewables and other system contingencies. In this paper, a deep reinforcement learning-based (DRL) method is presented to provide a near-optimal solution to the OAPD problem without system modeling. The DRL agent undergoes offline training, based on which, it is able to obtain the OAPD points under unseen scenarios, e.g., different load patterns. The DRL-based OAPD method is tested on the IEEE 14-bus system, thereby validating its feasibility to solve the OAPD problem. Its utility is further confirmed in that it can be leveraged as a key component for solving future model-free AC-OPF problems.
△ Less
Submitted 30 August, 2019;
originally announced August 2019.
-
The Power Grid Library for Benchmarking AC Optimal Power Flow Algorithms
Authors:
Sogol Babaeinejadsarookolaee,
Adam Birchfield,
Richard D. Christie,
Carleton Coffrin,
Christopher DeMarco,
Ruisheng Diao,
Michael Ferris,
Stephane Fliscounakis,
Scott Greene,
Renke Huang,
Cedric Josz,
Roman Korab,
Bernard Lesieutre,
Jean Maeght,
Terrence W. K. Mak,
Daniel K. Molzahn,
Thomas J. Overbye,
Patrick Panciatici,
Byungkwon Park,
Jonathan Snodgrass,
Ahmad Tbaileh,
Pascal Van Hentenryck,
Ray Zimmerman
Abstract:
In recent years, the power systems research community has seen an explosion of novel methods for formulating the AC power flow equations. Consequently, benchmarking studies using the seminal AC Optimal Power Flow (AC-OPF) problem have emerged as the primary method for evaluating these emerging methods. However, it is often difficult to directly compare these studies due to subtle differences in th…
▽ More
In recent years, the power systems research community has seen an explosion of novel methods for formulating the AC power flow equations. Consequently, benchmarking studies using the seminal AC Optimal Power Flow (AC-OPF) problem have emerged as the primary method for evaluating these emerging methods. However, it is often difficult to directly compare these studies due to subtle differences in the AC-OPF problem formulation as well as the network, generation, and loading data that are used for evaluation. To help address these challenges, this IEEE PES Task Force report proposes a standardized AC-OPF mathematical formulation and the PGLib-OPF networks for benchmarking AC-OPF algorithms. A motivating study demonstrates some limitations of the established network datasets in the context of benchmarking AC-OPF algorithms and a validation study demonstrates the efficacy of using the PGLib-OPF networks for this purpose. In the interest of scientific discourse and future additions, the PGLib-OPF benchmark library is open-access and all the of network data is provided under a creative commons license.
△ Less
Submitted 4 January, 2021; v1 submitted 7 August, 2019;
originally announced August 2019.
-
Adaptive Robust Energy Management Strategy for Campus-Based Commercial Buildings Considering Comprehensive Comfort Levels
Authors:
Zheming Liang,
Desong Bian,
Dawei Su,
Ruisheng Diao,
Di Shi,
Zhiwei Wang,
Wencong Su
Abstract:
Neglecting consumers' comfort always leads to failure or slow-response to demand response request. In this paper, we propose several comprehensive comfort level models for various appliances in campus-based commercial buildings (CBs). The objective of the proposed system is to minimize O\&M costs of campus-based CBs and maximize various comfort levels simultaneously under the worst-case scenarios.…
▽ More
Neglecting consumers' comfort always leads to failure or slow-response to demand response request. In this paper, we propose several comprehensive comfort level models for various appliances in campus-based commercial buildings (CBs). The objective of the proposed system is to minimize O\&M costs of campus-based CBs and maximize various comfort levels simultaneously under the worst-case scenarios. Adaptive robust optimization (ARO) is leveraged to handle various uncertainties within the proposed system: (i) demand response signals sending from the distribution system operator (DSO); (ii) arrival state-of-charge (SoC) conditions of plug-in electric vehicles (PEVs); (iii) power outputs of renewable energy sources (RESs); and (iv) load demand of other appliances. Benders decomposition, such as column-and-constraint generation (C\&CG) algorithm, is used to solve the reformulated NP-hard min-max problem. Extensive simulation results demonstrate the effectiveness of the proposed optimal energy management strategy for campus-based CBs in both minimizing O\&M costs and maximizing comprehensive comfort levels.
△ Less
Submitted 27 March, 2019; v1 submitted 26 February, 2019;
originally announced February 2019.
-
Mathematical representation of the WECC composite load model
Authors:
Zixiao Ma,
Zhaoyu Wang,
Yishen Wang,
Ruisheng Diao,
Di Shi
Abstract:
The Western Electricity Coordinating Council (WECC) composite load model is a newly developed load model that has drawn great interest from the industry. To analyze its dynamic characteristics with both mathematical and engineering rigor, a detailed mathematical model is needed. Although WECC composite load model is available in commercial software as a module and its detailed block diagrams can b…
▽ More
The Western Electricity Coordinating Council (WECC) composite load model is a newly developed load model that has drawn great interest from the industry. To analyze its dynamic characteristics with both mathematical and engineering rigor, a detailed mathematical model is needed. Although WECC composite load model is available in commercial software as a module and its detailed block diagrams can be found in several public reports, there is no complete mathematical representation of the full model in literature. This paper addresses a challenging problem of deriving detailed mathematical representation of WECC composite load model from its block diagrams. In particular, for the first time, we have derived the mathematical representation of the new DER_A model. The developed mathematical model is verified using both Matlab and PSS/E to show its effectiveness in representing WECC composite load model. The derived mathematical representation serves as an important foundation for parameter identification, order reduction and other dynamic analysis.
△ Less
Submitted 16 August, 2019; v1 submitted 23 February, 2019;
originally announced February 2019.
-
Optimal Energy Management for Commercial Buildings Considering Comprehensive Comfort Levels in a Retail Electricity Market
Authors:
Zheming Liang,
Desong Bian,
Xiaohu Zhang,
Di Shi,
Ruisheng Diao,
Zhiwei Wang
Abstract:
Demand response has been implemented by distribution system operators to reduce peak demand and mitigate contingency issues on distribution lines and substations. Specifically, the campus based commercial buildings make the major contributions to peak demand in a distribution system. Note that prior works neglect the consumers comfort level in performing demand response, which limits their applica…
▽ More
Demand response has been implemented by distribution system operators to reduce peak demand and mitigate contingency issues on distribution lines and substations. Specifically, the campus based commercial buildings make the major contributions to peak demand in a distribution system. Note that prior works neglect the consumers comfort level in performing demand response, which limits their applications as the incentives are not worth as compared to the loss in comfort levels for most time. Thus, a framework to comprehensively consider both operating costs and comfort levels is necessary. Moreover, distributed energy resources are widely deployed in commercial buildings such as roof top solar panels, plug in electric vehicles, and energy storage units, which bring various uncertainties to the distribution systems, i.e., output of renewable; electricity prices; arrival and departure of plug-in electric vehicles; business hour demand response signals and flexible energy demand. In this paper, we propose an optimal demand response framework to enable local control of demand-side appliances that are usually too small to participate in a retail electricity market. Several typical small demand side appliances, i.e., heating, ventilation, and air conditioning systems, electric water heaters and plug-in electric vehicles, are considered in our proposed model. Their operations are coordinated by a central controller, whose objective is to minimize the total cost and maximize the customers comfort levels for multiple commercial buildings. A scenario-based stochastic programming is leveraged to handle the aforementioned uncertainties. Numerical results based on the practical data demonstrate the effectiveness of the proposed framework. In addition, the trade off between the operation costs of commercial buildings and customers comfort levels is illustrated.
△ Less
Submitted 20 December, 2018;
originally announced December 2018.
-
A New Fully Polynomial Time Approximation Scheme for the Interval Subset Sum Problem
Authors:
Rui Diao,
Ya-Feng Liu,
Yu-Hong Dai
Abstract:
The interval subset sum problem (ISSP) is a generalization of the well-known subset sum problem. Given a set of intervals $\left\{[a_{i,1},a_{i,2}]\right\}_{i=1}^n$ and a target integer $T,$ the ISSP is to find a set of integers, at most one from each interval, such that their sum best approximates the target $T$ but cannot exceed it. In this paper, we first study the computational complexity of t…
▽ More
The interval subset sum problem (ISSP) is a generalization of the well-known subset sum problem. Given a set of intervals $\left\{[a_{i,1},a_{i,2}]\right\}_{i=1}^n$ and a target integer $T,$ the ISSP is to find a set of integers, at most one from each interval, such that their sum best approximates the target $T$ but cannot exceed it. In this paper, we first study the computational complexity of the ISSP. We show that the ISSP is relatively easy to solve compared to the 0-1 Knapsack problem (KP). We also identify several subclasses of the ISSP which are polynomial time solvable (with high probability), albeit the problem is generally NP-hard. Then, we propose a new fully polynomial time approximation scheme (FPTAS) for solving the general ISSP problem. The time and space complexities of the proposed scheme are ${\cal O}\left(n \max\left\{1 / ε,\log n\right\}\right)$ and ${\cal O}\left(n+1/ε\right),$ respectively, where $ε$ is the relative approximation error. To the best of our knowledge, the proposed scheme has almost the same time complexity but a significantly lower space complexity compared to the best known scheme. Both the correctness and efficiency of the proposed scheme are validated by numerical simulations. In particular, the proposed scheme successfully solves ISSP instances with $n=100,000$ and $ε=0.1\%$ within one second.
△ Less
Submitted 23 April, 2017;
originally announced April 2017.
-
An Efficient Inexact Newton-CG Algorithm for the Smallest Enclosing Ball Problem of Large Dimensions
Authors:
Ya-Feng Liu,
Rui Diao,
Feng Ye,
Hongwei Liu
Abstract:
In this paper, we consider the problem of computing the smallest enclosing ball (SEB) of a set of $m$ balls in $\mathbb{R}^n,$ where the product $mn$ is large. We first approximate the non-differentiable SEB problem by its log-exponential aggregation function and then propose a computationally efficient inexact Newton-CG algorithm for the smoothing approximation problem by exploiting its special (…
▽ More
In this paper, we consider the problem of computing the smallest enclosing ball (SEB) of a set of $m$ balls in $\mathbb{R}^n,$ where the product $mn$ is large. We first approximate the non-differentiable SEB problem by its log-exponential aggregation function and then propose a computationally efficient inexact Newton-CG algorithm for the smoothing approximation problem by exploiting its special (approximate) sparsity structure. The key difference between the proposed inexact Newton-CG algorithm and the classical Newton-CG algorithm is that the gradient and the Hessian-vector product are inexactly computed in the proposed algorithm, which makes it capable of solving the large-scale SEB problem. We give an adaptive criterion of inexactly computing the gradient/Hessian and establish global convergence of the proposed algorithm. We illustrate the efficiency of the proposed algorithm by using the classical Newton-CG algorithm as well as the algorithm from [Zhou. {et al.} in Comput. Opt. \& Appl. 30, 147--160 (2005)] as benchmarks.
△ Less
Submitted 22 September, 2015;
originally announced September 2015.
