-
A Pioneering Roadmap for ML-Driven Algorithmic Advancements in Electrical Networks
Authors:
Jochen L. Cremer,
Adrian Kelly,
Ricardo J. Bessa,
Milos Subasic,
Panagiotis N. Papadopoulos,
Samuel Young,
Amar Sagar,
Antoine Marot
Abstract:
To advance control, operation and planning tools of electrical networks with ML is not straightforward. 110 experts were surveyed showing where and how ML algorithmis could advance. This paper assesses this survey and research environment. Then it develops an innovation roadmap that helps align our research community towards a goal-oriented realisation of the opportunities that AI upholds. This pa…
▽ More
To advance control, operation and planning tools of electrical networks with ML is not straightforward. 110 experts were surveyed showing where and how ML algorithmis could advance. This paper assesses this survey and research environment. Then it develops an innovation roadmap that helps align our research community towards a goal-oriented realisation of the opportunities that AI upholds. This paper finds that the R\&D environment of system operators (and the surrounding research ecosystem) needs adaptation to enable faster developments with AI while maintaining high testing quality and safety. This roadmap may interest research centre managers in system operators, academics, and labs dedicated to advancing the next generation of tooling for electrical networks.
△ Less
Submitted 28 May, 2024; v1 submitted 27 May, 2024;
originally announced May 2024.
-
Extended superposition theorem under power grid topological changes
Authors:
Antoine Marot,
Benjamin Donnot,
Noureddine Henka,
Sami Tazi
Abstract:
Standard superposition theorem has been the basis in the last decades for many power system problems decomposition involving changes in nodal injections, from productions and loads. Its application scope has however been limited to fixed grid topology and breaks as soon as a topology change happens in the grid. For instance, it cannot be applied to compute N-2 power flows simply from N-1 security…
▽ More
Standard superposition theorem has been the basis in the last decades for many power system problems decomposition involving changes in nodal injections, from productions and loads. Its application scope has however been limited to fixed grid topology and breaks as soon as a topology change happens in the grid. For instance, it cannot be applied to compute N-2 power flows simply from N-1 security analysis. Topological changes also become a flexibility used more and more frequently for congestion management. Studying the effect of combinatorial topological changes is hence of interest, but so far very computation intensive. In this paper, we propose an extension of the superposition theorem to varying grid topologies. We demonstrate it under the DC approximation for all topological changes, namely line disconnection and reconnection, bus splitting and merging. We finally apply it to two use cases related to the above mentioned, effectively extending its scope of application.
△ Less
Submitted 30 September, 2023;
originally announced October 2023.
-
Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agents
Authors:
Malte Lehna,
Jan Viebahn,
Christoph Scholz,
Antoine Marot,
Sven Tomforde
Abstract:
The operation of electricity grids has become increasingly complex due to the current upheaval and the increase in renewable energy production. As a consequence, active grid management is reaching its limits with conventional approaches. In the context of the Learning to Run a Power Network challenge, it has been shown that Reinforcement Learning (RL) is an efficient and reliable approach with con…
▽ More
The operation of electricity grids has become increasingly complex due to the current upheaval and the increase in renewable energy production. As a consequence, active grid management is reaching its limits with conventional approaches. In the context of the Learning to Run a Power Network challenge, it has been shown that Reinforcement Learning (RL) is an efficient and reliable approach with considerable potential for automatic grid operation. In this article, we analyse the submitted agent from Binbinchen and provide novel strategies to improve the agent, both for the RL and the rule-based approach. The main improvement is a N-1 strategy, where we consider topology actions that keep the grid stable, even if one line is disconnected. More, we also propose a topology reversion to the original grid, which proved to be beneficial. The improvements are tested against reference approaches on the challenge test sets and are able to increase the performance of the rule-based agent by 27%. In direct comparison between rule-based and RL agent we find similar performance. However, the RL agent has a clear computational advantage. We also analyse the behaviour in an exemplary case in more detail to provide additional insights. Here, we observe that through the N-1 strategy, the actions of the agents become more diversified.
△ Less
Submitted 17 April, 2023; v1 submitted 3 April, 2023;
originally announced April 2023.
-
Learning to run a power network with trust
Authors:
Antoine Marot,
Benjamin Donnot,
Karim Chaouache,
Adrian Kelly,
Qiuhua Huang,
Ramij-Raja Hossain,
Jochen L. Cremer
Abstract:
Artificial agents are promising for real-time power network operations, particularly, to compute remedial actions for congestion management. However, due to high reliability requirements, purely autonomous agents will not be deployed any time soon and operators will be in charge of taking action for the foreseeable future. Aiming at designing assistant for operators, we instead consider humans in…
▽ More
Artificial agents are promising for real-time power network operations, particularly, to compute remedial actions for congestion management. However, due to high reliability requirements, purely autonomous agents will not be deployed any time soon and operators will be in charge of taking action for the foreseeable future. Aiming at designing assistant for operators, we instead consider humans in the loop and propose an original formulation. We first advance an agent with the ability to send to the operator alarms ahead of time when the proposed actions are of low confidence. We further model the operator's available attention as a budget that decreases when alarms are sent. We present the design and results of our competition "Learning to run a power network with trust" in which we evaluate our formulation and benchmark the ability of submitted agents to send relevant alarms while operating the network to their best.
△ Less
Submitted 16 April, 2022; v1 submitted 21 October, 2021;
originally announced October 2021.
-
Learning to run a Power Network Challenge: a Retrospective Analysis
Authors:
Antoine Marot,
Benjamin Donnot,
Gabriel Dulac-Arnold,
Adrian Kelly,
Aïdan O'Sullivan,
Jan Viebahn,
Mariette Awad,
Isabelle Guyon,
Patrick Panciatici,
Camilo Romero
Abstract:
Power networks, responsible for transporting electricity across large geographical regions, are complex infrastructures on which modern life critically depend. Variations in demand and production profiles, with increasing renewable energy integration, as well as the high voltage network technology, constitute a real challenge for human operators when optimizing electricity transportation while avo…
▽ More
Power networks, responsible for transporting electricity across large geographical regions, are complex infrastructures on which modern life critically depend. Variations in demand and production profiles, with increasing renewable energy integration, as well as the high voltage network technology, constitute a real challenge for human operators when optimizing electricity transportation while avoiding blackouts. Motivated to investigate the potential of AI methods in enabling adaptability in power network operation, we have designed a L2RPN challenge to encourage the development of reinforcement learning solutions to key problems present in the next-generation power networks. The NeurIPS 2020 competition was well received by the international community attracting over 300 participants worldwide.
The main contribution of this challenge is our proposed comprehensive 'Grid2Op' framework, and associated benchmark, which plays realistic sequential network operations scenarios. The Grid2Op framework, which is open-source and easily re-usable, allows users to define new environments with its companion GridAlive ecosystem. Grid2Op relies on existing non-linear physical power network simulators and let users create a series of perturbations and challenges that are representative of two important problems: a) the uncertainty resulting from the increased use of unpredictable renewable energy sources, and b) the robustness required with contingent line disconnections. In this paper, we give the competition highlights. We present the benchmark suite and analyse the winning solutions, including one super-human performance demonstration. We propose our organizational insights for a successful competition and conclude on open research avenues. Given the challenge success, we expect our work will foster research to create more sustainable solutions for power network operations.
△ Less
Submitted 21 October, 2021; v1 submitted 2 March, 2021;
originally announced March 2021.
-
Exploring grid topology reconfiguration using a simple deep reinforcement learning approach
Authors:
Medha Subramanian,
Jan Viebahn,
Simon H. Tindemans,
Benjamin Donnot,
Antoine Marot
Abstract:
System operators are faced with increasingly volatile operating conditions. In order to manage system reliability in a cost-effective manner, control room operators are turning to computerised decision support tools based on AI and machine learning. Specifically, Reinforcement Learning (RL) is a promising technique to train agents that suggest grid control actions to operators. In this paper, a si…
▽ More
System operators are faced with increasingly volatile operating conditions. In order to manage system reliability in a cost-effective manner, control room operators are turning to computerised decision support tools based on AI and machine learning. Specifically, Reinforcement Learning (RL) is a promising technique to train agents that suggest grid control actions to operators. In this paper, a simple baseline approach is presented using RL to represent an artificial control room operator that can operate a IEEE 14-bus test case for a duration of 1 week. This agent takes topological switching actions to control power flows on the grid, and is trained on only a single well-chosen scenario. The behaviour of this agent is tested on different time-series of generation and demand, demonstrating its ability to operate the grid successfully in 965 out of 1000 scenarios. The type and variability of topologies suggested by the agent are analysed across the test scenarios, demonstrating efficient and diverse agent behaviour.
△ Less
Submitted 17 April, 2021; v1 submitted 26 November, 2020;
originally announced November 2020.
-
Reinforcement Learning for Electricity Network Operation
Authors:
Adrian Kelly,
Aidan O'Sullivan,
Patrick de Mars,
Antoine Marot
Abstract:
This paper presents the background material required for the Learning to Run Power Networks Challenge. The challenge is focused on using Reinforcement Learning to train an agent to manage the real-time operations of a power grid, balancing power flows and making interventions to maintain stability. We present an introduction to power systems targeted at the machine learning community and an introd…
▽ More
This paper presents the background material required for the Learning to Run Power Networks Challenge. The challenge is focused on using Reinforcement Learning to train an agent to manage the real-time operations of a power grid, balancing power flows and making interventions to maintain stability. We present an introduction to power systems targeted at the machine learning community and an introduction to reinforcement learning targeted at the power systems community. This is to enable and encourage broader participation in the challenge and collaboration between these two communities.
△ Less
Submitted 16 March, 2020;
originally announced March 2020.
-
Learning to run a power network challenge for training topology controllers
Authors:
Antoine Marot,
Benjamin Donnot,
Camilo Romero,
Luca Veyrin-Forrer,
Marvin Lerousseau,
Balthazar Donon,
Isabelle Guyon
Abstract:
For power grid operations, a large body of research focuses on using generation redispatching, load shedding or demand side management flexibilities. However, a less costly and potentially more flexible option would be grid topology reconfiguration, as already partially exploited by Coreso (European RSC) and RTE (French TSO) operations. Beyond previous work on branch switching, bus reconfiguration…
▽ More
For power grid operations, a large body of research focuses on using generation redispatching, load shedding or demand side management flexibilities. However, a less costly and potentially more flexible option would be grid topology reconfiguration, as already partially exploited by Coreso (European RSC) and RTE (French TSO) operations. Beyond previous work on branch switching, bus reconfigurations are a broader class of action and could provide some substantial benefits to route electricity and optimize the grid capacity to keep it within safety margins. Because of its non-linear and combinatorial nature, no existing optimal power flow solver can yet tackle this problem. We here propose a new framework to learn topology controllers through imitation and reinforcement learning. We present the design and the results of the first "Learning to Run a Power Network" challenge released with this framework. We finally develop a method providing performance upper-bounds (oracle), which highlights remaining unsolved challenges and suggests future directions of improvement.
△ Less
Submitted 5 December, 2019;
originally announced December 2019.
-
LEAP nets for power grid perturbations
Authors:
Benjamin Donnot,
Balthazar Donon,
Isabelle Guyon,
Zhengying Liu,
Antoine Marot,
Patrick Panciatici,
Marc Schoenauer
Abstract:
We propose a novel neural network embedding approach to model power transmission grids, in which high voltage lines are disconnected and reconnected with one-another from time to time, either accidentally or willfully. We call our architeture LEAP net, for Latent Encoding of Atypical Perturbation. Our method implements a form of transfer learning, permitting to train on a few source domains, then…
▽ More
We propose a novel neural network embedding approach to model power transmission grids, in which high voltage lines are disconnected and reconnected with one-another from time to time, either accidentally or willfully. We call our architeture LEAP net, for Latent Encoding of Atypical Perturbation. Our method implements a form of transfer learning, permitting to train on a few source domains, then generalize to new target domains, without learning on any example of that domain. We evaluate the viability of this technique to rapidly assess cu-rative actions that human operators take in emergency situations, using real historical data, from the French high voltage power grid.
△ Less
Submitted 22 August, 2019;
originally announced August 2019.
