Showing 1–50 of 110 results for author: Witthaut, D

Synchronized states of power grids and oscillator networks by convex optimization

Authors: Carsten Hartmann, Philipp C. Böttcher, David Gross, Dirk Witthaut

Abstract: Synchronization is essential for the operation of AC power systems: All generators in the power grid must rotate with fixed relative phases to enable a steady flow of electric power. Understanding the conditions for and the limitations of synchronization is of utmost practical importance. In this article, we propose a novel approach to compute and analyze the stable stationary states of a power gr… ▽ More Synchronization is essential for the operation of AC power systems: All generators in the power grid must rotate with fixed relative phases to enable a steady flow of electric power. Understanding the conditions for and the limitations of synchronization is of utmost practical importance. In this article, we propose a novel approach to compute and analyze the stable stationary states of a power grid or an oscillator network in terms of a convex optimization problem. This approach allows to systematically compute \emph{all} stable states where the phase difference across an edge does not exceed $π/2$.Furthermore, the optimization formulation allows to rigorously establish certain properties of synchronized states and to bound the error in the widely used linear power flow approximation. △ Less

Submitted 14 March, 2024; originally announced March 2024.

Comments: 19 pages, 7 figures

Topological Determinants of Perturbation Spreading in Networks

Authors: Xiaozhu Zhang, Dirk Witthaut, Marc Timme

Abstract: Spreading phenomena essentially underlie the dynamics of various natural and technological networked systems, yet how spatiotemporal propagation patterns emerge from such networks remains largely unknown. Here we propose a novel approach that reveals universal features determining the spreading dynamics in diffusively coupled networks and disentangles them from factors that are system specific. In… ▽ More Spreading phenomena essentially underlie the dynamics of various natural and technological networked systems, yet how spatiotemporal propagation patterns emerge from such networks remains largely unknown. Here we propose a novel approach that reveals universal features determining the spreading dynamics in diffusively coupled networks and disentangles them from factors that are system specific. In particular, we first analytically identify a purely topological factor encoding the interaction structure and strength, and second, numerically estimate a master function characterizing the universal scaling of the perturbation arrival times across topologically different networks. The proposed approach thereby provides intuitive insights into complex propagation patterns as well as accurate predictions for the perturbation arrival times. The approach readily generalizes to a wide range of networked systems with diffusive couplings and may contribute to assess the risks of transient influences of ubiquitous perturbations in real-world systems. △ Less

Submitted 9 March, 2024; originally announced March 2024.

Journal ref: Physical Review Letters 125.21 (2020): 218301

Multivariate Scenario Generation of Day-Ahead Electricity Prices using Normalizing Flows

Authors: Hannes Hilger, Dirk Witthaut, Manuel Dahmen, Leonardo Rydin Gorjao, Julius Trebbien, Eike Cramer

Abstract: Trading on the day-ahead electricity markets requires accurate information about the realization of electricity prices and the uncertainty attached to the predictions. Deriving accurate forecasting models presents a difficult task due to the day-ahead price's non-stationarity resulting from changing market conditions, e.g., due to changes resulting from the energy crisis in 2021. We present a prob… ▽ More Trading on the day-ahead electricity markets requires accurate information about the realization of electricity prices and the uncertainty attached to the predictions. Deriving accurate forecasting models presents a difficult task due to the day-ahead price's non-stationarity resulting from changing market conditions, e.g., due to changes resulting from the energy crisis in 2021. We present a probabilistic forecasting approach for day-ahead electricity prices using the fully data-driven deep generative model called normalizing flow. Our modeling approach generates full-day scenarios of day-ahead electricity prices based on conditional features such as residual load forecasts. Furthermore, we propose extended feature sets of prior realizations and a periodic retraining scheme that allows the normalizing flow to adapt to the changing conditions of modern electricity markets. Our results highlight that the normalizing flow generates high-quality scenarios that reproduce the true price distribution and yield accurate forecasts. Additionally, our analysis highlights how our improvements towards adaptations in changing regimes allow the normalizing flow to adapt to changing market conditions and enable continued sampling of high-quality day-ahead price scenarios. △ Less

Submitted 22 March, 2024; v1 submitted 23 November, 2023; originally announced November 2023.

Comments: 17 pages, 9 figures

Probabilistic Forecasting of Day-Ahead Electricity Prices and their Volatility with LSTMs

Authors: Julius Trebbien, Sebastian Pütz, Benjamin Schäfer, Heidi S. Nygård, Leonardo Rydin Gorjão, Dirk Witthaut

Abstract: Accurate forecasts of electricity prices are crucial for the management of electric power systems and the development of smart applications. European electricity prices have risen substantially and became highly volatile after the Russian invasion of Ukraine, challenging established forecasting methods. Here, we present a Long Short-Term Memory (LSTM) model for the German-Luxembourg day-ahead elec… ▽ More Accurate forecasts of electricity prices are crucial for the management of electric power systems and the development of smart applications. European electricity prices have risen substantially and became highly volatile after the Russian invasion of Ukraine, challenging established forecasting methods. Here, we present a Long Short-Term Memory (LSTM) model for the German-Luxembourg day-ahead electricity prices addressing these challenges. The recurrent structure of the LSTM allows the model to adapt to trends, while the joint prediction of both mean and standard deviation enables a probabilistic prediction. Using a physics-inspired approach - superstatistics - to derive an explanation for the statistics of prices, we show that the LSTM model faithfully reproduces both prices and their volatility. △ Less

Submitted 5 October, 2023; originally announced October 2023.

Comments: 5 pages, 1 figure

Identifying drivers and mitigators for congestion and redispatch in the German electric power system with explainable AI

Authors: Maurizio Titz, Sebastian Pütz, Dirk Witthaut

Abstract: The transition to a sustainable energy supply challenges the operation of electric power systems in manifold ways. Transmission grid loads increase as wind and solar power are often installed far away from the consumers. In extreme cases, system operators must intervene via countertrading or redispatch to ensure grid stability. In this article, we provide a data-driven analysis of congestion in th… ▽ More The transition to a sustainable energy supply challenges the operation of electric power systems in manifold ways. Transmission grid loads increase as wind and solar power are often installed far away from the consumers. In extreme cases, system operators must intervene via countertrading or redispatch to ensure grid stability. In this article, we provide a data-driven analysis of congestion in the German transmission grid. We develop an explainable machine learning model to predict the volume of redispatch and countertrade on an hourly basis. The model reveals factors that drive or mitigate grid congestion and quantifies their impact. We show that, as expected, wind power generation is the main driver, but hydropower and cross-border electricity trading also play an essential role. Solar power, on the other hand, has no mitigating effect. Our results suggest that a change to the market design would alleviate congestion. △ Less

Submitted 24 July, 2023; originally announced July 2023.

Regulatory Changes in Power Systems Explored with Explainable Artificial Intelligence

Authors: Sebatian Pütz, Johannes Kruse, Dirk Witthaut, Veit Hagenmeyer, Benjamin Schäfer

Abstract: A stable supply of electrical energy is essential for the functioning of our society. Therefore, the electrical power grid's operation and energy and balancing markets are subject to strict regulations. As the external technical, economic, or social influences on the power grid change, these regulations must also be constantly adapted. However, whether these regulatory changes lead to the intended… ▽ More A stable supply of electrical energy is essential for the functioning of our society. Therefore, the electrical power grid's operation and energy and balancing markets are subject to strict regulations. As the external technical, economic, or social influences on the power grid change, these regulations must also be constantly adapted. However, whether these regulatory changes lead to the intended results is not easy to assess. Could eXplainable Artificial Intelligence (XAI) models distinguish regulatory settings and support the understanding of the effects of these changes? In this article, we explore two examples of regulatory changes in the German energy markets for bulk electricity and for reserve power. We explore the splitting of the German-Austrian bidding zone and changes in the pricing schemes of the German balancing energy market. We find that boosted tree models and feedforward neural networks before and after a regulatory change differ in their respective parametrizations. Using Shapley additive explanations, we reveal model differences, e.g. in terms of feature importances, and identify key features of these distinct models. With this study, we demonstrate how XAI can be applied to investigate system changes in power systems. △ Less

Submitted 30 March, 2023; originally announced March 2023.

Comments: 7 pages, 3 figures

Journal ref: ACM e-Energy Companion (2023) 26-31

Stability bounds of droop-controlled inverters in power grid networks

Authors: Philipp C. Böttcher, Leonardo Rydin Gorjão, Dirk Witthaut

Abstract: The energy mix of future power systems will include high shares of wind power and solar PV. These generation facilities are generally connected via power-electronic inverters. While conventional generation responds dynamically to the state of the electric power system, inverters are power electronic hardware and need to be programmed to react to the state of the system. Choosing an appropriate con… ▽ More The energy mix of future power systems will include high shares of wind power and solar PV. These generation facilities are generally connected via power-electronic inverters. While conventional generation responds dynamically to the state of the electric power system, inverters are power electronic hardware and need to be programmed to react to the state of the system. Choosing an appropriate control scheme and the corresponding parameters is necessary to guarantee that the system operates safely. A prominent control scheme for inverters is droop control, which mimics the response of conventional generation. In this work, we investigate the stability of coupled systems of droop-controlled inverters in arbitrary network topologies. Employing linear stability analysis, we derive effective local stability criteria that consider both the overall network topology as well as its interplay with the inverters' intrinsic parameters. First, we explore the stability of an inverter coupled to an infinite grid in an analytic fashion and uncover stability and instability regions. Secondly, we extend the analysis to a generic topology of inverters and provide mathematical criteria for stability and instability of the system. Last, we showcase the usefulness of the criteria by examining two model systems using numerical simulations. The developed criteria show which parameters might lead to an unstable operating state. △ Less

Submitted 29 March, 2023; originally announced March 2023.

Comments: 13 pages, 7 figures

Local versus global stability in dynamical systems with consecutive Hopf-Bifurcations

Authors: Philipp C. Böttcher, Benjamin Schäfer, Stefan Kettemann, Carsten Agert, Dirk Witthaut

Abstract: Quantifying the stability of an equilibrium is central in the theory of dynamical systems as well as in engineering and control. A comprehensive picture must include the response to both small and large perturbations, leading to the concepts of local (linear) and global stability. Here, we show how systems displaying Hopf bifurcations show contrarian results on these two aspects of stability: Glob… ▽ More Quantifying the stability of an equilibrium is central in the theory of dynamical systems as well as in engineering and control. A comprehensive picture must include the response to both small and large perturbations, leading to the concepts of local (linear) and global stability. Here, we show how systems displaying Hopf bifurcations show contrarian results on these two aspects of stability: Global stability is large close to the point where the system loses its local stability altogether. We demonstrate this effect for an elementary model system, an anharmonic oscillator and a realistic model of power system dynamics with delayed control. Detailed investigations of the bifurcation explain the seeming paradox in terms of the location of the attractors relative to the equilibrium. △ Less

Submitted 7 March, 2023; v1 submitted 16 February, 2023; originally announced February 2023.

Comments: 29 pages, 9 figures

Understanding electricity prices beyond the merit order principle using explainable AI

Authors: Julius Trebbien, Leonardo Rydin Gorjão, Aaron Praktiknjo, Benjamin Schäfer, Dirk Witthaut

Abstract: Electricity prices in liberalized markets are determined by the supply and demand for electric power, which are in turn driven by various external influences that vary strongly in time. In perfect competition, the merit order principle describes that dispatchable power plants enter the market in the order of their marginal costs to meet the residual load, i.e. the difference of load and renewable… ▽ More Electricity prices in liberalized markets are determined by the supply and demand for electric power, which are in turn driven by various external influences that vary strongly in time. In perfect competition, the merit order principle describes that dispatchable power plants enter the market in the order of their marginal costs to meet the residual load, i.e. the difference of load and renewable generation. Many market models implement this principle to predict electricity prices but typically require certain assumptions and simplifications. In this article, we present an explainable machine learning model for the prices on the German day-ahead market, which substantially outperforms a benchmark model based on the merit order principle. Our model is designed for the ex-post analysis of prices and thus builds on various external features. Using Shapley Additive exPlanation (SHAP) values, we can disentangle the role of the different features and quantify their importance from empiric data. Load, wind and solar generation are most important, as expected, but wind power appears to affect prices stronger than solar power does. Fuel prices also rank highly and show nontrivial dependencies, including strong interactions with other features revealed by a SHAP interaction analysis. Large generation ramps are correlated with high prices, again with strong feature interactions, due to the limited flexibility of nuclear and lignite plants. Our results further contribute to model development by providing quantitative insights directly from data. △ Less

Submitted 9 December, 2022; originally announced December 2022.

Comments: 13 pages, 6 figures

Formation of trade networks by economies of scale and product differentiation

Authors: Chengyuan Han, Malte Schröder, Dirk Witthaut, Philipp C. Böttcher

Abstract: Understanding the structure and formation of networks is a central topic in complexity science. Economic networks are formed by decisions of individual agents and thus not properly described by established random graph models. In this article, we establish a model for the emergence of trade networks that is based on rational decisions of individual agents. The model incorporates key drivers for th… ▽ More Understanding the structure and formation of networks is a central topic in complexity science. Economic networks are formed by decisions of individual agents and thus not properly described by established random graph models. In this article, we establish a model for the emergence of trade networks that is based on rational decisions of individual agents. The model incorporates key drivers for the emergence of trade, comparative advantage and economic scale effects, but also the heterogeneity of agents and the transportation or transaction costs. Numerical simulations show three macroscopically different regimes of the emerging trade networks. Depending on the specific transportation costs and the heterogeneity of individual preferences, we find centralized production with a star-like trade network, distributed production with all-to-all trading or local production and no trade. Using methods from statistical mechanics, we provide an analytic theory of the transitions between these regimes and estimates for critical parameters values. △ Less

Submitted 8 August, 2023; v1 submitted 6 December, 2022; originally announced December 2022.

Comments: 25 pages, 7 figures

Journal ref: J. Phys. Complex. 4 (2023) 025006

Physics-inspired machine learning for power grid frequency modelling

Authors: Johannes Kruse, Eike Cramer, Benjamin Schäfer, Dirk Witthaut

Abstract: The operation of power systems is affected by diverse technical, economic and social factors. Social behaviour determines load patterns, electricity markets regulate the generation and weather-dependent renewables introduce power fluctuations. Thus, power system dynamics must be regarded as a non-autonomous system whose parameters vary strongly with time. However, the external driving factors are… ▽ More The operation of power systems is affected by diverse technical, economic and social factors. Social behaviour determines load patterns, electricity markets regulate the generation and weather-dependent renewables introduce power fluctuations. Thus, power system dynamics must be regarded as a non-autonomous system whose parameters vary strongly with time. However, the external driving factors are usually only available on coarse scales and the actual dependencies of the dynamic system parameters are generally unknown. Here, we propose a physics-inspired machine learning model that bridges the gap between large-scale drivers and short-term dynamics of the power system. Integrating stochastic differential equations and artificial neural networks, we construct a probabilistic model of the power grid frequency dynamics in Continental Europe. Its probabilistic prediction outperforms the daily average profile, which is an important benchmark. Using the integrated model, we identify and explain the parameters of the dynamical system from the data, which reveals their strong time-dependence and their relation to external drivers such as wind power feed-in and fast generation ramps. Finally, we generate synthetic time series from the model, which successfully reproduce central characteristics of the grid frequency such as their heavy-tailed distribution. All in all, our work emphasises the importance of modelling power system dynamics as a stochastic non-autonomous system with both intrinsic dynamics and external drivers. △ Less

Submitted 2 November, 2022; originally announced November 2022.

Comments: 21 pages, 5 figures

Predicting Dynamic Stability from Static Features in Power Grid Models using Machine Learning

Authors: Maurizio Titz, Franz Kaiser, Johannes Kruse, Dirk Witthaut

Abstract: A reliable supply with electric power is vital for our society. Transmission line failures are among the biggest threats for power grid stability as they may lead to a splitting of the grid into mutual asynchronous fragments. New conceptual methods are needed to assess system stability that complement existing simulation models. In this article we propose a combination of network science metrics a… ▽ More A reliable supply with electric power is vital for our society. Transmission line failures are among the biggest threats for power grid stability as they may lead to a splitting of the grid into mutual asynchronous fragments. New conceptual methods are needed to assess system stability that complement existing simulation models. In this article we propose a combination of network science metrics and machine learning models to predict the risk of desynchronisation events. Network science provides metrics for essential properties of transmission lines such as their redundancy or centrality. Machine learning models perform inherent feature selection and thus reveal key factors that determine network robustness and vulnerability. As a case study, we train and test such models on simulated data from several synthetic test grids. We find that the integrated models are capable of predicting desynchronisation events after line failures with an average precision greater than $0.996$ when averaging over all data sets. Learning transfer between different data sets is generally possible, at a slight loss of prediction performance. Our results suggest that power grid desynchronisation is essentially governed by only a few network metrics that quantify the networks ability to reroute flow without creating exceedingly high static line loadings. △ Less

Submitted 17 October, 2022; originally announced October 2022.

Understanding Braess' Paradox in power grids

Authors: Benjamin Schäfer, Thiemo Pesch, Debsankha Manik, Julian Gollenstede, Guosong Lin, Hans-Peter Beck, Dirk Witthaut, Marc Timme

Abstract: The ongoing energy transition requires power grid extensions to connect renewable generators to consumers and to transfer power among distant areas. The process of grid extension requires a large investment of resources and is supposed to make grid operation more robust. Yet, counter-intuitively, increasing the capacity of existing lines or adding new lines may also reduce the overall system perfo… ▽ More The ongoing energy transition requires power grid extensions to connect renewable generators to consumers and to transfer power among distant areas. The process of grid extension requires a large investment of resources and is supposed to make grid operation more robust. Yet, counter-intuitively, increasing the capacity of existing lines or adding new lines may also reduce the overall system performance and even promote blackouts due to Braess' paradox. Braess' paradox was theoretically modeled but not yet proven in realistically scaled power grids. Here, we present an experimental setup demonstrating Braess' paradox in an AC power grid and show how it constrains ongoing large-scale grid extension projects. We present a topological theory that reveals the key mechanism and predicts Braessian grid extensions from the network structure. These results offer a theoretical method to understand and practical guidelines in support of preventing unsuitable infrastructures and the systemic planning of grid extensions. △ Less

Submitted 27 September, 2022; originally announced September 2022.

Comments: 12 pages

Journal ref: Nature Communications volume 13, Article number: 5396 (2022)

Predicting Braess' Paradox in Supply and Transport Networks

Authors: Debsankha Manik, Dirk Witthaut, Marc Timme

Abstract: Reliable functioning of supply and transport networks fundamentally support many non-equilibrium dynamical systems, from biological organisms and ecosystems to human-made water, gas, heat, electricity and traffic networks. Strengthening an edge of such a network lowers its resistance opposing a flow and intuitively improves the robustness of the system's function. If, in contrast, it deteriorate o… ▽ More Reliable functioning of supply and transport networks fundamentally support many non-equilibrium dynamical systems, from biological organisms and ecosystems to human-made water, gas, heat, electricity and traffic networks. Strengthening an edge of such a network lowers its resistance opposing a flow and intuitively improves the robustness of the system's function. If, in contrast, it deteriorate operation by overloading other edges, the counterintuitive phenomenon of \emph{Braess' paradox} emerges. How to predict which edges enhancements may trigger Braess' paradox remains unknown to date. To approximately locate and intuitively understand such Braessian edges, we here present a differential perspective on how enhancing any edge impacts network-wide flow patterns. First, we exactly map the prediction problem to a dual problem of electrostatic dipole currents on networks such that simultaneously finding \textit{all} Braessian edges is equivalent to finding the currents in the resistor network resulting from a constant current across one edge. Second, we propose a simple approximate criterion -- rerouting alignment -- to efficiently predict Braessian edges, thereby providing an intuitive topological understanding of the phenomenon. Finally, we show how to intentionally weaken Braessian edges to mitigate network overload, with beneficial consequences for network functionality. △ Less

Submitted 29 May, 2022; originally announced May 2022.

Comments: 10 pages, 7 figures

Multivariate Probabilistic Forecasting of Intraday Electricity Prices using Normalizing Flows

Authors: Eike Cramer, Dirk Witthaut, Alexander Mitsos, Manuel Dahmen

Abstract: Electricity is traded on various markets with different time horizons and regulations. Short-term intraday trading becomes increasingly important due to the higher penetration of renewables. In Germany, the intraday electricity price typically fluctuates around the day-ahead price of the European Power EXchange (EPEX) spot markets in a distinct hourly pattern. This work proposes a probabilistic mo… ▽ More Electricity is traded on various markets with different time horizons and regulations. Short-term intraday trading becomes increasingly important due to the higher penetration of renewables. In Germany, the intraday electricity price typically fluctuates around the day-ahead price of the European Power EXchange (EPEX) spot markets in a distinct hourly pattern. This work proposes a probabilistic modeling approach that models the intraday price difference to the day-ahead contracts. The model captures the emerging hourly pattern by considering the four 15 min intervals in each day-ahead price interval as a four-dimensional joint probability distribution. The resulting nontrivial, multivariate price difference distribution is learned using a normalizing flow, i.e., a deep generative model that combines conditional multivariate density estimation and probabilistic regression. Furthermore, this work discusses the influence of different external impact factors based on literature insights and impact analysis using explainable artificial intelligence (XAI). The normalizing flow is compared to an informed selection of historical data and probabilistic forecasts using a Gaussian copula and a Gaussian regression model. Among the different models, the normalizing flow identifies the trends with the highest accuracy and has the narrowest prediction intervals. Both the XAI analysis and the empirical experiments highlight that the immediate history of the price difference realization and the increments of the day-ahead price have the most substantial impact on the price difference. △ Less

Submitted 10 March, 2023; v1 submitted 27 May, 2022; originally announced May 2022.

Comments: manuscript (20 pages, 11 figures, 5 tables), supporting information (8 pages, 5 figures, 4 tables)

Revealing interactions between HVDC cross-area flows and frequency stability with explainable AI

Authors: Sebastian Pütz, Benjamin Schäfer, Dirk Witthaut, Johannes Kruse

Abstract: The energy transition introduces more volatile energy sources into the power grids. In this context, power transfer between different synchronous areas through High Voltage Direct Current (HVDC) links becomes increasingly important. Such links can balance volatile generation by enabling long-distance transport or by leveraging their fast control behavior. Here, we investigate the interaction of po… ▽ More The energy transition introduces more volatile energy sources into the power grids. In this context, power transfer between different synchronous areas through High Voltage Direct Current (HVDC) links becomes increasingly important. Such links can balance volatile generation by enabling long-distance transport or by leveraging their fast control behavior. Here, we investigate the interaction of power imbalances - represented through the power grid frequency - and power flows on HVDC links between synchronous areas in Europe. We use explainable machine learning to identify key dependencies and disentangle the interaction of critical features. Our results show that market-based HVDC flows introduce deterministic frequency deviations, which however can be mitigated through strict ram** limits. Moreover, varying HVDC operation modes strongly affect the interaction with the grid. In particular, we show that load-frequency control via HVDC links can both have control-like or disturbance-like impacts on frequency stability. △ Less

Submitted 22 April, 2022; originally announced April 2022.

Comments: 14 pages, 8 figures; submitted version

Journal ref: Energy Inform 5 (Suppl 4), 46 (2022)

Initial analysis of the impact of the Ukrainian power grid synchronization with Continental Europe

Authors: Philipp C. Böttcher, Leonardo Rydin Gorjão, Christian Beck, Richard Jumar, Heiko Maass, Veit Hagenmeyer, Dirk Witthaut, Benjamin Schäfer

Abstract: When Russia invaded Ukraine on the 24\textsuperscript{th} of February 2022, this led to many acts of solidarity with Ukraine, including support for its electricity system. Just 20 days after the invasion started, the Ukrainian and Moldovan power grids were synchronized to the Continental European power grid to provide stability to these grids. Here, we present an initial analysis of how this synch… ▽ More When Russia invaded Ukraine on the 24\textsuperscript{th} of February 2022, this led to many acts of solidarity with Ukraine, including support for its electricity system. Just 20 days after the invasion started, the Ukrainian and Moldovan power grids were synchronized to the Continental European power grid to provide stability to these grids. Here, we present an initial analysis of how this synchronization affected the statistics of the power grid frequency and cross-border flows of electric power within Continental Europe. We observe faster inter-area oscillations, an increase in fluctuations and changes in the cross-border flows in and out of Ukraine and surrounding countries as an effect of the synchronization with Continental Europe. Overall these changes are small such that the now connected system can be considered as stable as before the synchronization. △ Less

Submitted 13 December, 2022; v1 submitted 15 April, 2022; originally announced April 2022.

Comments: 7 pages, 6 figures

Journal ref: Energy Adv., 2023

Collective effects and synchronization of demand in real-time demand response

Authors: Chengyuan Han, Dirk Witthaut, Leonardo Rydin Gorjão, Philipp C. Böttcher

Abstract: Sustainable energy systems require flexible elements to balance the variability of renewable energy sources. Demand response aims to adapt the demand to the variable generation, in particular by shifting the load in time. In this article, we provide a detailed statistic analysis of the collective operation of many demand response units. We establish and simulate a model for load shifting in respon… ▽ More Sustainable energy systems require flexible elements to balance the variability of renewable energy sources. Demand response aims to adapt the demand to the variable generation, in particular by shifting the load in time. In this article, we provide a detailed statistic analysis of the collective operation of many demand response units. We establish and simulate a model for load shifting in response to real-time electricity pricing using local storage systems. We show that demand response drives load shifting as desired, but also induces strong collective effects that may threaten system stability. The load of individual households synchronizes, leading to extreme demand peaks. We provide a detailed statistical analysis of the grid load, and quantify both the likeliness and extent of extreme demand peaks. △ Less

Submitted 20 January, 2022; originally announced January 2022.

Comments: 20 pages, 9 figures

Journal ref: J. Phys. Complex. 3 025002, 2022

Change of persistence in European electricity spot prices

Authors: Leonardo Rydin Gorjão, Dirk Witthaut, Pedro G. Lind, Wided Medjroubi

Abstract: The European Power Exchange has introduced day-ahead auctions and continuous trading spot markets to facilitate the insertion of renewable electricity. These markets are designed to balance excess or lack of power in short time periods, which leads to a large stochastic variability of the electricity prices. Furthermore, the different markets show different stochastic memory in their electricity p… ▽ More The European Power Exchange has introduced day-ahead auctions and continuous trading spot markets to facilitate the insertion of renewable electricity. These markets are designed to balance excess or lack of power in short time periods, which leads to a large stochastic variability of the electricity prices. Furthermore, the different markets show different stochastic memory in their electricity price time series, which seem to be the cause for the large volatility. In particular, we show the antithetical temporal correlation in the intraday 15 minutes spot markets in comparison to the day-ahead hourly market. We contrast the results from Detrended Fluctuation Analysis (DFA) to a new method based on the Kramers--Moyal equation in scale. For very short term ($<12$ hours), all price time series show positive temporal correlations (Hurst exponent $H>0.5$) except for the intraday 15 minute market, which shows strong negative correlations ($H<0.5$). For longer term periods covering up to two days, all price time series are anti-correlated ($H<0.5$). △ Less

Submitted 7 December, 2021; originally announced December 2021.

Comments: 7 pages, 2 figures

Complexity and Persistence of Price Time Series of the European Electricity Spot Market

Authors: Chengyuan Han, Hannes Hilger, Eva Mix, Philipp C. Böttcher, Mark Reyers, Christian Beck, Dirk Witthaut, Leonardo Rydin Gorjão

Abstract: The large variability of renewable power sources is a central challenge in the transition to a sustainable energy system. Electricity markets are central for the coordination of electric power generation. These markets rely evermore on short-term trading to facilitate the balancing of power generation and demand and to enable systems integration of small producers. Electricity prices in these spot… ▽ More The large variability of renewable power sources is a central challenge in the transition to a sustainable energy system. Electricity markets are central for the coordination of electric power generation. These markets rely evermore on short-term trading to facilitate the balancing of power generation and demand and to enable systems integration of small producers. Electricity prices in these spot markets show pronounced fluctuations, featuring extreme peaks as well as occasional negative prices. In this article, we analyse electricity price time series from the European EPEX market, in particular the hourly day-ahead, hourly intraday, and 15-min intraday market prices. We quantify the fluctuations, correlations, and extreme events and reveal different time scales in the dynamics of the market. The short-term fluctuations show remarkably different characteristics for time scales below and above 12 hours. Fluctuations are strongly correlated and persistent below 12 hours, which contributes to extreme price events and a strong multifractal behaviour. On longer time scales, they get anti-correlated and price time series revert to their mean, witnessed by a stark decrease of the Hurst coefficient after 12 hours. The long-term behaviour is strongly influenced by the evolution of a large-scale weather patterns with a typical time scale of four days. We elucidate this dependence in detail using a classification into circulation weather types. The separation in time scales enables a superstatistical treatment, which confirms the characteristic time scale of four days, and motivates the use of $q$-Gaussian distributions as the best fit to the empiric distribution of electricity prices. △ Less

Submitted 1 December, 2021; originally announced December 2021.

Comments: 16 pages, 10 figures

Validation Methods for Energy Time Series Scenarios from Deep Generative Models

Authors: Eike Cramer, Leonardo Rydin Gorjão, Alexander Mitsos, Benjamin Schäfer, Dirk Witthaut, Manuel Dahmen

Abstract: The design and operation of modern energy systems are heavily influenced by time-dependent and uncertain parameters, e.g., renewable electricity generation, load-demand, and electricity prices. These are typically represented by a set of discrete realizations known as scenarios. A popular scenario generation approach uses deep generative models (DGM) that allow scenario generation without prior as… ▽ More The design and operation of modern energy systems are heavily influenced by time-dependent and uncertain parameters, e.g., renewable electricity generation, load-demand, and electricity prices. These are typically represented by a set of discrete realizations known as scenarios. A popular scenario generation approach uses deep generative models (DGM) that allow scenario generation without prior assumptions about the data distribution. However, the validation of generated scenarios is difficult, and a comprehensive discussion about appropriate validation methods is currently lacking. To start this discussion, we provide a critical assessment of the currently used validation methods in the energy scenario generation literature. In particular, we assess validation methods based on probability density, auto-correlation, and power spectral density. Furthermore, we propose using the multifractal detrended fluctuation analysis (MFDFA) as an additional validation method for non-trivial features like peaks, bursts, and plateaus. As representative examples, we train generative adversarial networks (GANs), Wasserstein GANs (WGANs), and variational autoencoders (VAEs) on two renewable power generation time series (photovoltaic and wind from Germany in 2013 to 2015) and an intra-day electricity price time series form the European Energy Exchange in 2017 to 2019. We apply the four validation methods to both the historical and the generated data and discuss the interpretation of validation results as well as common mistakes, pitfalls, and limitations of the validation methods. Our assessment shows that no single method sufficiently characterizes a scenario but ideally validation should include multiple methods and be interpreted carefully in the context of scenarios over short time periods. △ Less

Submitted 15 December, 2021; v1 submitted 27 October, 2021; originally announced October 2021.

Comments: 20 pages, 8 figures, 2 tables

Secondary control activation analysed and predicted with explainable AI

Authors: Johannes Kruse, Benjamin Schäfer, Dirk Witthaut

Abstract: The transition to a renewable energy system poses challenges for power grid operation and stability. Secondary control is key in restoring the power system to its reference following a disturbance. Underestimating the necessary control capacity may require emergency measures, such as load shedding. Hence, a solid understanding of the emerging risks and the driving factors of control is needed. In… ▽ More The transition to a renewable energy system poses challenges for power grid operation and stability. Secondary control is key in restoring the power system to its reference following a disturbance. Underestimating the necessary control capacity may require emergency measures, such as load shedding. Hence, a solid understanding of the emerging risks and the driving factors of control is needed. In this contribution, we establish an explainable machine learning model for the activation of secondary control power in Germany. Training gradient boosted trees, we obtain an accurate description of control activation. Using SHapely Additive exPlanation (SHAP) values, we investigate the dependency between control activation and external features such as the generation mix, forecasting errors, and electricity market data. Thereby, our analysis reveals drivers that lead to high reserve requirements in the German power system. Our transparent approach, utilizing open data and making machine learning models interpretable, opens new scientific discovery avenues. △ Less

Submitted 10 September, 2021; originally announced September 2021.

Comments: 8 pages, 6 figures

Journal ref: Electric Power Systems Research 212, 108489 (2022)

Exploring deterministic frequency deviations with explainable AI

Authors: Johannes Kruse, Benjamin Schäfer, Dirk Witthaut

Abstract: Deterministic frequency deviations (DFDs) critically affect power grid frequency quality and power system stability. A better understanding of these events is urgently needed as frequency deviations have been growing in the European grid in recent years. DFDs are partially explained by the rapid adjustment of power generation following the intervals of electricity trading, but this intuitive pictu… ▽ More Deterministic frequency deviations (DFDs) critically affect power grid frequency quality and power system stability. A better understanding of these events is urgently needed as frequency deviations have been growing in the European grid in recent years. DFDs are partially explained by the rapid adjustment of power generation following the intervals of electricity trading, but this intuitive picture fails especially before and around noonday. In this article, we provide a detailed analysis of DFDs and their relation to external features using methods from explainable Artificial Intelligence. We establish a machine learning model that well describes the daily cycle of DFDs and elucidate key interdependencies using SHapley Additive exPlanations (SHAP). Thereby, we identify solar ramps as critical to explain patterns in the Rate of Change of Frequency (RoCoF). △ Less

Submitted 14 June, 2021; originally announced June 2021.

Comments: 7 pages, 4 figures

Journal ref: 2021 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), 133-139 (2021)

Revealing drivers and risks for power grid frequency stability with explainable AI

Authors: Johannes Kruse, Benjamin Schäfer, Dirk Witthaut

Abstract: Stable operation of the electrical power system requires the power grid frequency to stay within strict operational limits. With millions of consumers and thousands of generators connected to a power grid, detailed human-build models can no longer capture the full dynamics of this complex system. Modern machine learning algorithms provide a powerful alternative for system modelling and prediction,… ▽ More Stable operation of the electrical power system requires the power grid frequency to stay within strict operational limits. With millions of consumers and thousands of generators connected to a power grid, detailed human-build models can no longer capture the full dynamics of this complex system. Modern machine learning algorithms provide a powerful alternative for system modelling and prediction, but the intrinsic black-box character of many models impedes scientific insights and poses severe security risks. Here, we show how eXplainable AI (XAI) alleviates these problems by revealing critical dependencies and influences on the power grid frequency. We accurately predict frequency stability indicators (such as RoCoF and Nadir) for three major European synchronous areas and identify key features that determine the power grid stability. Load ramps, specific generation ramps but also prices and forecast errors are central to understand and stabilize the power grid. △ Less

Submitted 6 January, 2022; v1 submitted 7 June, 2021; originally announced June 2021.

Comments: 26 pages, 19 figures; updated comments; this is the initially submitted version, for the final version see journal link

Journal ref: Patterns 2 (11), 100365 (2021)

Dual communities in spatial networks

Authors: Franz Kaiser, Philipp C. Böttcher, Henrik Ronellenfitsch, Vito Latora, Dirk Witthaut

Abstract: Both human-made and natural supply systems, such as power grids and leaf venation networks, are built to operate reliably under changing external conditions. Many of these spatial networks exhibit community structures. Here, we show that a relatively strong connectivity between the parts of a network can be used to define a different class of communities: dual communities. We demonstrate that trad… ▽ More Both human-made and natural supply systems, such as power grids and leaf venation networks, are built to operate reliably under changing external conditions. Many of these spatial networks exhibit community structures. Here, we show that a relatively strong connectivity between the parts of a network can be used to define a different class of communities: dual communities. We demonstrate that traditional and dual communities emerge naturally as two different phases of optimized network structures that are shaped by fluctuations and that they suppress failure spreading, which underlines their importance in understanding the shape of real-world supply networks. △ Less

Submitted 28 October, 2022; v1 submitted 14 May, 2021; originally announced May 2021.

Journal ref: Nature Communications 13, 7479 (2022)

Phase and amplitude synchronisation in power-grid frequency fluctuations in the Nordic Grid

Authors: Leonardo Rydin Gorjão, Luigi Vanfretti, Dirk Witthaut, Christian Beck, Benjamin Schäfer

Abstract: Monitoring and modelling the power grid frequency is key to ensuring stability in the electrical power system. Many tools exist to investigate the detailed deterministic dynamics and especially the bulk behaviour of the frequency. However, far less attention has been paid to its stochastic properties, and there is a need for a cohesive framework that couples both short-time scale fluctuations and… ▽ More Monitoring and modelling the power grid frequency is key to ensuring stability in the electrical power system. Many tools exist to investigate the detailed deterministic dynamics and especially the bulk behaviour of the frequency. However, far less attention has been paid to its stochastic properties, and there is a need for a cohesive framework that couples both short-time scale fluctuations and bulk behaviour. Moreover, commonly assumed uncorrelated stochastic noise is predominantly employed in modelling in energy systems. In this publication, we examine the stochastic properties of six synchronous power-grid frequency recording with high-temporal resolution of the Nordic Grid from September 2013, focusing on the increments of the frequency recordings. We show that these increments follow non-Gaussian statistics and display spatial and temporal correlations. Furthermore, we report two different physical synchronisation phenomena: a very short timescale phase synchronisation ($<2\,$s) followed by a slightly larger timescale amplitude synchronisation ($2\,$s-$5\,$s). Overall, these results provide guidance on how to model fluctuations in power systems. △ Less

Submitted 1 May, 2021; originally announced May 2021.

Comments: 11 pages, 6 figures

Arbitrary-order finite-time corrections for the Kramers-Moyal operator

Authors: Leonardo Rydin Gorjão, Dirk Witthaut, Klaus Lehnertz, Pedro G. Lind

Abstract: With the aim of improving the reconstruction of stochastic evolution equations from empirical time-series data, we derive a full representation of the generator of the Kramers-Moyal operator via a power-series expansion of the exponential operator. This expansion is necessary for deriving the different terms in a stochastic differential equation. With the full representation of this operator, we a… ▽ More With the aim of improving the reconstruction of stochastic evolution equations from empirical time-series data, we derive a full representation of the generator of the Kramers-Moyal operator via a power-series expansion of the exponential operator. This expansion is necessary for deriving the different terms in a stochastic differential equation. With the full representation of this operator, we are able to separate finite-time corrections of the power-series expansion of arbitrary order into terms with and without derivatives of the Kramers-Moyal coefficients. We arrive at a closed-form solution expressed through conditional moments, which can be extracted directly from time-series data with a finite sampling intervals. We provide all finite-time correction terms for parametric and non-parametric estimation of the Kramers-Moyal coefficients for discontinuous processes which can be easily implemented - employing Bell polynomials - in time-series analyses of stochastic processes. With exemplary cases of insufficiently sampled diffusion and jump-diffusion processes, we demonstrate the advantages of our arbitrary-order finite-time corrections and their impact in distinguishing diffusion and jump-diffusion processes strictly from time-series data. △ Less

Submitted 26 April, 2021; originally announced April 2021.

Comments: 15 pages, 2 figues

Journal ref: Entropy 2021, 23(5), 517

Spatio-temporal complexity of power-grid frequency fluctuations

Authors: Leonardo Rydin Gorjão, Benjamin Schäfer, Dirk Witthaut, Christian Beck

Abstract: Power-grid systems constitute one of the most complex man-made spatially extended structures. These operate with strict operational bounds to ensure synchrony across the grid. This is particularly relevant for power-grid frequency, which operates strictly at $50\,$Hz ($60\,$Hz). Nevertheless, small fluctuations around the mean frequency are present at very short time scales $<2$ seconds and can ex… ▽ More Power-grid systems constitute one of the most complex man-made spatially extended structures. These operate with strict operational bounds to ensure synchrony across the grid. This is particularly relevant for power-grid frequency, which operates strictly at $50\,$Hz ($60\,$Hz). Nevertheless, small fluctuations around the mean frequency are present at very short time scales $<2$ seconds and can exhibit highly complex spatio-temporal behaviour. Here we apply superstatistical data analysis techniques to measured frequency fluctuations in the Nordic Grid. We study the increment statistics and extract the relevant time scales and superstatistical distribution functions from the data. We show that different synchronous recordings of power-grid frequency have very distinct stochastic fluctuations with different types of superstatistics at different spatial locations, and with transitions from one superstatistics to another when the time lag of the increment statistics is changed. △ Less

Submitted 21 April, 2021; originally announced April 2021.

Comments: 11 pages, 6 figures

Report number: 073016

Journal ref: New Journal of Physics 23, 2021

MFDFA: Efficient Multifractal Detrended Fluctuation Analysis in Python

Authors: Leonardo Rydin Gorjão, Galib Hassan, Jürgen Kurths, Dirk Witthaut

Abstract: Multifractal detrended fluctuation analysis (MFDFA) has become a central method to characterise the variability and uncertainty in empiric time series. Extracting the fluctuations on different temporal scales allows quantifying the strength and correlations in the underlying stochastic properties, their scaling behaviour, as well as the level of fractality. Several extensions to the fundamental me… ▽ More Multifractal detrended fluctuation analysis (MFDFA) has become a central method to characterise the variability and uncertainty in empiric time series. Extracting the fluctuations on different temporal scales allows quantifying the strength and correlations in the underlying stochastic properties, their scaling behaviour, as well as the level of fractality. Several extensions to the fundamental method have been developed over the years, vastly enhancing the applicability of MFDFA, e.g. empirical mode decomposition for the study of long-range correlations and persistence. In this article we introduce an efficient, easy-to-use python library for MFDFA, incorporating the most common extensions and harnessing the most of multi-threaded processing for very fast calculations. △ Less

Submitted 21 April, 2021; originally announced April 2021.

Comments: 12 pages, 6 figures, software in https://github.com/LRydin/MFDFA

How Decentral Smart Grid Control limits non-Gaussian power grid frequency fluctuations

Authors: Benjamin Schäfer, Dirk Witthaut, Marc Timme

Abstract: Frequency fluctuations in power grids, caused by unpredictable renewable energy sources, consumer behavior and trading, need to be balanced to ensure stable grid operation. Standard smart grid solutions to mitigate large frequency excursions are based on centrally collecting data and give rise to security and privacy concerns. Furthermore, control of fluctuations is often tested by employing Gauss… ▽ More Frequency fluctuations in power grids, caused by unpredictable renewable energy sources, consumer behavior and trading, need to be balanced to ensure stable grid operation. Standard smart grid solutions to mitigate large frequency excursions are based on centrally collecting data and give rise to security and privacy concerns. Furthermore, control of fluctuations is often tested by employing Gaussian perturbations. Here, we demonstrate that power grid frequency fluctuations are in general non-Gaussian, implying that large excursions are more likely than expected based on Gaussian modeling. We consider real power grid frequency measurements from Continental Europe and compare them to stochastic models and predictions based on Fokker-Planck equations. Furthermore, we review a decentral smart grid control scheme to limit these fluctuations. In particular, we derive a scaling law of how decentralized control actions reduce the magnitude of frequency fluctuations and demonstrate the power of these theoretical predictions using a test grid. Overall, we find that decentral smart grid control may reduce grid frequency excursions due to both Gaussian and non-Gaussian power fluctuations and thus offers an alternative pathway for mitigating fluctuation-induced risks. △ Less

Submitted 24 March, 2021; originally announced April 2021.

Journal ref: Published in: 2018 IEEE Conference on Control Technology and Applications (CCTA)

Isolating the impact of trading on grid frequency fluctuations

Authors: Benjamin Schäfer, Marc Timme, Dirk Witthaut

Abstract: To ensure reliable operation of power grids, their frequency shall stay within strict bounds. Multiple sources of disturbances cause fluctuations of the grid frequency, ranging from changing demand over volatile feed-in to energy trading. Here, we analyze frequency time series from the continental European grid in 2011 and 2017 as a case study to isolate the impact of trading. We find that trading… ▽ More To ensure reliable operation of power grids, their frequency shall stay within strict bounds. Multiple sources of disturbances cause fluctuations of the grid frequency, ranging from changing demand over volatile feed-in to energy trading. Here, we analyze frequency time series from the continental European grid in 2011 and 2017 as a case study to isolate the impact of trading. We find that trading at typical trading intervals such as full hours modifies the frequency fluctuation statistics. While particularly large frequency deviations in 2017 are not as frequent as in 2011, large deviations are more likely to occur shortly after the trading instances. A comparison between the two years indicates that trading at shorter intervals might be beneficial for frequency quality and grid stability, because particularly large fluctuations are substantially diminished. Furthermore, we observe that the statistics of the frequency fluctuations do not follow Gaussian distributions but are better described using heavy-tailed and asymmetric distributions, for example Lévy-stable distributions. Comparing intervals without trading to those with trading instances indicates that frequency deviations near the trading times are distributed more widely and thus extreme deviations are orders of magnitude more likely. Finally, we briefly review a stochastic analysis that allows a quantitative description of power grid frequency fluctuations. △ Less

Submitted 24 March, 2021; originally announced March 2021.

Journal ref: Published in: 2018 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe)

Discontinuous transition to loop formation in optimal supply networks

Authors: Franz Kaiser, Henrik Ronellenfitsch, Dirk Witthaut

Abstract: The structure and design of optimal supply networks is an important topic in complex networks research. A fundamental trait of natural and man-made networks is the emergence of loops and the trade-off governing their formation: adding redundant edges to supply networks is costly, yet beneficial for resilience. Loops typically form when costs for new edges are small or inputs uncertain. Here, we sh… ▽ More The structure and design of optimal supply networks is an important topic in complex networks research. A fundamental trait of natural and man-made networks is the emergence of loops and the trade-off governing their formation: adding redundant edges to supply networks is costly, yet beneficial for resilience. Loops typically form when costs for new edges are small or inputs uncertain. Here, we shed further light on the transition to loop formation. We demonstrate that loops emerge discontinuously when decreasing the costs for new edges for both an edge-damage model and a fluctuating sink model. Mathematically, new loops are shown to form through a saddle-node bifurcation. Our analysis allows to heuristically predict the location and cost where the first loop emerges. Finally, we unveil an intimate relationship among betweenness measures and optimal tree networks. Our results can be used to understand the evolution of loop formation in real-world biological networks. △ Less

Submitted 24 November, 2020; originally announced November 2020.

Comments: 28 pages, 6 Figures, Accepted version of manuscript published in Nature Communications

Journal ref: Nature Communications, 11, 5796 (2020)

Topological theory of resilience and failure spreading in flow networks

Authors: Franz Kaiser, Dirk Witthaut

Abstract: Link failures in supply networks can have catastrophic consequences that can lead to a complete collapse of the network. Strategies to prevent failure spreading are thus heavily sought after. Here, we make use of a spanning tree formulation of link failures in linear flow networks to analyse topological structures that prevent failures spreading. In particular, we exploit a result obtained for res… ▽ More Link failures in supply networks can have catastrophic consequences that can lead to a complete collapse of the network. Strategies to prevent failure spreading are thus heavily sought after. Here, we make use of a spanning tree formulation of link failures in linear flow networks to analyse topological structures that prevent failures spreading. In particular, we exploit a result obtained for resistor networks based on the \textit{Matrix tree theorem} to analyse failure spreading after link failures in power grids. Using a spanning tree formulation of link failures, we analyse three strategies based on the network topology that allow to reduce the impact of single link failures. All our strategies do not reduce the grid's ability to transport flow or do in fact improve it - in contrast to traditional containment strategies based on lowering network connectivity. Our results also explain why certain connectivity features completely suppress any failure spreading as reported in recent publications. △ Less

Submitted 22 September, 2020; originally announced September 2020.

Comments: 9 pages, 5 figures,

Journal ref: Phys. Rev. Research 3, 023161 (2021)

Inhibiting failure spreading in complex networks

Authors: Franz Kaiser, Vito Latora, Dirk Witthaut

Abstract: In our daily lives, we rely on the proper functioning of supply networks, from power grids to water transmission systems. A single failure in these critical infrastructures can lead to a complete collapse through a cascading failure mechanism. Counteracting strategies are thus heavily sought after. In this article, we introduce a general framework to analyse the spreading of failures in complex ne… ▽ More In our daily lives, we rely on the proper functioning of supply networks, from power grids to water transmission systems. A single failure in these critical infrastructures can lead to a complete collapse through a cascading failure mechanism. Counteracting strategies are thus heavily sought after. In this article, we introduce a general framework to analyse the spreading of failures in complex networks and demonstrate that both weak and strong connections can be used to contain damages. We rigorously prove the existence of certain subgraphs, called network isolators, that can completely inhibit any failure spreading, and we show how to create such isolators in synthetic and real-world networks. The addition of selected links can thus prevent large scale outages as demonstrated for power transmission grids. △ Less

Submitted 7 September, 2020; originally announced September 2020.

Comments: 41 pages, 12 figures

Journal ref: Nature Communications 12, (2021) 3143

Open data base analysis of scaling and spatio-temporal properties of power grid frequencies

Authors: Leonardo Rydin Gorjão, Richard Jumar, Heiko Maass, Veit Hagenmeyer, G. Cigdem Yalcin, Johannes Kruse, Marc Timme, Christian Beck, Dirk Witthaut, Benjamin Schäfer

Abstract: The electrical energy system has attracted much attention from an increasingly diverse research community. Many theoretical predictions have been made, from scaling laws of fluctuations to propagation velocities of disturbances. However, to validate any theory, empirical data from large-scale power systems are necessary but are rarely shared openly. Here, we analyse an open data base of measuremen… ▽ More The electrical energy system has attracted much attention from an increasingly diverse research community. Many theoretical predictions have been made, from scaling laws of fluctuations to propagation velocities of disturbances. However, to validate any theory, empirical data from large-scale power systems are necessary but are rarely shared openly. Here, we analyse an open data base of measurements of electric power grid frequencies across 17 locations in 12 synchronous areas on three continents. The power grid frequency is of particular interest, as it indicates the balance of supply and demand and carries information on deterministic, stochastic, and control influences. We perform a broad analysis of the recorded data, compare different synchronous areas and validate a previously conjectured scaling law. Furthermore, we show how fluctuations change from local independent oscillations to a homogeneous bulk behaviour. Overall, the presented open data base and analyses constitute a step towards more shared, collaborative △ Less

Submitted 16 October, 2020; v1 submitted 3 June, 2020; originally announced June 2020.

Comments: 11 pages, 9 figures. Supplemental Material. Associated database: https://osf.io/by5hu/

Journal ref: Nat Commun 11, 6362 (2020)

Three stages in the co-transformation of the energy and mobility sector

Authors: Simon Morgenthaler, Justus Dünzen, Ingo Stadler, Dirk Witthaut

Abstract: Renewable electricity sources such as wind and solar have shown a remarkable development in terms of efficiency, costs and availability, but system integration still remains a challenge. Realizing a fully renewable electricity supply will require large scale storage technologies and flexible users to overcome long periods of low power generation. At the same time, other sectors such as mobility an… ▽ More Renewable electricity sources such as wind and solar have shown a remarkable development in terms of efficiency, costs and availability, but system integration still remains a challenge. Realizing a fully renewable electricity supply will require large scale storage technologies and flexible users to overcome long periods of low power generation. At the same time, other sectors such as mobility and industry must be electrified to replace fossil fuels. Power-to-Methane is a promising technology as it enables large-scale energy storage and sector coupling using existing infrastructures. In this work, we analyze the co-transformation of the German electricity, mobility and industry sector taking into account the recent decisions for coal phase out until 2038. We evaluate the necessary capacities of renewables and storage sizes as well as system costs and associated emissions using a techno-economic optimization model with a high technological and temporal resolution in the open source framework OSeMOSYS. We find three rather different stages of the transformation driven by the decreasing emission gap and the coal phase out. Solar power is expanded vastly until 2030, then coal is replaced mainly by fossil natural gas until 2040. Emission caps become very challenging afterwards such that all flexibility options are greatly expanded: Storage, curtailment and flexible Power-to-Methane. △ Less

Submitted 15 May, 2020; originally announced May 2020.

Predictability of Power Grid Frequency

Authors: Johannes Kruse, Benjamin Schäfer, Dirk Witthaut

Abstract: The power grid frequency is the central observable in power system control, as it measures the balance of electrical supply and demand. A reliable frequency forecast can facilitate rapid control actions and may thus greatly improve power system stability. Here, we develop a weighted-nearest-neighbor (WNN) predictor to investigate how predictable the frequency trajectories are. Our forecasts for up… ▽ More The power grid frequency is the central observable in power system control, as it measures the balance of electrical supply and demand. A reliable frequency forecast can facilitate rapid control actions and may thus greatly improve power system stability. Here, we develop a weighted-nearest-neighbor (WNN) predictor to investigate how predictable the frequency trajectories are. Our forecasts for up to one hour are more precise than averaged daily profiles and could increase the efficiency of frequency control actions. Furthermore, we gain an increased understanding of the specific properties of different synchronous areas by interpreting the optimal prediction parameters (number of nearest neighbors, the prediction horizon, etc.) in terms of the physical system. Finally, prediction errors indicate the occurrence of exceptional external perturbations. Overall, we provide a diagnostics tool and an accurate predictor of the power grid frequency time series, allowing better understanding of the underlying dynamics. △ Less

Submitted 17 April, 2020; originally announced April 2020.

Comments: 12 pages, 8 figures, Supplementary material on data preparation

Journal ref: IEEE Access, vol. 8, August 2020, pp. 149435-149446

Economic Viability and Infrastructure Requirements for the Electrification of Highway Traffic

Authors: Thiemo Pesch, Hans-Josef Allelein Dirk Müller, Dirk Witthaut

Abstract: Battery electric vehicles are rapidly entering the market. Their success offers great opportunities for the decarbonization of the transport sector, but also pose new challenges to energy infrastructures. Public charging stations must be built and power grids may become congested. In this article, we analyze the optimal layout and operation of charging systems along highways using a high-resolutio… ▽ More Battery electric vehicles are rapidly entering the market. Their success offers great opportunities for the decarbonization of the transport sector, but also pose new challenges to energy infrastructures. Public charging stations must be built and power grids may become congested. In this article, we analyze the optimal layout and operation of charging systems along highways using a high-resolution optimization model. We discuss the economic viability and identify potential roadblocks impeding a rapid build-up of electric mobility. We find that congestion of regional distribution grids becomes a serious issue already for a moderate market penetration of electric vehicles. While peak loads can be handled by battery electric storage systems, the grid connection fundamentally limits the total amount of cars that can be served per day. Our results further highlight the interdependency of different sectors and the importance of regional infrastructures during the transformation to a sustainable energy system. Given the long time period needed for the planning and realization of infrastructure measures, rapid decisions are imperative. △ Less

Submitted 20 February, 2020; originally announced February 2020.

Comments: 12 pages, 6 figures

Site-dependent levelized cost assessment for fully renewable Power-to-Methane systems

Authors: Simon Morgenthaler, Christopher Ball, Jan Koj, Wilhelm Kuckshinrichs, Dirk Witthaut

Abstract: The generation of synthetic natural gas from renewable electricity enables long-term energy storage and provides clean fuels for transportation. In this article, we analyze fully renewable Power-to-Methane systems using a high-resolution energy system optimization model applied to two regions within Europe. The optimum system layout and operation depend on the availability of natural resources, wh… ▽ More The generation of synthetic natural gas from renewable electricity enables long-term energy storage and provides clean fuels for transportation. In this article, we analyze fully renewable Power-to-Methane systems using a high-resolution energy system optimization model applied to two regions within Europe. The optimum system layout and operation depend on the availability of natural resources, which vary between locations and years. We find that much more wind than solar power is used, while the use of an intermediate battery electric storage system has little effects. The resulting levelized costs of methane vary between 0.24 and 0.30 Euro/kWh and the economic optimal utilization rate between 63% and 78%. We further discuss how the economic competitiveness of Power-to-Methane systems can be improved by the technical developments and by the use of co-products, such as oxygen and curtailed electricity. A sensitivity analysis reveals that the interest rate has the highest influence on levelized costs, followed by the investment costs for wind and electrolyzer stack. △ Less

Submitted 14 February, 2020; originally announced February 2020.

Comments: 15 pages, 11 figures

Reconstruction of Demand Shocks in Input-Output Networks

Authors: Chengyuan Han, Johannes Többen, Wilhelm Kuckshinrichs, Malte Schröder, Dirk Witthaut

Abstract: Input-Output analysis describes the dependence of production, demand and trade between sectors and regions and allows to understand the propagation of economic shocks through economic networks. A central challenge in practical applications is the availability of data. Observations may be limited to the impact of the shocks in few sectors, but a complete picture of the origin and impacts would be h… ▽ More Input-Output analysis describes the dependence of production, demand and trade between sectors and regions and allows to understand the propagation of economic shocks through economic networks. A central challenge in practical applications is the availability of data. Observations may be limited to the impact of the shocks in few sectors, but a complete picture of the origin and impacts would be highly desirable to guide political countermeasures. In this article we demonstrate that a shock in the final demand in few sectors can be fully reconstructed from limited observations of production changes. We adapt three algorithms from sparse signal recovery and evaluate their performance and their robustness to observation uncertainties. △ Less

Submitted 6 January, 2020; originally announced January 2020.

Comments: 10 pages, 4 figures, conference proceeding for CompleNet 2020

Stochastic properties of the frequency dynamics in real and synthetic power grids

Authors: Mehrnaz Anvari, Leonardo Rydin Gorjão, Marc Timme, Dirk Witthaut, Benjamin Schäfer, Holger Kantz

Abstract: The frequency constitutes a key state variable of electrical power grids. However, as the frequency is subject to several sources of fluctuations, ranging from renewable volatility to demand fluctuations and dispatch, it is strongly dynamic. Yet, the statistical and stochastic properties of the frequency fluctuation dynamics are far from fully understood. Here, we analyse properties of power grid… ▽ More The frequency constitutes a key state variable of electrical power grids. However, as the frequency is subject to several sources of fluctuations, ranging from renewable volatility to demand fluctuations and dispatch, it is strongly dynamic. Yet, the statistical and stochastic properties of the frequency fluctuation dynamics are far from fully understood. Here, we analyse properties of power grid frequency trajectories recorded from different synchronous regions. We highlight the non-Gaussian and still approximately Markovian nature of the frequency statistics. Further, we find that the frequency displays significant fluctuations exactly at the time intervals of regulation and trading, confirming the need of having a regulatory and market design that respects the technical and dynamical constraints in future highly renewable power grids. Finally, employing a recently proposed synthetic model for the frequency dynamics, we combine our statistical and stochastic analysis and analyse in how far dynamically modelled frequency properties match the ones of real trajectories. △ Less

Submitted 19 September, 2019; originally announced September 2019.

Journal ref: Phys. Rev. Research 2, 013339 (2020)

Data-driven model of the power-grid frequency dynamics

Authors: Leonardo Rydin Gorjão, Mehrnaz Anvari, Holger Kantz, Christian Beck, Dirk Witthaut, Marc Timme, Benjamin Schäfer

Abstract: The energy system is rapidly changing to accommodate the increasing number of renewable generators and the general transition towards a more sustainable future. Simultaneously, business models and market designs evolve, affecting power-grid operation and power-grid frequency. Problems raised by this ongoing transition are increasingly addressed by transdisciplinary research approaches, ranging fro… ▽ More The energy system is rapidly changing to accommodate the increasing number of renewable generators and the general transition towards a more sustainable future. Simultaneously, business models and market designs evolve, affecting power-grid operation and power-grid frequency. Problems raised by this ongoing transition are increasingly addressed by transdisciplinary research approaches, ranging from purely mathematical modelling to applied case studies. These approaches require a stochastic description of consumer behaviour, fluctuations by renewables, market rules, and how they influence the stability of the power-grid frequency. Here, we introduce an easy-to-use, data-driven, stochastic model for the power-grid frequency and demonstrate how it reproduces key characteristics of the observed statistics of the Continental European and British power grids. We offer executable code and guidelines on how to use the model on any power grid for various mathematical or engineering applications. △ Less

Submitted 2 October, 2019; v1 submitted 18 September, 2019; originally announced September 2019.

Comments: 14 pages, 10 figures, Supplemental Material with code

Collective effects of link failures in linear flow networks

Authors: Franz Kaiser, Julius Strake, Dirk Witthaut

Abstract: The smooth operation of supply networks is crucial for the proper functioning of many systems, ranging from biological organisms such as the human blood transport system or plant leaves to man-made systems such as power grids or gas pipelines. Whereas the failure of single transmission elements has been analysed thoroughly for power grids, the understanding of multiple failures is becoming more an… ▽ More The smooth operation of supply networks is crucial for the proper functioning of many systems, ranging from biological organisms such as the human blood transport system or plant leaves to man-made systems such as power grids or gas pipelines. Whereas the failure of single transmission elements has been analysed thoroughly for power grids, the understanding of multiple failures is becoming more and more important to prevent large scale outages with an increasing penetration of renewable energy sources. In this publication, we examine the collective nature of the simultaneous failure of several transmission elements. In particular, we focus on the difference between single transmission element failures and the collective failure of several elements. We demonstrate that already for two concurrent failures, the simultaneous outage can lead to an inversion of the direction of flow as compared to the two individual failures and find situations where additional outages may be beneficial for the overall system. In addition to that, we introduce a quantifier that performs very well in predicting if two outages act strongly collectively or may be treated as individual failures mathematically. Finally, we extend on recent progress made on the understanding of single link failures demonstrating that multiple link failures may be treated as superpositions of multiple electrical dipoles for lattice-like networks with collective effects completely vanishing in the continuum limit. Our results demonstrate that the simultaneous failure of multiple lines may lead to unexpected effects that cannot be easily described using the theoretical framework for single link failures. △ Less

Submitted 2 September, 2019; originally announced September 2019.

Comments: First two authors contributed equally, 16 pages, 8 figures

Dynamic stability of electric power grids: Tracking the interplay of the network structure, transmission losses and voltage dynamics

Authors: Philipp C. Böttcher, Dirk Witthaut, Leonardo Rydin Gorjão

Abstract: Dynamic stability is imperative for the operation of the electric power system. This article provides analytical results and effective stability criteria focusing on the interplay of network structures and the local dynamics of synchronous machines. The results are based on an extensive linear stability analysis of the third-order model for synchronous machines, comprising the classical power-swin… ▽ More Dynamic stability is imperative for the operation of the electric power system. This article provides analytical results and effective stability criteria focusing on the interplay of network structures and the local dynamics of synchronous machines. The results are based on an extensive linear stability analysis of the third-order model for synchronous machines, comprising the classical power-swing equations and the voltage dynamics. The article explicitly covers the impact of Ohmic losses in a linear approximation in power grids, which are often neglected in analytical studies. Necessary and sufficient stability conditions are formulated, and different routes to instability are analysed, yielding concrete mathematical criteria applicable to all scales of power grids, from transmission to distribution grids, as well as microgrids. A subsequent numerical study of the criteria is presented, without and with resistive terms, to test how tight the derived analytical results are. △ Less

Submitted 3 December, 2021; v1 submitted 27 August, 2019; originally announced August 2019.

Comments: 17 pages, 7 figures

Multistability in lossy power grids and oscillator networks

Authors: Chiara Balestra, Franz Kaiser, Debsankha Manik, Dirk Witthaut

Abstract: The stable operation of the electric power grid relies on a precisely synchronized state of all generators and machines. All machines rotate at exactly the same frequency with fixed phase differences, leading to steady power flows throughout the grid. Whether such a steady state exists for a given network is of eminent practical importance. The loss of a steady state typically leads to power outag… ▽ More The stable operation of the electric power grid relies on a precisely synchronized state of all generators and machines. All machines rotate at exactly the same frequency with fixed phase differences, leading to steady power flows throughout the grid. Whether such a steady state exists for a given network is of eminent practical importance. The loss of a steady state typically leads to power outages up to a complete blackout. But also the existence of multiple steady states is undesirable, as it can lead to sudden transitions, circulating flows and eventually also to power outages. Steady states are typically calculated numerically, but this approach gives only limited insight into the existence and (non-)uniqueness of steady states. Analytic results are available only for special network configuration, in particular for grids with negligible Ohmic losses or radial networks without any loops. In this article, we introduce a method to systematically construct the solutions of the real power load-flow equations in the presence of Ohmic losses. We calculate the steady states explicitly for elementary networks demonstrating different mechanisms leading to multistability. Our results also apply to models of coupled oscillators which are widely used in theoretical physics and mathematical biology. △ Less

Submitted 8 January, 2020; v1 submitted 27 August, 2019; originally announced August 2019.

Comments: This article may be downloaded for personal use only. Any other use requires prior permission of the author and AIP Publishing. The following article appeared in Chaos 29, 123119 (2019) and may be found at https://doi.org/10.1063/1.5122739

The winner takes it all -- How to win network globalization

Authors: Chengyuan Han, Dirk Witthaut, Marc Timme, Malte Schröder

Abstract: Quantifying the importance and power of individual nodes depending on their position in socio-economic networks constitutes a problem across a variety of applications. Examples include the reach of individuals in (online) social networks, the importance of individual banks or loans in financial networks, the relevance of individual companies in supply networks, and the role of traffic hubs in tran… ▽ More Quantifying the importance and power of individual nodes depending on their position in socio-economic networks constitutes a problem across a variety of applications. Examples include the reach of individuals in (online) social networks, the importance of individual banks or loans in financial networks, the relevance of individual companies in supply networks, and the role of traffic hubs in transport networks. Which features characterize the importance of a node in a trade network during the emergence of a globalized, connected market? Here we analyze a model that maps the evolution of trade networks to a percolation problem. In particular, we focus on the influence of topological features of the node within the trade network. Our results reveal that an advantageous position with respect to different length scales determines the success of a node at different stages of globalization and depending on the speed of globalization. △ Less

Submitted 14 June, 2019; originally announced June 2019.

Journal ref: PLoS ONE 14, e0225346 (2019)

Non-Local Impact of Link Failures in Linear Flow Networks

Authors: Julius Strake, Franz Kaiser, Farnaz Basiri, Henrik Ronellenfitsch, Dirk Witthaut

Abstract: The failure of a single link can degrade the operation of a supply network up to the point of complete collapse. Yet, the interplay between network topology and locality of the response to such damage is poorly understood. Here, we study how topology affects the redistribution of flow after the failure of a single link in linear flow networks with a special focus on power grids. In particular, we… ▽ More The failure of a single link can degrade the operation of a supply network up to the point of complete collapse. Yet, the interplay between network topology and locality of the response to such damage is poorly understood. Here, we study how topology affects the redistribution of flow after the failure of a single link in linear flow networks with a special focus on power grids. In particular, we analyze the decay of flow changes with distance after a link failure and map it to the field of an electrical dipole for lattice-like networks. The corresponding inverse-square law is shown to hold for all regular tilings. For sparse networks, a long-range response is found instead. In the case of more realistic topologies, we introduce a rerouting distance, which captures the decay of flow changes better than the traditional geodesic distance. Finally, we are able to derive rigorous bounds on the strength of the decay for arbitrary topologies that we verify through extensive numerical simulations. Our results show that it is possible to forecast flow rerouting after link failures to a large extent based on purely topological measures and that these effects generally decay with distance from the failing link. They might be used to predict links prone to failure in supply networks such as power grids and thus help to construct grids providing a more robust and reliable power supply. △ Less

Submitted 21 November, 2018; originally announced November 2018.

Comments: First two authors contributed equally, 17 pages, 9 figures

Wind Power Persistence Characterized by Superstatistics

Authors: Juliane Weber, Mark Reyers, Christian Beck, Marc Timme, Joaquim G. Pinto, Dirk Witthaut, Benjamin Schäfer

Abstract: Mitigating climate change demands a transition towards renewable electricity generation, with wind power being a particularly promising technology. Long periods either of high or of low wind therefore essentially define the necessary amount of storage to balance the power system. While the general statistics of wind velocities have been studied extensively, persistence (waiting) time statistics of… ▽ More Mitigating climate change demands a transition towards renewable electricity generation, with wind power being a particularly promising technology. Long periods either of high or of low wind therefore essentially define the necessary amount of storage to balance the power system. While the general statistics of wind velocities have been studied extensively, persistence (waiting) time statistics of wind is far from well understood. Here, we investigate the statistics of both high- and low-wind persistence. We find heavy tails and explain them as a superposition of different wind conditions, requiring $q$-exponential distributions instead of exponential distributions. Persistent wind conditions are not necessarily caused by stationary atmospheric circulation patterns nor by recurring individual weather types but may emerge as a combination of multiple weather types and circulation patterns. Understanding wind persistence statistically and synoptically, may help to ensure a reliable and economically feasible future energy system, which uses a high share of wind generation. △ Less

Submitted 6 January, 2020; v1 submitted 12 October, 2018; originally announced October 2018.

Comments: 15 pages, 8 figures, Supplemental Material available here: https://static-content.springer.com/esm/art%3A10.1038%2Fs41598-019-56286-1/MediaObjects/41598_2019_56286_MOESM1_ESM.pdf

Journal ref: Scientific Reports 9, 19971 (2019)

Counter-intuitive behaviour of energy system models under CO2 caps and prices

Authors: Juliane Weber, Heidi Ursula Heinrichs, Bastian Gillessen, Diana Schumann, Jonas Hörsch, Tom Brown, Dirk Witthaut

Abstract: The mitigation of climate change requires a fundamental transition of the energy system. Affordability, reliability and the reduction of greenhouse gas emissions constitute central but often conflicting targets for this energy transition. Against this context, we reveal limitations and counter-intuitive results in the model-based optimization of energy systems, which are often applied for policy a… ▽ More The mitigation of climate change requires a fundamental transition of the energy system. Affordability, reliability and the reduction of greenhouse gas emissions constitute central but often conflicting targets for this energy transition. Against this context, we reveal limitations and counter-intuitive results in the model-based optimization of energy systems, which are often applied for policy advice. When system costs are minimized in the presence of a CO2 cap, efficiency gains free a part of the CO2 cap, allowing cheap technologies to replace expensive low-emission technologies. Even more striking results are observed in a setup where emissions are minimized in the presence of a budget constraint. Increasing CO2 prices can oust clean, but expensive technologies out of the system, and eventually lead to higher emissions. These effects robustly occur in models of different scope and complexity. Hence, extreme care is necessary in the application of energy system optimization models to avoid misleading policy advice. △ Less

Submitted 10 September, 2018; originally announced September 2018.

Comments: 10 pages, 7 figures

Journal ref: Energy 179, 22-30 (2019)

Fluctuation-induced Distributed Resonances in Oscillatory Networks

Authors: Xiaozhu Zhang, Sarah Hallerberg, Moritz Matthiae, Dirk Witthaut, Marc Timme

Abstract: Self-organized network dynamics prevails for systems across physics, biology and engineering. How external signals generate distributed responses in networked systems fundamentally underlies their function, yet is far from fully understood. Here we analyze the dynamic response patterns of oscillatory networks to fluctuating input signals. We disentangle the impact of the signal distribution across… ▽ More Self-organized network dynamics prevails for systems across physics, biology and engineering. How external signals generate distributed responses in networked systems fundamentally underlies their function, yet is far from fully understood. Here we analyze the dynamic response patterns of oscillatory networks to fluctuating input signals. We disentangle the impact of the signal distribution across the network, the signals' frequency contents and the network topology. We analytically derive qualitatively different dynamic response patterns and find three frequency regimes: homogeneous responses at low frequencies, topology-dependent resonances at intermediate frequencies, and localized responses at high frequencies. The theory faithfully predicts the network-wide collective responses to regular and irregular, localized and distributed simulated signals, as well as to real input signals to power grids recorded from renewable-energy supplies. These results not only provide general insights into the formation of dynamic response patterns in networked systems but also suggest regime- and topology-specific design principles underlying network function. △ Less

Submitted 9 September, 2018; originally announced September 2018.

Comments: 7 pages, 4 figures

Journal ref: Science advances 5.7(2019): eaav1027