-
Wind Power Assessment based on Super-Resolution and Downscaling -- A Comparison of Deep Learning Methods
Authors:
Luca Schmidt,
Nicole Ludwig
Abstract:
The efficient placement of wind turbines relies on accurate local wind speed forecasts. Climate projections provide valuable insight into long-term wind speed conditions, yet their spatial data resolution is typically insufficient for precise wind power forecasts. Deep learning methods, particularly models developed for image super-resolution, offer a promising solution to bridge this scale gap by…
▽ More
The efficient placement of wind turbines relies on accurate local wind speed forecasts. Climate projections provide valuable insight into long-term wind speed conditions, yet their spatial data resolution is typically insufficient for precise wind power forecasts. Deep learning methods, particularly models developed for image super-resolution, offer a promising solution to bridge this scale gap by increasing the spatial resolution of climate models. In this paper, we compare the performance of various deep learning models on two distinct tasks: super-resolution, where we map artificially coarsened ERA5 data to its native resolution, and downscaling, where we map native ERA5 to high-resolution COSMO-REA6 data. We evaluate the models on their downstream application in forecasting long-term wind power, emphasizing the impact of spatial wind speed resolution on wind power estimates. Our findings highlight the importance of aligning models and evaluation metrics with their specific downstream applications. We show that a diffusion model outperforms other models for estimating the wind power potential by better preserving the wind speeds' distributional and physical properties.
△ Less
Submitted 11 July, 2024;
originally announced July 2024.
-
Quotient Modules of Finite Length and Their Relation to Fredholm Elements in Semiprime Rings
Authors:
Niklas Ludwig
Abstract:
B. A. Barnes introduced so-called Fredholm elements in a semiprime ring whose definition is inspired by Atkinson's theorem. Here the socle of a semiprime ring generalizes the ideal of finite-rank operators on a Banach space. In this paper, we aim to see that the algebraic concept of the length of a module is strongly related to that of Fredholm elements. This motivates another generalization of Fr…
▽ More
B. A. Barnes introduced so-called Fredholm elements in a semiprime ring whose definition is inspired by Atkinson's theorem. Here the socle of a semiprime ring generalizes the ideal of finite-rank operators on a Banach space. In this paper, we aim to see that the algebraic concept of the length of a module is strongly related to that of Fredholm elements. This motivates another generalization of Fredholm elements by requiring for an element $a\in\mathcal{A}$ that the $\mathcal{A}$-modules of the form $\mathcal{A}/\mathcal{A} a$ and $\mathcal{A}/a\mathcal{A}$ are of finite length. We are particularly interested in sufficient conditions for our generalized Fredholm elements to be Fredholm. In a unital C$^*$-algebra $\mathcal{A}$ we shall even see that an element $a\in\mathcal{A}$ is Fredholm if and only if the $\mathcal{A}$-modules $\mathcal{A}/\mathcal{A} a$ and $\mathcal{A}/a\mathcal{A}$ both have finite length.
△ Less
Submitted 25 April, 2024; v1 submitted 14 April, 2024;
originally announced April 2024.
-
Mind the (spectral) gap: How the temporal resolution of wind data affects multi-decadal wind power forecasts
Authors:
Nina Effenberger,
Nicole Ludwig,
Rachel H. White
Abstract:
To forecast wind power generation in the scale of years to decades, outputs from climate models are often used. However, one major limitation of the data projected by these models is their coarse temporal resolution - usually not finer than three hours and sometimes as coarse as one month. Due to the non-linear relationship between wind speed and wind power, and the long forecast horizon considere…
▽ More
To forecast wind power generation in the scale of years to decades, outputs from climate models are often used. However, one major limitation of the data projected by these models is their coarse temporal resolution - usually not finer than three hours and sometimes as coarse as one month. Due to the non-linear relationship between wind speed and wind power, and the long forecast horizon considered, small changes in wind speed can result in big changes in projected wind power generation. Our study indicates that the distribution of observed 10min wind speed data is relatively well preserved using three- or six-hourly instantaneous values. In contrast, daily or monthly values, as well as any averages, including three-hourly averages, are almost never capable of preserving the distribution of the underlying higher resolution data. Assuming that climate models behave in a similar manner to observations, our results indicate that output at three-hourly or six-hourly temporal resolution is high enough for multi-decadal wind power generation forecasting. In contrast, wind speed projections of lower temporal resolution, or averages over any time range, should be handled with care.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
Inductive biases in deep learning models for weather prediction
Authors:
Jannik Thuemmel,
Matthias Karlbauer,
Sebastian Otte,
Christiane Zarfl,
Georg Martius,
Nicole Ludwig,
Thomas Scholten,
Ulrich Friedrich,
Volker Wulfmeyer,
Bedartha Goswami,
Martin V. Butz
Abstract:
Deep learning has gained immense popularity in the Earth sciences as it enables us to formulate purely data-driven models of complex Earth system processes. Deep learning-based weather prediction (DLWP) models have made significant progress in the last few years, achieving forecast skills comparable to established numerical weather prediction models with comparatively lesser computational costs. I…
▽ More
Deep learning has gained immense popularity in the Earth sciences as it enables us to formulate purely data-driven models of complex Earth system processes. Deep learning-based weather prediction (DLWP) models have made significant progress in the last few years, achieving forecast skills comparable to established numerical weather prediction models with comparatively lesser computational costs. In order to train accurate, reliable, and tractable DLWP models with several millions of parameters, the model design needs to incorporate suitable inductive biases that encode structural assumptions about the data and the modelled processes. When chosen appropriately, these biases enable faster learning and better generalisation to unseen data. Although inductive biases play a crucial role in successful DLWP models, they are often not stated explicitly and their contribution to model performance remains unclear. Here, we review and analyse the inductive biases of state-of-the-art DLWP models with respect to five key design elements: data selection, learning objective, loss function, architecture, and optimisation method. We identify the most important inductive biases and highlight potential avenues towards more efficient and probabilistic DLWP models.
△ Less
Submitted 30 April, 2024; v1 submitted 6 April, 2023;
originally announced April 2023.
-
Analytical Uncertainty Propagation for Multi-Period Stochastic Optimal Power Flow
Authors:
Rebecca Bauer,
Tillmann Mühlpfordt,
Nicole Ludwig,
Veit Hagenmeyer
Abstract:
The increase in renewable energy sources (RESs), like wind or solar power, results in growinguncertainty also in transmission grids. This affects grid stability through fluctuating energy supplyand an increased probability of overloaded lines. One key strategy to cope with this uncertainty isthe use of distributed energy storage systems (ESSs). In order to securely operate power systemscontaining…
▽ More
The increase in renewable energy sources (RESs), like wind or solar power, results in growinguncertainty also in transmission grids. This affects grid stability through fluctuating energy supplyand an increased probability of overloaded lines. One key strategy to cope with this uncertainty isthe use of distributed energy storage systems (ESSs). In order to securely operate power systemscontaining renewables and use storage, optimization models are needed that both handle uncertaintyand apply ESSs. This paper introduces a compact dynamic stochastic chance-constrained DC optimalpower flow (CC-OPF) model, that minimizes generation costs and includes distributed ESSs. AssumingGaussian uncertainty, we use affine policies to obtain a tractable, analytically exact reformulation asa second-order cone problem (SOCP). We test the new model on five different IEEE networks withvarying sizes of 5, 39, 57, 118 and 300 nodes and include complexity analysis. The results showthat the model is computationally efficient and robust with respect to constraint violation risk. Thedistributed energy storage system leads to more stable operation with flattened generation profiles.Storage absorbed RES uncertainty, and reduced generation cost.
△ Less
Submitted 6 December, 2022;
originally announced December 2022.
-
Analytical Uncertainty Propagation for Multi-Period Stochastic Optimal Power Flow
Authors:
Rebecca Bauer,
Tillmann Mühlpfordt,
Nicole Ludwig,
Veit Hagenmeyer
Abstract:
The increase in renewable energy sources (RESs), like wind or solar power, results in growing uncertainty also in transmission grids. This affects grid stability through fluctuating energy supply and an increased probability of overloaded lines. One key strategy to cope with this uncertainty is the use of distributed energy storage systems (ESSs). In order to securely operate power systems contain…
▽ More
The increase in renewable energy sources (RESs), like wind or solar power, results in growing uncertainty also in transmission grids. This affects grid stability through fluctuating energy supply and an increased probability of overloaded lines. One key strategy to cope with this uncertainty is the use of distributed energy storage systems (ESSs). In order to securely operate power systems containing renewables and use storage, optimization models are needed that both handle uncertainty and apply ESSs. This paper introduces a compact dynamic stochastic chance-constrained optimal power flow (CC-OPF) model, that minimizes generation costs and includes distributed ESSs. Assuming Gaussian uncertainty, we use affine policies to obtain a tractable, analytically exact reformulation as a second-order cone problem (SOCP). We test the new model on five different IEEE networks with varying sizes of 5, 39, 57, 118 and 300 nodes and include complexity analysis. The results show that the model is computationally efficient and robust with respect to constraint violation risk. The distributed energy storage system leads to more stable operation with flattened generation profiles. Storage absorbed RES uncertainty, and reduced generation cost.
△ Less
Submitted 12 April, 2022;
originally announced April 2022.
-
A Collection and Categorization of Open-Source Wind and Wind Power Datasets
Authors:
Nina Effenberger,
Nicole Ludwig
Abstract:
Wind power and other forms of renewable energy sources play an ever more important role in the energy supply of today's power grids. Forecasting renewable energy sources has therefore become essential in balancing the power grid. While a lot of focus is placed on new forecasting methods, little attention is given on how to compare, reproduce and transfer the methods to other use cases and data. On…
▽ More
Wind power and other forms of renewable energy sources play an ever more important role in the energy supply of today's power grids. Forecasting renewable energy sources has therefore become essential in balancing the power grid. While a lot of focus is placed on new forecasting methods, little attention is given on how to compare, reproduce and transfer the methods to other use cases and data. One reason for this lack of attention is the limited availability of open-source datasets, as many currently used datasets are non-disclosed and make reproducibility of research impossible. This unavailability of open-source datasets is especially prevalent in commercially interesting fields such as wind power forecasting. However, with this paper we want to enable researchers to compare their methods on publicly available datasets by providing the, to our knowledge, largest up-to-date overview of existing open-source wind power datasets, and a categorization into different groups of datasets that can be used for wind power forecasting. We show that there are publicly available datasets sufficient for wind power forecasting tasks and discuss the different data groups properties to enable researchers to choose appropriate open-source datasets and compare their methods on them.
△ Less
Submitted 17 February, 2022;
originally announced February 2022.
-
Smart Data Representations: Impact on the Accuracy of Deep Neural Networks
Authors:
Oliver Neumann,
Nicole Ludwig,
Marian Turowski,
Benedikt Heidrich,
Veit Hagenmeyer,
Ralf Mikut
Abstract:
Deep Neural Networks are able to solve many complex tasks with less engineering effort and better performance. However, these networks often use data for training and evaluation without investigating its representation, i.e.~the form of the used data. In the present paper, we analyze the impact of data representations on the performance of Deep Neural Networks using energy time series forecasting.…
▽ More
Deep Neural Networks are able to solve many complex tasks with less engineering effort and better performance. However, these networks often use data for training and evaluation without investigating its representation, i.e.~the form of the used data. In the present paper, we analyze the impact of data representations on the performance of Deep Neural Networks using energy time series forecasting. Based on an overview of exemplary data representations, we select four exemplary data representations and evaluate them using two different Deep Neural Network architectures and three forecasting horizons on real-world energy time series. The results show that, depending on the forecast horizon, the same data representations can have a positive or negative impact on the accuracy of Deep Neural Networks.
△ Less
Submitted 17 November, 2021;
originally announced November 2021.
-
pyWATTS: Python Workflow Automation Tool for Time Series
Authors:
Benedikt Heidrich,
Andreas Bartschat,
Marian Turowski,
Oliver Neumann,
Kaleb Phipps,
Stefan Meisenbacher,
Kai Schmieder,
Nicole Ludwig,
Ralf Mikut,
Veit Hagenmeyer
Abstract:
Time series data are fundamental for a variety of applications, ranging from financial markets to energy systems. Due to their importance, the number and complexity of tools and methods used for time series analysis is constantly increasing. However, due to unclear APIs and a lack of documentation, researchers struggle to integrate them into their research projects and replicate results. Additiona…
▽ More
Time series data are fundamental for a variety of applications, ranging from financial markets to energy systems. Due to their importance, the number and complexity of tools and methods used for time series analysis is constantly increasing. However, due to unclear APIs and a lack of documentation, researchers struggle to integrate them into their research projects and replicate results. Additionally, in time series analysis there exist many repetitive tasks, which are often re-implemented for each project, unnecessarily costing time. To solve these problems we present \texttt{pyWATTS}, an open-source Python-based package that is a non-sequential workflow automation tool for the analysis of time series data. pyWATTS includes modules with clearly defined interfaces to enable seamless integration of new or existing methods, subpipelining to easily reproduce repetitive tasks, load and save functionality to simply replicate results, and native support for key Python machine learning libraries such as scikit-learn, PyTorch, and Keras.
△ Less
Submitted 18 June, 2021;
originally announced June 2021.
-
Evaluating Ensemble Post-Processing for Wind Power Forecasts
Authors:
Kaleb Phipps,
Sebastian Lerch,
Maria Andersson,
Ralf Mikut,
Veit Hagenmeyer,
Nicole Ludwig
Abstract:
Capturing the uncertainty in probabilistic wind power forecasts is challenging, especially when uncertain input variables, such as the weather, play a role. Since ensemble weather predictions aim to capture the uncertainty in the weather system, they can be used to propagate this uncertainty through to subsequent wind power forecasting models. However, as weather ensemble systems are known to be b…
▽ More
Capturing the uncertainty in probabilistic wind power forecasts is challenging, especially when uncertain input variables, such as the weather, play a role. Since ensemble weather predictions aim to capture the uncertainty in the weather system, they can be used to propagate this uncertainty through to subsequent wind power forecasting models. However, as weather ensemble systems are known to be biased and underdispersed, meteorologists post-process the ensembles. This post-processing can successfully correct the biases in the weather variables but has not been evaluated thoroughly in the context of subsequent forecasts, such as wind power generation forecasts. The present paper evaluates multiple strategies for applying ensemble post-processing to probabilistic wind power forecasts. We use Ensemble Model Output Statistics (EMOS) as the post-processing method and evaluate four possible strategies: only using the raw ensembles without post-processing, a one-step strategy where only the weather ensembles are post-processed, a one-step strategy where we only post-process the power ensembles, and a two-step strategy where we post-process both the weather and power ensembles. Results show that post-processing the final wind power ensemble improves forecast performance regarding both calibration and sharpness, whilst only post-processing the weather ensembles does not necessarily lead to increased forecast performance.
△ Less
Submitted 25 April, 2022; v1 submitted 29 September, 2020;
originally announced September 2020.
-
Nucleation and shape dynamics of model nematic tactoids around adhesive colloids
Authors:
Nicholas B. Ludwig,
Kimberly Weirich,
Eli Alster,
Thomas A. Witten,
Margaret L. Gardel,
Kinjal Dasbiswas,
Suriyanarayanan Vaikuntanathan
Abstract:
Recent experiments have shown how nematically-ordered tactoid shaped actin droplets can be reorganized and divided by the action of myosin molecular motors. In this paper, we consider how similar morphological changes can potentially be achieved under equilibrium conditions. Using simulations, both atomistic and continuum, and a phenomenological model, we explore how the nucleation dynamics, shape…
▽ More
Recent experiments have shown how nematically-ordered tactoid shaped actin droplets can be reorganized and divided by the action of myosin molecular motors. In this paper, we consider how similar morphological changes can potentially be achieved under equilibrium conditions. Using simulations, both atomistic and continuum, and a phenomenological model, we explore how the nucleation dynamics, shape changes, and the final steady state of a nematic tactoid droplet can be modified by interactions with model adhesive colloids that mimic a myosin motor cluster. Our results provide a prescription for the minimal conditions required to stabilize tactoid reorganization and division in an equilibrium colloidal-nematic setting.
△ Less
Submitted 8 September, 2019;
originally announced September 2019.
-
Describing screening in dense ionic fluids with a charge-frustrated Ising model
Authors:
Nicholas B. Ludwig,
Kinjal Dasbiswas,
Dmitri V. Talapin,
Suriyanarayanan Vaikuntanathan
Abstract:
Charge correlations in dense ionic fluids give rise to novel effects such as long-range screening and colloidal stabilization which are not predicted by the classic Debye-Huckel theory. We show that a Coulomb or charge-frustrated Ising model, which accounts for both long-range Coulomb and short-range molecular interactions, simply describes some of these ionic correlations. In particular, we obtai…
▽ More
Charge correlations in dense ionic fluids give rise to novel effects such as long-range screening and colloidal stabilization which are not predicted by the classic Debye-Huckel theory. We show that a Coulomb or charge-frustrated Ising model, which accounts for both long-range Coulomb and short-range molecular interactions, simply describes some of these ionic correlations. In particular, we obtain at mean field level and in simulations, a non-monotonic dependence of the screening length on the temperature. Using a combination of simulations and mean field theories, we study how the correlations in the various regimes are affected by the strength of the short ranged interactions.
△ Less
Submitted 30 October, 2018; v1 submitted 1 October, 2018;
originally announced October 2018.
