-
Distributional neural networks for electricity price forecasting
Authors:
Grzegorz Marcjasz,
Michał Narajewski,
Rafał Weron,
Florian Ziel
Abstract:
We present a novel approach to probabilistic electricity price forecasting which utilizes distributional neural networks. The model structure is based on a deep neural network that contains a so-called probability layer. The network's output is a parametric distribution with 2 (normal) or 4 (Johnson's SU) parameters. In a forecasting study involving day-ahead electricity prices in the German marke…
▽ More
We present a novel approach to probabilistic electricity price forecasting which utilizes distributional neural networks. The model structure is based on a deep neural network that contains a so-called probability layer. The network's output is a parametric distribution with 2 (normal) or 4 (Johnson's SU) parameters. In a forecasting study involving day-ahead electricity prices in the German market, our approach significantly outperforms state-of-the-art benchmarks, including LASSO-estimated regressions and deep neural networks combined with Quantile Regression Averaging. The obtained results not only emphasize the importance of higher moments when modeling volatile electricity prices, but also -- given that probabilistic forecasting is the essence of risk management -- provide important implications for managing portfolios in the power sector.
△ Less
Submitted 10 December, 2022; v1 submitted 6 July, 2022;
originally announced July 2022.
-
Electricity Price Forecasting: The Dawn of Machine Learning
Authors:
Arkadiusz Jędrzejewski,
Jesus Lago,
Grzegorz Marcjasz,
Rafał Weron
Abstract:
Electricity price forecasting (EPF) is a branch of forecasting on the interface of electrical engineering, statistics, computer science, and finance, which focuses on predicting prices in wholesale electricity markets for a whole spectrum of horizons. These range from a few minutes (real-time/intraday auctions and continuous trading), through days (day-ahead auctions), to weeks, months or even yea…
▽ More
Electricity price forecasting (EPF) is a branch of forecasting on the interface of electrical engineering, statistics, computer science, and finance, which focuses on predicting prices in wholesale electricity markets for a whole spectrum of horizons. These range from a few minutes (real-time/intraday auctions and continuous trading), through days (day-ahead auctions), to weeks, months or even years (exchange and over-the-counter traded futures and forward contracts). Over the last 25 years, various methods and computational tools have been applied to intraday and day-ahead EPF. Until the early 2010s, the field was dominated by relatively small linear regression models and (artificial) neural networks, typically with no more than two dozen inputs. As time passed, more data and more computational power became available. The models grew larger to the extent where expert knowledge was no longer enough to manage the complex structures. This, in turn, led to the introduction of machine learning (ML) techniques in this rapidly develo** and fascinating area. Here, we provide an overview of the main trends and EPF models as of 2022.
△ Less
Submitted 2 April, 2022;
originally announced April 2022.
-
Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx
Authors:
Kin G. Olivares,
Cristian Challu,
Grzegorz Marcjasz,
Rafał Weron,
Artur Dubrawski
Abstract:
We extend the neural basis expansion analysis (NBEATS) to incorporate exogenous factors. The resulting method, called NBEATSx, improves on a well performing deep learning model, extending its capabilities by including exogenous variables and allowing it to integrate multiple sources of useful information. To showcase the utility of the NBEATSx model, we conduct a comprehensive study of its applica…
▽ More
We extend the neural basis expansion analysis (NBEATS) to incorporate exogenous factors. The resulting method, called NBEATSx, improves on a well performing deep learning model, extending its capabilities by including exogenous variables and allowing it to integrate multiple sources of useful information. To showcase the utility of the NBEATSx model, we conduct a comprehensive study of its application to electricity price forecasting (EPF) tasks across a broad range of years and markets. We observe state-of-the-art performance, significantly improving the forecast accuracy by nearly 20% over the original NBEATS model, and by up to 5% over other well established statistical and machine learning methods specialized for these tasks. Additionally, the proposed neural network has an interpretable configuration that can structurally decompose time series, visualizing the relative impact of trend and seasonal components and revealing the modeled processes' interactions with exogenous factors. To assist related work we made the code available in https://github.com/cchallu/nbeatsx.
△ Less
Submitted 4 April, 2022; v1 submitted 12 April, 2021;
originally announced April 2021.
-
Neural networks in day-ahead electricity price forecasting: Single vs. multiple outputs
Authors:
Grzegorz Marcjasz,
Jesus Lago,
Rafał Weron
Abstract:
Recent advancements in the fields of artificial intelligence and machine learning methods resulted in a significant increase of their popularity in the literature, including electricity price forecasting. Said methods cover a very broad spectrum, from decision trees, through random forests to various artificial neural network models and hybrid approaches. In electricity price forecasting, neural n…
▽ More
Recent advancements in the fields of artificial intelligence and machine learning methods resulted in a significant increase of their popularity in the literature, including electricity price forecasting. Said methods cover a very broad spectrum, from decision trees, through random forests to various artificial neural network models and hybrid approaches. In electricity price forecasting, neural networks are the most popular machine learning method as they provide a non-linear counterpart for well-tested linear regression models. Their application, however, is not straightforward, with multiple implementation factors to consider. One of such factors is the network's structure. This paper provides a comprehensive comparison of two most common structures when using the deep neural networks -- one that focuses on each hour of the day separately, and one that reflects the daily auction structure and models vectors of the prices. The results show a significant accuracy advantage of using the latter, confirmed on data from five distinct power exchanges.
△ Less
Submitted 18 August, 2020;
originally announced August 2020.
-
Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark
Authors:
Jesus Lago,
Grzegorz Marcjasz,
Bart De Schutter,
Rafał Weron
Abstract:
While the field of electricity price forecasting has benefited from plenty of contributions in the last two decades, it arguably lacks a rigorous approach to evaluating new predictive algorithms. The latter are often compared using unique, not publicly available datasets and across too short and limited to one market test samples. The proposed new methods are rarely benchmarked against well establ…
▽ More
While the field of electricity price forecasting has benefited from plenty of contributions in the last two decades, it arguably lacks a rigorous approach to evaluating new predictive algorithms. The latter are often compared using unique, not publicly available datasets and across too short and limited to one market test samples. The proposed new methods are rarely benchmarked against well established and well performing simpler models, the accuracy metrics are sometimes inadequate and testing the significance of differences in predictive performance is seldom conducted. Consequently, it is not clear which methods perform well nor what are the best practices when forecasting electricity prices. In this paper, we tackle these issues by performing a literature survey of state-of-the-art models, comparing state-of-the-art statistical and deep learning methods across multiple years and markets, and by putting forward a set of best practices. In addition, we make available the considered datasets, forecasts of the state-of-the-art models, and a specifically designed python toolbox, so that new algorithms can be rigorously evaluated in future studies.
△ Less
Submitted 21 December, 2020; v1 submitted 18 August, 2020;
originally announced August 2020.
-
Think then act or act then think?
Authors:
Arkadiusz Jędrzejewski,
Grzegorz Marcjasz,
Paul R. Nail,
Katarzyna Sznajd-Weron
Abstract:
We introduce a new agent-based model of opinion dynamics in which binary opinions (yes/no) of each agent can be measured and described regarding both pre- and post-influence at both of two levels, public and private, vis-à-vis the influence source. The model combines ideas introduced within the $q$-voter model with noise, proposed by physicists, with the descriptive, four-dimensional model of soci…
▽ More
We introduce a new agent-based model of opinion dynamics in which binary opinions (yes/no) of each agent can be measured and described regarding both pre- and post-influence at both of two levels, public and private, vis-à-vis the influence source. The model combines ideas introduced within the $q$-voter model with noise, proposed by physicists, with the descriptive, four-dimensional model of social response, formulated by social psychologists. We investigate two versions of the same model that differ only by the updating order: an opinion on the public level is updated before an opinion on the private level or vice versa. We show how the results on the macroscopic scale depend on this order. The main finding of this paper is that both models produce the same outcome if one looks only at such a macroscopic variable as the total number of the individuals with positive opinions. However, if also the level of internal harmony (viz., dissonance) is measured, then significant, qualitative differences are seen between these two versions of the model. All results were obtained simultaneously within Monte Carlo simulations and analytical calculations. We discuss the importance of our studies and findings from three points of view: the theory of phase transitions, agent-based modeling of social systems, and social psychology.
△ Less
Submitted 27 October, 2018; v1 submitted 28 June, 2018;
originally announced June 2018.
