-
Skillful Precipitation Nowcasting using Deep Generative Models of Radar
Authors:
Suman Ravuri,
Karel Lenc,
Matthew Willson,
Dmitry Kangin,
Remi Lam,
Piotr Mirowski,
Megan Fitzsimons,
Maria Athanassiadou,
Sheleem Kashem,
Sam Madge,
Rachel Prudden,
Amol Mandhane,
Aidan Clark,
Andrew Brock,
Karen Simonyan,
Raia Hadsell,
Niall Robinson,
Ellen Clancy,
Alberto Arribas,
Shakir Mohamed
Abstract:
Precipitation nowcasting, the high-resolution forecasting of precipitation up to two hours ahead, supports the real-world socio-economic needs of many sectors reliant on weather-dependent decision-making. State-of-the-art operational nowcasting methods typically advect precipitation fields with radar-based wind estimates, and struggle to capture important non-linear events such as convective initi…
▽ More
Precipitation nowcasting, the high-resolution forecasting of precipitation up to two hours ahead, supports the real-world socio-economic needs of many sectors reliant on weather-dependent decision-making. State-of-the-art operational nowcasting methods typically advect precipitation fields with radar-based wind estimates, and struggle to capture important non-linear events such as convective initiations. Recently introduced deep learning methods use radar to directly predict future rain rates, free of physical constraints. While they accurately predict low-intensity rainfall, their operational utility is limited because their lack of constraints produces blurry nowcasts at longer lead times, yielding poor performance on more rare medium-to-heavy rain events. To address these challenges, we present a Deep Generative Model for the probabilistic nowcasting of precipitation from radar. Our model produces realistic and spatio-temporally consistent predictions over regions up to 1536 km x 1280 km and with lead times from 5-90 min ahead. In a systematic evaluation by more than fifty expert forecasters from the Met Office, our generative model ranked first for its accuracy and usefulness in 88% of cases against two competitive methods, demonstrating its decision-making value and ability to provide physical insight to real-world experts. When verified quantitatively, these nowcasts are skillful without resorting to blurring. We show that generative nowcasting can provide probabilistic predictions that improve forecast value and support operational utility, and at resolutions and lead times where alternative methods struggle.
△ Less
Submitted 2 April, 2021;
originally announced April 2021.
-
A review of radar-based nowcasting of precipitation and applicable machine learning techniques
Authors:
Rachel Prudden,
Samantha Adams,
Dmitry Kangin,
Niall Robinson,
Suman Ravuri,
Shakir Mohamed,
Alberto Arribas
Abstract:
A 'nowcast' is a type of weather forecast which makes predictions in the very short term, typically less than two hours - a period in which traditional numerical weather prediction can be limited. This type of weather prediction has important applications for commercial aviation; public and outdoor events; and the construction industry, power utilities, and ground transportation services that cond…
▽ More
A 'nowcast' is a type of weather forecast which makes predictions in the very short term, typically less than two hours - a period in which traditional numerical weather prediction can be limited. This type of weather prediction has important applications for commercial aviation; public and outdoor events; and the construction industry, power utilities, and ground transportation services that conduct much of their work outdoors. Importantly, one of the key needs for nowcasting systems is in the provision of accurate warnings of adverse weather events, such as heavy rain and flooding, for the protection of life and property in such situations. Typical nowcasting approaches are based on simple extrapolation models applied to observations, primarily rainfall radar. In this paper we review existing techniques to radar-based nowcasting from environmental sciences, as well as the statistical approaches that are applicable from the field of machine learning. Nowcasting continues to be an important component of operational systems and we believe new advances are possible with new partnerships between the environmental science and machine learning communities.
△ Less
Submitted 11 May, 2020;
originally announced May 2020.
-
What is next for National Meteorological Services?
Authors:
Alberto Arribas,
Nial H. Robinson,
Phil Evans
Abstract:
Weather prediction is one of the greatest scientific and technical successes of the last century. Today, National Meteorological Services routinely produce forecasts that have a major positive impact across society and many economic sectors. This success has been intrinsically linked to improvements in supercomputing which has increased various orders of magnitude following Moores Law, enabling un…
▽ More
Weather prediction is one of the greatest scientific and technical successes of the last century. Today, National Meteorological Services routinely produce forecasts that have a major positive impact across society and many economic sectors. This success has been intrinsically linked to improvements in supercomputing which has increased various orders of magnitude following Moores Law, enabling underpinning increases in model complexity and resolution. However, there are good reasons to believe that we may have reached the end of this particular road. The combination of technological discontinuities and contextual changes mean that NMS are facing the highest level of uncertainty and change in many decades. This brings new organisational challenges, altering existing power and social structures within NMS. Analysis from other industries that have faced similar transformations in the past show that the period of change we are entering could be as long as thirty years and that there is a substantial risk that the foundations of the weather industry could be altered significantly. Therefore, NMS need to use their resources not only to make best use of the diminishing improvements available within the current technology trajectory but to simultaneously innovate in new technologies to ensure they can generate value in the future. This paper analyses the strategic options available to National Meteorological Services.
△ Less
Submitted 4 May, 2020;
originally announced May 2020.
-
Computing the symmetries of a ruled rational surface
Authors:
Alcázar Arribas,
Juan Gerardo,
Emily Quintero
Abstract:
We present a method for computing all the symmetries of a rational ruled surface defined by a rational parametrization which works directly in parametric rational form, i.e. without computing or making use of the implicit equation of the surface. The method proceeds by translating the problem into the parameter space, and relies on polynomial system solving. If we want all the symmetries of the su…
▽ More
We present a method for computing all the symmetries of a rational ruled surface defined by a rational parametrization which works directly in parametric rational form, i.e. without computing or making use of the implicit equation of the surface. The method proceeds by translating the problem into the parameter space, and relies on polynomial system solving. If we want all the symmetries of the surface, including rotational symmetries, we need to deal with polynomial systems in four variables; if we are only interested in involutions (e.g. central symmetries, axial symmetries, reflections in a plane), we can come down to bivariate polynomial systems. An application to compute symmetries of an implicit algebraic surface under certain conditions is also provided.
△ Less
Submitted 26 June, 2018;
originally announced June 2018.
-
A Practical Approach to Spatiotemporal Data Compression
Authors:
Niall H. Robinson,
Rachel Prudden,
Alberto Arribas
Abstract:
Datasets representing the world around us are becoming ever more unwieldy as data volumes grow. This is largely due to increased measurement and modelling resolution, but the problem is often exacerbated when data are stored at spuriously high precisions. In an effort to facilitate analysis of these datasets, computationally intensive calculations are increasingly being performed on specialised re…
▽ More
Datasets representing the world around us are becoming ever more unwieldy as data volumes grow. This is largely due to increased measurement and modelling resolution, but the problem is often exacerbated when data are stored at spuriously high precisions. In an effort to facilitate analysis of these datasets, computationally intensive calculations are increasingly being performed on specialised remote servers before the reduced data are transferred to the consumer. Due to bandwidth limitations, this often means data are displayed as simple 2D data visualisations, such as scatter plots or images. We present here a novel way to efficiently encode and transmit 4D data fields on-demand so that they can be locally visualised and interrogated. This nascent "4D video" format allows us to more flexibly move the boundary between data server and consumer client. However, it has applications beyond purely scientific visualisation, in the transmission of data to virtual and augmented reality.
△ Less
Submitted 27 April, 2016; v1 submitted 13 April, 2016;
originally announced April 2016.
-
A Bayesian framework for verification and recalibration of ensemble forecasts: How uncertain is NAO predictability?
Authors:
Stefan Siegert,
David B. Stephenson,
Philip G. Sansom,
Adam A. Scaife,
Rosie Eade,
Alberto Arribas
Abstract:
Predictability estimates of ensemble prediction systems are uncertain due to limited numbers of past forecasts and observations. To account for such uncertainty, this paper proposes a Bayesian inferential framework that provides a simple 6-parameter representation of ensemble forecasting systems and the corresponding observations. The framework is probabilistic, and thus allows for quantifying unc…
▽ More
Predictability estimates of ensemble prediction systems are uncertain due to limited numbers of past forecasts and observations. To account for such uncertainty, this paper proposes a Bayesian inferential framework that provides a simple 6-parameter representation of ensemble forecasting systems and the corresponding observations. The framework is probabilistic, and thus allows for quantifying uncertainty in predictability measures such as correlation skill and signal-to-noise ratios. It also provides a natural way to produce recalibrated probabilistic predictions from uncalibrated ensembles forecasts. The framework is used to address important questions concerning the skill of winter hindcasts of the North Atlantic Oscillation for 1992-2011 issued by the Met Office GloSea5 climate prediction system. Although there is much uncertainty in the correlation between ensemble mean and observations, there is strong evidence of skill: the 95% credible interval of the correlation coefficient of [0.19,0.68] does not overlap zero. There is also strong evidence that the forecasts are not exchangeable with the observations: With over 99% certainty, the signal-to-noise ratio of the forecasts is smaller than the signal-to-noise ratio of the observations, which suggests that raw forecasts should not be taken as representative scenarios of the observations. Forecast recalibration is thus required, which can be coherently addressed within the proposed framework.
△ Less
Submitted 22 September, 2015; v1 submitted 8 April, 2015;
originally announced April 2015.
