-
Spatial verification of high-resolution ensemble precipitation forecasts using local wavelet spectra
Authors:
Florian Kapp,
Petra Friederichs,
Sebastian Brune,
Michael Weniger
Abstract:
The purpose of this study is to perform verification of the structural characteristics of high-resolution spatial forecasts without relying on an object identification algorithm. To this end, a wavelet approach developed for image texture analysis is applied to an ensemble of high-resolution quantitative precipitation forecasts. The forecasts are verified against estimates from a high-resolution r…
▽ More
The purpose of this study is to perform verification of the structural characteristics of high-resolution spatial forecasts without relying on an object identification algorithm. To this end, a wavelet approach developed for image texture analysis is applied to an ensemble of high-resolution quantitative precipitation forecasts. The forecasts are verified against estimates from a high-resolution regional reanalysis with a similar model version. The wavelet approach estimates an averaged wavelet spectrum for each spatial field of the ensemble forecasts and the reanalysis, thereby removing all information on the localization of precipitation and investigating solely the overall structure of forecasts and reanalysis. In order to assess skill using a multivariate score, an additional reduction of dimensionality is needed. This is performed using singular vectors from a linear discriminant analysis as it favors data compression in the direction where the ensemble is most discriminating. We discuss implications of this strategy, show that the averaged wavelet spectra give valuable information on forecast performance. The skill difference between a so-called perfect forecast using for verification a member of the ensemble, and the non-perfect forecast using the reanalysis points to significant deficiencies of the forecast ensemble. Overall, the discriminating power solely based on global spectral information is remarkable, and the COSMO-DE-EPS is a quite good forecast ensemble with respect to the reanalysis.
△ Less
Submitted 23 August, 2018;
originally announced August 2018.
-
Local dimension and recurrent circulation patterns in long-term climate simulations
Authors:
Sebastian Buschow,
Petra Friederichs
Abstract:
With the recent advent of a sound mathematical theory for extreme events in dynamical systems, new ways of analyzing a system's inherent properties have become available: Studying only the probabilities of extremely close Poincaré recurrences, we can infer the underlying attractor's local dimensionality -- a quantity which is closely linked to the predictability of individual configurations, as we…
▽ More
With the recent advent of a sound mathematical theory for extreme events in dynamical systems, new ways of analyzing a system's inherent properties have become available: Studying only the probabilities of extremely close Poincaré recurrences, we can infer the underlying attractor's local dimensionality -- a quantity which is closely linked to the predictability of individual configurations, as well as the information gained from observing them. This study examines possible ways of estimating local and global attractor dimensions, identifies potential pitfalls and discusses conceivable applications. The Portable University Model of the Atmosphere (PUMA) serves a test subject of intermediate complexity between simple mathematical toys and truly realistic atmospheric data-sets. It is demonstrated that the introduction of a simple, analytical estimator can streamline the procedure and allows for additional tests of the agreement between theoretical expectation and observed data. We furthermore show how the newly gained knowledge about local dimensions can complement classical techniques like principal component analysis and may assist in separating meaningful patterns from mathematical artifacts.
△ Less
Submitted 7 January, 2019; v1 submitted 28 March, 2018;
originally announced March 2018.
-
Estimating space-time trend and dependence of heavy rainfall
Authors:
Ana Ferreira,
Petra Friederichs,
Laurens de Haan,
Cláudia Neves,
Martin Schlather
Abstract:
A new approach for evaluating time-trends in extreme values accounting also for spatial dependence is proposed. Based on exceedances over a space-time threshold, estimators for a trend function and for extreme value parameters are given, leading to a homogenization procedure for then applying stationary extreme value processes. Extremal dependence over space is further evaluated through variogram…
▽ More
A new approach for evaluating time-trends in extreme values accounting also for spatial dependence is proposed. Based on exceedances over a space-time threshold, estimators for a trend function and for extreme value parameters are given, leading to a homogenization procedure for then applying stationary extreme value processes. Extremal dependence over space is further evaluated through variogram analysis including anisotropy. We detect significant inhomogeneities and trends in the extremal behaviour of daily precipitation data over a time period of 84 years and from 68 observational weather stations in North-West Germany. We observe that the trend is not monotonous over time in general.
Asymptotic normality of the estimators under maximum domain of attraction conditions are proven.
△ Less
Submitted 14 July, 2017;
originally announced July 2017.
-
A Matern based multivariate Gaussian random process for a consistent model of the horizontal wind components and related variables
Authors:
Rüdiger Hewer,
Petra Friederichs,
Andreas Hense,
Martin Schlather
Abstract:
The integration of physical relationships into stochastic models is of major interest e.g. in data assimilation. Here, a multivariate Gaussian random field formulation is introduced, which represents the differential relations of the two-dimensional wind field and related variables such as streamfunction, velocity potential, vorticity and divergence. The covariance model is based on a flexible biv…
▽ More
The integration of physical relationships into stochastic models is of major interest e.g. in data assimilation. Here, a multivariate Gaussian random field formulation is introduced, which represents the differential relations of the two-dimensional wind field and related variables such as streamfunction, velocity potential, vorticity and divergence. The covariance model is based on a flexible bivariate Matérn covariance function for streamfunction and velocity potential. It allows for different variances in the potentials, non-zero correlations between them, anisotropy and a flexible smoothness parameter. The joint covariance function of the related variables is derived analytically. Further, it is shown that a consistent model with non-zero correlations between the potentials and positive definite covariance function is possible. The statistical model is fitted to forecasts of the horizontal wind fields of a mesoscale numerical weather prediction system. Parameter uncertainty is assessed by a parametric bootstrap method. The estimates reveal only physically negligible correlations between the potentials. In contrast to the numerical estimator, the statistical estimator of the ratio between the variances of the rotational and divergent wind components is unbiased.
△ Less
Submitted 5 July, 2017;
originally announced July 2017.
-
Spatial Verification Using Wavelet Transforms: A Review
Authors:
Michael Weniger,
Florian Kapp,
Petra Friederichs
Abstract:
Due to the emergence of new high resolution numerical weather prediction (NWP) models and the availability of new or more reliable remote sensing data, the importance of efficient spatial verification techniques is growing. Wavelet transforms offer an effective framework to decompose spatial data into separate (and possibly orthogonal) scales and directions. Most wavelet based spatial verification…
▽ More
Due to the emergence of new high resolution numerical weather prediction (NWP) models and the availability of new or more reliable remote sensing data, the importance of efficient spatial verification techniques is growing. Wavelet transforms offer an effective framework to decompose spatial data into separate (and possibly orthogonal) scales and directions. Most wavelet based spatial verification techniques have been developed or refined in the last decade and concentrate on assessing forecast performance (i.e. forecast skill or forecast error) on distinct physical scales. Particularly during the last five years, a significant growth in meteorological applications could be observed. However, a comparison with other scientific fields such as feature detection, image fusion, texture analysis, or facial and biometric recognition, shows that there is still a considerable, currently unused potential to derive useful diagnostic information. In order to tab the full potential of wavelet analysis, we revise the state-of-the art in one- and two-dimensional wavelet analysis and its application with emphasis on spatial verification. We further use a technique developed for texture analysis in the context of high-resolution quantitative precipitation forecasts, which is able to assess structural characteristics of the precipitation fields and allows efficient clustering of ensemble data.
△ Less
Submitted 11 May, 2016;
originally announced May 2016.
-
Using the SAL technique for spatial verification of cloud processes: A sensitivity analysis
Authors:
Michael Weniger,
Petra Friederichs
Abstract:
The feature based spatial verification method SAL is applied to cloud data, i.e. two-dimensional spatial fields of total cloud cover and spectral radiance. Model output is obtained from the COSMO-DE forward operator SynSat and compared to SEVIRI satellite data. The aim of this study is twofold. First, to assess the applicability of SAL to this kind of data, and second, to analyze the role of exter…
▽ More
The feature based spatial verification method SAL is applied to cloud data, i.e. two-dimensional spatial fields of total cloud cover and spectral radiance. Model output is obtained from the COSMO-DE forward operator SynSat and compared to SEVIRI satellite data. The aim of this study is twofold. First, to assess the applicability of SAL to this kind of data, and second, to analyze the role of external object identification algorithms (OIA) and the effects of observational uncertainties on the resulting scores.
As a feature based method, SAL requires external OIA. A comparison of three different algorithms shows that the threshold level, which is a fundamental part of all studied algorithms, induces high sensitivity and unstable behavior of object dependent SAL scores (i.e. even very small changes in parameter values can lead to large changes in the resulting scores). An in-depth statistical analysis reveals significant effects on distributional quantities commonly used in the interpretation of SAL, e.g. median and interquartile distance. Two sensitivity indicators based on the univariate cumulative distribution functions are derived. They allow to asses the sensitivity of the SAL scores to threshold level changes without computationally expensive iterative calculations of SAL for various thresholds. The mathematical structure of these indicators connects the sensitivity of the SAL scores to parameter changes with the effect of observational uncertainties.
Finally, the discriminating power of SAL is studied. It is shown, that - for large-scale cloud data - changes in the parameters may have larger effects on the object dependent SAL scores (i.e. the S and L2 scores) than a complete loss of temporal collocation.
△ Less
Submitted 4 March, 2016;
originally announced March 2016.
-
Stochastic Parameterization: Towards a new view of Weather and Climate Models
Authors:
Judith Berner,
Ulrich Achatz,
Lauriane Batte,
Lisa Bengtsson,
Alvaro De La Camara,
Daan Crommelin,
Hannah Christensen,
Matteo Colangeli,
Stamen Dolaptchiev,
Christian L. E. Franzke,
Petra Friederichs,
Peter Imkeller,
Heikki Jarvinen,
Stephan Juricke,
Vassili Kitsios,
Franois Lott,
Valerio Lucarini,
Salil Mahajan,
Timothy N. Palmer,
Cecile Penland,
**-Song Von Storch,
Mirjana Sakradzija,
Michael Weniger,
Antje Weisheimer,
Paul D. Williams
, et al. (1 additional authors not shown)
Abstract:
The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not…
▽ More
The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not only provides better estimates of uncertainty, but it is also extremely promising for reducing longstanding climate biases and relevant for determining the climate response to external forcing. This article highlights recent developments from different research groups which show that the stochastic representation of unresolved processes in the atmosphere, oceans, land surface and cryosphere of comprehensive weather and climate models (a) gives rise to more reliable probabilistic forecasts of weather and climate and (b) reduces systematic model bias. We make a case that the use of mathematically stringent methods for the derivation of stochastic dynamic equations will lead to substantial improvements in our ability to accurately simulate weather and climate at all scales. Recent work in mathematics, statistical mechanics and turbulence is reviewed, its relevance for the climate problem demonstrated, and future research directions outlined.
△ Less
Submitted 20 March, 2017; v1 submitted 29 October, 2015;
originally announced October 2015.
-
Quantile forecast discrimination ability and value
Authors:
Zied Ben Bouallegue,
Pierre Pinson,
Petra Friederichs
Abstract:
While probabilistic forecast verification for categorical forecasts is well established, some of the existing concepts and methods have not found their equivalent for the case of continuous variables. New tools dedicated to the assessment of forecast discrimination ability and forecast value are introduced here, based on quantile forecasts being the base product for the continuous case (hence in a…
▽ More
While probabilistic forecast verification for categorical forecasts is well established, some of the existing concepts and methods have not found their equivalent for the case of continuous variables. New tools dedicated to the assessment of forecast discrimination ability and forecast value are introduced here, based on quantile forecasts being the base product for the continuous case (hence in a nonparametric framework). The relative user characteristic (RUC) curve and the quantile value plot allow analysing the performance of a forecast for a specific user in a decision-making framework. The RUC curve is designed as a user-based discrimination tool and the quantile value plot translates forecast discrimination ability in terms of economic value. The relationship between the overall value of a quantile forecast and the respective quantile skill score is also discussed. The application of these new verification approaches and tools is illustrated based on synthetic datasets, as well as for the case of global radiation forecasts from the high resolution ensemble COSMO-DE-EPS of the German Weather Service.
△ Less
Submitted 16 April, 2015;
originally announced April 2015.
-
Downscaling near-surface atmospheric fields with multi-objective Genetic Programming
Authors:
Tanja Zerenner,
Victor Venema,
Petra Friederichs,
Clemens Simmer
Abstract:
The coupling of models for the different components of the Soil-Vegetation-Atmosphere-System is required to investigate component interactions and feedback processes. However, the component models for atmosphere, land-surface and subsurface are usually operated at different resolutions in space and time owing to the dominant processes. The computationally often more expensive atmospheric models, f…
▽ More
The coupling of models for the different components of the Soil-Vegetation-Atmosphere-System is required to investigate component interactions and feedback processes. However, the component models for atmosphere, land-surface and subsurface are usually operated at different resolutions in space and time owing to the dominant processes. The computationally often more expensive atmospheric models, for instance, are typically employed at a coarser resolution than land-surface and subsurface models. Thus up- and downscaling procedures are required at the interface between the atmospheric model and the land-surface/subsurface models. We apply multi-objective Genetic Programming (GP) to a training data set of high-resolution atmospheric model runs to learn equations or short programs that reconstruct the fine-scale fields (e.g., 400 m resolution) of the near-surface atmospheric state variables from the coarse atmospheric model output (e.g., 2.8 km resolution). Like artificial neural networks, GP can flexibly incorporate multivariate and nonlinear relations, but offers the advantage that the solutions are human readable and thus can be checked for physical consistency. Using the Strength Pareto Approach for multi-objective fitness assignment allows us to consider multiple characteristics of the fine-scale fields during the learning procedure.
△ Less
Submitted 7 July, 2014;
originally announced July 2014.
-
Statistical Post-Processing of Forecasts for Extremes Using Bivariate Brown-Resnick Processes with an Application to Wind Gusts
Authors:
Marco Oesting,
Martin Schlather,
Petra Friederichs
Abstract:
To improve the forecasts of weather extremes, we propose a joint spatial model for the observations and the forecasts, based on a bivariate Brown-Resnick process. As the class of stationary bivariate Brown-Resnick processes is fully characterized by the class of pseudo cross-variograms, we contribute to the theorical understanding of pseudo cross-variograms refining the knowledge of the asymptotic…
▽ More
To improve the forecasts of weather extremes, we propose a joint spatial model for the observations and the forecasts, based on a bivariate Brown-Resnick process. As the class of stationary bivariate Brown-Resnick processes is fully characterized by the class of pseudo cross-variograms, we contribute to the theorical understanding of pseudo cross-variograms refining the knowledge of the asymptotic behaviour of all their components and introducing a parsimonious, but flexible parametric model. Both findings are of interest in classical geostatistics on their own. The proposed model is applied to real observation and forecast data for extreme wind gusts at 119 stations in Northern Germany.
△ Less
Submitted 29 May, 2015; v1 submitted 16 December, 2013;
originally announced December 2013.
-
Forecast verification for extreme value distributions with an application to probabilistic peak wind prediction
Authors:
Petra Friederichs,
Thordis L. Thorarinsdottir
Abstract:
Predictions of the uncertainty associated with extreme events are a vital component of any prediction system for such events. Consequently, the prediction system ought to be probabilistic in nature, with the predictions taking the form of probability distributions. This paper concerns probabilistic prediction systems where the data is assumed to follow either a generalized extreme value distributi…
▽ More
Predictions of the uncertainty associated with extreme events are a vital component of any prediction system for such events. Consequently, the prediction system ought to be probabilistic in nature, with the predictions taking the form of probability distributions. This paper concerns probabilistic prediction systems where the data is assumed to follow either a generalized extreme value distribution (GEV) or a generalized Pareto distribution (GPD). In this setting, the properties of proper scoring rules which facilitate the assessment of the prediction uncertainty are investigated and closed-from expressions for the continuous ranked probability score (CRPS) are provided. In an application to peak wind prediction, the predictive performance of a GEV model under maximum likelihood estimation, optimum score estimation with the CRPS, and a Bayesian framework are compared. The Bayesian inference yields the highest overall prediction skill and is shown to be a valuable tool for covariate selection, while the predictions obtained under optimum CRPS estimation are the sharpest and give the best performance for high thresholds and quantiles.
△ Less
Submitted 28 September, 2012; v1 submitted 4 April, 2012;
originally announced April 2012.
