-
Spatial verification of high-resolution ensemble precipitation forecasts using local wavelet spectra
Authors:
Florian Kapp,
Petra Friederichs,
Sebastian Brune,
Michael Weniger
Abstract:
The purpose of this study is to perform verification of the structural characteristics of high-resolution spatial forecasts without relying on an object identification algorithm. To this end, a wavelet approach developed for image texture analysis is applied to an ensemble of high-resolution quantitative precipitation forecasts. The forecasts are verified against estimates from a high-resolution r…
▽ More
The purpose of this study is to perform verification of the structural characteristics of high-resolution spatial forecasts without relying on an object identification algorithm. To this end, a wavelet approach developed for image texture analysis is applied to an ensemble of high-resolution quantitative precipitation forecasts. The forecasts are verified against estimates from a high-resolution regional reanalysis with a similar model version. The wavelet approach estimates an averaged wavelet spectrum for each spatial field of the ensemble forecasts and the reanalysis, thereby removing all information on the localization of precipitation and investigating solely the overall structure of forecasts and reanalysis. In order to assess skill using a multivariate score, an additional reduction of dimensionality is needed. This is performed using singular vectors from a linear discriminant analysis as it favors data compression in the direction where the ensemble is most discriminating. We discuss implications of this strategy, show that the averaged wavelet spectra give valuable information on forecast performance. The skill difference between a so-called perfect forecast using for verification a member of the ensemble, and the non-perfect forecast using the reanalysis points to significant deficiencies of the forecast ensemble. Overall, the discriminating power solely based on global spectral information is remarkable, and the COSMO-DE-EPS is a quite good forecast ensemble with respect to the reanalysis.
△ Less
Submitted 23 August, 2018;
originally announced August 2018.
-
Spatial Verification Using Wavelet Transforms: A Review
Authors:
Michael Weniger,
Florian Kapp,
Petra Friederichs
Abstract:
Due to the emergence of new high resolution numerical weather prediction (NWP) models and the availability of new or more reliable remote sensing data, the importance of efficient spatial verification techniques is growing. Wavelet transforms offer an effective framework to decompose spatial data into separate (and possibly orthogonal) scales and directions. Most wavelet based spatial verification…
▽ More
Due to the emergence of new high resolution numerical weather prediction (NWP) models and the availability of new or more reliable remote sensing data, the importance of efficient spatial verification techniques is growing. Wavelet transforms offer an effective framework to decompose spatial data into separate (and possibly orthogonal) scales and directions. Most wavelet based spatial verification techniques have been developed or refined in the last decade and concentrate on assessing forecast performance (i.e. forecast skill or forecast error) on distinct physical scales. Particularly during the last five years, a significant growth in meteorological applications could be observed. However, a comparison with other scientific fields such as feature detection, image fusion, texture analysis, or facial and biometric recognition, shows that there is still a considerable, currently unused potential to derive useful diagnostic information. In order to tab the full potential of wavelet analysis, we revise the state-of-the art in one- and two-dimensional wavelet analysis and its application with emphasis on spatial verification. We further use a technique developed for texture analysis in the context of high-resolution quantitative precipitation forecasts, which is able to assess structural characteristics of the precipitation fields and allows efficient clustering of ensemble data.
△ Less
Submitted 11 May, 2016;
originally announced May 2016.
-
Using the SAL technique for spatial verification of cloud processes: A sensitivity analysis
Authors:
Michael Weniger,
Petra Friederichs
Abstract:
The feature based spatial verification method SAL is applied to cloud data, i.e. two-dimensional spatial fields of total cloud cover and spectral radiance. Model output is obtained from the COSMO-DE forward operator SynSat and compared to SEVIRI satellite data. The aim of this study is twofold. First, to assess the applicability of SAL to this kind of data, and second, to analyze the role of exter…
▽ More
The feature based spatial verification method SAL is applied to cloud data, i.e. two-dimensional spatial fields of total cloud cover and spectral radiance. Model output is obtained from the COSMO-DE forward operator SynSat and compared to SEVIRI satellite data. The aim of this study is twofold. First, to assess the applicability of SAL to this kind of data, and second, to analyze the role of external object identification algorithms (OIA) and the effects of observational uncertainties on the resulting scores.
As a feature based method, SAL requires external OIA. A comparison of three different algorithms shows that the threshold level, which is a fundamental part of all studied algorithms, induces high sensitivity and unstable behavior of object dependent SAL scores (i.e. even very small changes in parameter values can lead to large changes in the resulting scores). An in-depth statistical analysis reveals significant effects on distributional quantities commonly used in the interpretation of SAL, e.g. median and interquartile distance. Two sensitivity indicators based on the univariate cumulative distribution functions are derived. They allow to asses the sensitivity of the SAL scores to threshold level changes without computationally expensive iterative calculations of SAL for various thresholds. The mathematical structure of these indicators connects the sensitivity of the SAL scores to parameter changes with the effect of observational uncertainties.
Finally, the discriminating power of SAL is studied. It is shown, that - for large-scale cloud data - changes in the parameters may have larger effects on the object dependent SAL scores (i.e. the S and L2 scores) than a complete loss of temporal collocation.
△ Less
Submitted 4 March, 2016;
originally announced March 2016.
-
Stochastic Parameterization: Towards a new view of Weather and Climate Models
Authors:
Judith Berner,
Ulrich Achatz,
Lauriane Batte,
Lisa Bengtsson,
Alvaro De La Camara,
Daan Crommelin,
Hannah Christensen,
Matteo Colangeli,
Stamen Dolaptchiev,
Christian L. E. Franzke,
Petra Friederichs,
Peter Imkeller,
Heikki Jarvinen,
Stephan Juricke,
Vassili Kitsios,
Franois Lott,
Valerio Lucarini,
Salil Mahajan,
Timothy N. Palmer,
Cecile Penland,
**-Song Von Storch,
Mirjana Sakradzija,
Michael Weniger,
Antje Weisheimer,
Paul D. Williams
, et al. (1 additional authors not shown)
Abstract:
The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not…
▽ More
The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not only provides better estimates of uncertainty, but it is also extremely promising for reducing longstanding climate biases and relevant for determining the climate response to external forcing. This article highlights recent developments from different research groups which show that the stochastic representation of unresolved processes in the atmosphere, oceans, land surface and cryosphere of comprehensive weather and climate models (a) gives rise to more reliable probabilistic forecasts of weather and climate and (b) reduces systematic model bias. We make a case that the use of mathematically stringent methods for the derivation of stochastic dynamic equations will lead to substantial improvements in our ability to accurately simulate weather and climate at all scales. Recent work in mathematics, statistical mechanics and turbulence is reviewed, its relevance for the climate problem demonstrated, and future research directions outlined.
△ Less
Submitted 20 March, 2017; v1 submitted 29 October, 2015;
originally announced October 2015.
-
A Stochastic Energy Budget Model Using Physically Based Red Noise
Authors:
Michael Weniger,
Anton Bovier,
Andreas Hense
Abstract:
A method to describe unresolved processes in meteorological models by physically based stochastic processes (SP) is proposed by the example of an energy budget model (EBM). Contrary to the common approach using additive white noise, a suitable variable within the model is chosen to be represented by a SP. Spectral analysis of ice core time series shows a red noise character of the underlying fluct…
▽ More
A method to describe unresolved processes in meteorological models by physically based stochastic processes (SP) is proposed by the example of an energy budget model (EBM). Contrary to the common approach using additive white noise, a suitable variable within the model is chosen to be represented by a SP. Spectral analysis of ice core time series shows a red noise character of the underlying fluctuations. Fitting Ornstein Uhlenbeck processes to the observed spectrum defines the parameters for the stochastic dynamic model (SDM). Numerical simulations for different sets of ice core data lead to three sets of strongly differing systems. Pathwise, statistical and spectral analysis of these models show the importance of carefully choosing suitable stochastic terms in order to get a physically meaningful SDM.
△ Less
Submitted 16 May, 2011;
originally announced May 2011.
