Showing 1–4 of 4 results for author: Bhend, J

Weighted verification tools to evaluate univariate and multivariate forecasts for high-impact weather events

Authors: Sam Allen, Jonas Bhend, Olivia Martius, Johanna Ziegel

Abstract: To mitigate the impacts associated with adverse weather conditions, meteorological services issue weather warnings to the general public. These warnings rely heavily on forecasts issued by underlying prediction systems. When deciding which prediction system(s) to utilise to construct warnings, it is important to compare systems in their ability to forecast the occurrence and severity of extreme we… ▽ More To mitigate the impacts associated with adverse weather conditions, meteorological services issue weather warnings to the general public. These warnings rely heavily on forecasts issued by underlying prediction systems. When deciding which prediction system(s) to utilise to construct warnings, it is important to compare systems in their ability to forecast the occurrence and severity of extreme weather events. However, evaluating forecasts for extreme events is known to be a challenging task. This is exacerbated further by the fact that high-impact weather often manifests as a result of several confounding features, a realisation that has led to considerable research on so-called compound weather events. Both univariate and multivariate methods are therefore required to evaluate forecasts for high-impact weather. In this paper, we discuss weighted verification tools, which allow particular outcomes to be emphasised during forecast evaluation. We review and compare different approaches to construct weighted scoring rules, both in a univariate and multivariate setting, and we leverage existing results on weighted scores to introduce weighted probability integral transform (PIT) histograms, allowing forecast calibration to be assessed conditionally on particular outcomes having occurred. To illustrate the practical benefit afforded by these weighted verification tools, they are employed in a case study to evaluate forecasts for extreme heat events issued by the Swiss Federal Office of Meteorology and Climatology (MeteoSwiss). △ Less

Submitted 11 September, 2022; originally announced September 2022.

Seamless multi-model postprocessing for air temperature forecasts in complex topography

Authors: Regula Keller, Jan Rajczak, Jonas Bhend, Christoph Spirig, Stephan Hemri, Mark A. Liniger, Heini Wernli

Abstract: Statistical postprocessing is routinely applied to correct systematic errors of numerical weather prediction models (NWP) and to automatically produce calibrated local forecasts for end-users. Postprocessing is particularly relevant in complex terrain, where even state-of-the-art high-resolution NWP systems cannot resolve many of the small-scale processes sha** local weather conditions. In addit… ▽ More Statistical postprocessing is routinely applied to correct systematic errors of numerical weather prediction models (NWP) and to automatically produce calibrated local forecasts for end-users. Postprocessing is particularly relevant in complex terrain, where even state-of-the-art high-resolution NWP systems cannot resolve many of the small-scale processes sha** local weather conditions. In addition, statistical postprocessing can also be used to combine forecasts from multiple NWP systems. Here we assess an ensemble model output statistics (EMOS) approach to produce seamless temperature forecasts based on a combination of short-term ensemble forecasts from a convection-permitting limited-area ensemble and a medium-range global ensemble forecasting model. We quantify the benefit of this approach compared to only processing the high-resolution NWP. We calibrate and combine 2-m air temperature predictions for a large set of Swiss weather stations at the hourly time-scale. The multi-model EMOS approach ('Mixed EMOS') is able to improve forecasts by 30\% with respect to direct model output from the high-resolution NWP. A detailed evaluation of Mixed EMOS reveals that it outperforms either single-model EMOS version by 8-12\%. Valley location profit particularly from the model combination. All forecast variants perform worst in winter (DJF), however calibration and model combination improves forecast quality substantially. △ Less

Submitted 19 August, 2020; v1 submitted 18 August, 2020; originally announced August 2020.

Comments: 16 pages, 7 figures, submitted to Weather and Forecasting

Statistical Postprocessing for Weather Forecasts -- Review, Challenges and Avenues in a Big Data World

Authors: Stéphane Vannitsem, John Bjørnar Bremnes, Jonathan Demaeyer, Gavin R. Evans, Jonathan Flowerdew, Stephan Hemri, Sebastian Lerch, Nigel Roberts, Susanne Theis, Aitor Atencia, Zied Ben Bouallègue, Jonas Bhend, Markus Dabernig, Lesley De Cruz, Leila Hieta, Olivier Mestre, Lionel Moret, Iris Odak Plenković, Maurice Schmeits, Maxime Taillardat, Joris Van den Bergh, Bert Van Schaeybroeck, Kirien Whan, Jussi Ylhaisi

Abstract: Statistical postprocessing techniques are nowadays key components of the forecasting suites in many National Meteorological Services (NMS), with for most of them, the objective of correcting the impact of different types of errors on the forecasts. The final aim is to provide optimal, automated, seamless forecasts for end users. Many techniques are now flourishing in the statistical, meteorologica… ▽ More Statistical postprocessing techniques are nowadays key components of the forecasting suites in many National Meteorological Services (NMS), with for most of them, the objective of correcting the impact of different types of errors on the forecasts. The final aim is to provide optimal, automated, seamless forecasts for end users. Many techniques are now flourishing in the statistical, meteorological, climatological, hydrological, and engineering communities. The methods range in complexity from simple bias corrections to very sophisticated distribution-adjusting techniques that incorporate correlations among the prognostic variables. The paper is an attempt to summarize the main activities going on this area from theoretical developments to operational applications, with a focus on the current challenges and potential avenues in the field. Among these challenges is the shift in NMS towards running ensemble Numerical Weather Prediction (NWP) systems at the kilometer scale that produce very large datasets and require high-density high-quality observations; the necessity to preserve space time correlation of high-dimensional corrected fields; the need to reduce the impact of model changes affecting the parameters of the corrections; the necessity for techniques to merge different types of forecasts and ensembles with different behaviors; and finally the ability to transfer research on statistical postprocessing to operations. Potential new avenues will also be discussed. △ Less

Submitted 14 April, 2020; originally announced April 2020.

Comments: This work has been submitted to the Bulletin of the American Meteorological Society. Copyright in this work may be transferred without further notice

Area-covering postprocessing of ensemble precipitation forecasts using topographical and seasonal conditions

Authors: Lea Friedli, David Ginsbourger, Jonas Bhend

Abstract: Probabilistic weather forecasts from ensemble systems require statistical postprocessing to yield calibrated and sharp predictive distributions. This paper presents an area-covering postprocessing method for ensemble precipitation predictions. We rely on the ensemble model output statistics (EMOS) approach, which generates probabilistic forecasts with a parametric distribution whose parameters dep… ▽ More Probabilistic weather forecasts from ensemble systems require statistical postprocessing to yield calibrated and sharp predictive distributions. This paper presents an area-covering postprocessing method for ensemble precipitation predictions. We rely on the ensemble model output statistics (EMOS) approach, which generates probabilistic forecasts with a parametric distribution whose parameters depend on (statistics of) the ensemble prediction. A case study with daily precipitation predictions across Switzerland highlights that postprocessing at observation locations indeed improves high-resolution ensemble forecasts, with 4.5% CRPS reduction on average in the case of a lead time of 1 day. Our main aim is to achieve such an improvement without binding the model to stations, by leveraging topographical covariates. Specifically, regression coefficients are estimated by weighting the training data in relation to the topographical similarity between their station of origin and the prediction location. In our case study, this approach is found to reproduce the performance of the local model without using local historical data for calibration. We further identify that one key difficulty is that postprocessing often degrades the performance of the ensemble forecast during summer and early autumn. To mitigate, we additionally estimate on the training set whether postprocessing at a specific location is expected to improve the prediction. If not, the direct model output is used. This extension reduces the CRPS of the topographical model by up to another 1.7% on average at the price of a slight degradation in calibration. In this case, the highest improvement is achieved for a lead time of 4 days. △ Less

Submitted 12 October, 2020; v1 submitted 26 December, 2019; originally announced December 2019.