Comparison of indicators to evaluate the performance of climate models
Authors:
Mario J. Gómez,
Luis A. Barboza,
Hugo G. Hidalgo,
Eric J. Alfaro
Abstract:
The evaluation of climate models is a crucial step in climate studies. It consists of quantifying the resemblance of model outputs to reference data to identify models with superior capacity to replicate specific climate variables. Clearly, the choice of the evaluation indicator significantly impacts the results, underscoring the importance of selecting an indicator that properly captures the char…
▽ More
The evaluation of climate models is a crucial step in climate studies. It consists of quantifying the resemblance of model outputs to reference data to identify models with superior capacity to replicate specific climate variables. Clearly, the choice of the evaluation indicator significantly impacts the results, underscoring the importance of selecting an indicator that properly captures the characteristics of a "good model". This study examines the behavior of six indicators, considering spatial correlation, distribution mean, variance, and shape. A new multi-component measure was selected based on these criteria to assess the performance of 48 CMIP6 models in reproducing the annual seasonal cycle of precipitation, temperature, and teleconnection patterns in Central America. The top six models were determined using multi-criteria methods. It was found that even the best model reproduces one derived climatic variable poorly in this region. The proposed measure and selection method can contribute to enhancing the accuracy of climatological research based on climate models.
△ Less
Submitted 1 July, 2023;
originally announced July 2023.
Spatio-temporal Downscaling Emulator for Regional Climate Models: a Comparative Study
Authors:
Luis A. Barboza,
Shu Wei Chou Chen,
Marcela Alfaro Córdoba,
Eric J. Alfaro,
Hugo G. Hidalgo
Abstract:
Regional Climate Models (RCM) describe the meso scale global atmospheric and oceanic dynamics and serve as dynamical downscaling models. In other words, RCMs use atmospheric and oceanic climate output from General Circulation Models (GCM) to develop a higher resolution climate output. They are computationally demanding and, depending on the application, require several orders of magnitude of compu…
▽ More
Regional Climate Models (RCM) describe the meso scale global atmospheric and oceanic dynamics and serve as dynamical downscaling models. In other words, RCMs use atmospheric and oceanic climate output from General Circulation Models (GCM) to develop a higher resolution climate output. They are computationally demanding and, depending on the application, require several orders of magnitude of computer time more than statistical climate downscaling. In this paper we describe how to use a spatio-temporal statistical model with varying coefficients (VC), as a downscaling emulator for a RCM using varying coefficients. In order to estimate the proposed model, two options are compared: INLA, and varycoef. We set up a simulation to compare the performance of both methods for building a statistical downscaling emulator for RCM, and then show that the emulator works properly for NARCCAP data. The results show that the model is able to estimate non-stationary marginal effects, which means that the downscaling output can vary over space. Furthermore, the model has flexibility to estimate the mean of any variable in space and time, and has good prediction results. INLA was the fastest method for all the cases, and the approximation with best accuracy to estimate the different parameters from the model and the posterior distribution of the response variable.
△ Less
Submitted 13 March, 2023; v1 submitted 8 June, 2022;
originally announced June 2022.
