π€ AI Summary
This study addresses the risk of performance misjudgment in climate downscaling arising from single-metric evaluation and the inherent trade-off between spatial fidelity and fine-scale variability. To overcome these limitations, this work proposes a multidimensional evaluation framework encompassing pointwise error, structural similarity, distributional, spectral, and gradient metrics, and systematically benchmarks five downscaling methods using ERA5 data. The results reveal that method rankings vary substantially across evaluation dimensions and climatic variables, confirming that no single approach is universally optimal. Furthermore, this paper elucidates systematic trade-offs among distinct performance characteristics, emphasizing the necessity of selecting evaluation metrics aligned with the specific features targeted for preservation. Ultimately, this work establishes a rigorous scientific benchmark for comprehensively assessing the quality of reconstructed climate fields.
π Abstract
Climate downscaling aims to reconstruct fine scale spatial fields from coarse resolution inputs. Evaluating the quality of these reconstructions is challenging: low pointwise error can come at the cost of fine scale variability, while realistic spatial variability can be achieved with inaccurate local structures. The evaluation metric can therefore change which method appears to perform best. This work presents a multi metric benchmark comparing five spatial downscaling methods on ERA5 temperature, wind, and precipitation fields. Five criteria assess complementary properties: pointwise error, structural similarity, distribution error, spectral error, and gradient error. The results reveal a systematic trade off between spatial fidelity and fine scale variability. Some methods perform best on pointwise and spatially aligned metrics, but lose high frequency content, while others preserve substantially more spectral variability at the cost of less accurately positioned local structures. Consequently, method rankings change across metrics and variables. These results show that there is no single best downscaling method. Multi metric evaluation is therefore essential for assessing which properties of a climate field are preserved.