SearcharxivSearch

arXiv · 2210.16746

Deep learning for quality control of surface physiographic fields using satellite Earth observations

Abstract

A purposely built deep learning algorithm for the Verification of Earth-System ParametERisation (VESPER) is used to assess recent upgrades of the global physiographic datasets underpinning the quality of the Integrated Forecasting System (IFS) of the European Centre for Medium-Range Weather Forecasts (ECMWF), which is used both in numerical weather prediction and climate reanalyses. A neural network regression model is trained to learn the mapping between the surface physiographic dataset plus the meteorology from ERA5, and the MODIS satellite skin temperature observations. Once trained, this tool is applied to rapidly assess the quality of upgrades of the land-surface scheme. Upgrades which improve the prediction accuracy of the machine learning tool indicate a reduction of the errors in the surface fields used as input to the surface parametrisation schemes. Conversely, incorrect specifications of the surface fields decrease the accuracy with which VESPER can make predictions. We apply VESPER to assess the accuracy of recent upgrades of the permanent lake and glaciers covers as well as planned upgrades to represent seasonally varying water bodies (i.e. ephemeral lakes). We show that for grid-cells where the lake fields have been updated, the prediction accuracy in the land surface temperature (i.e mean absolute error difference between updated and original physiographic datasets) improves by 0.37 K on average, whilst for the subset of points where the lakes have been exchanged for bare ground (or vice versa) the improvement is 0.83 K. We also show that updates to the glacier cover improve the prediction accuracy by 0.22 K. We highlight how neural networks such as VESPER can assist the research and development of surface parameterizations and their input physiography to better represent Earth's surface couples processes in weather and climate models.

Explore related subjects

Keep this discovery

BibTeXRIS

Tom Kimpson, Margarita Choulga, Matthew Chantry, Gianpaolo Balsamo, Souhail Boussetta, Peter Dueben, Tim Palmer. 2022-10-30. Deep learning for quality control of surface physiographic fields using satellite Earth observations. https://doi.org/10.5194/egusphere-2022-1177

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Windowed Envelope Statistics for Time-Domain Significant Wave Height Estimation From HF Radar

Significant wave height (SWH) retrieval from high-frequency (HF) radar typically relies on a weak second-order Doppler continuum that is sensitive to noise, interference, and spectral leakage. This letter presents a Windowed Envelope Statistics Estimator (WESE) that operates directly on beam-formed time-domain voltages. A second-order term obtained from a Neumann expansion of the rough-surface field equation motivates quadratic compensation of localized radar features. WESE extracts the mean, standard deviation, or variance from overlapping windows of the in-phase, quadrature, or envelope-magnitude sequence, followed by quadratic compensation, rank ordering, least-squares regression, and causal smoothing. Evaluation used 335 synchronized hourly observations from a 13.385 MHz, 12-element WERA system at Argentia, Newfoundland and Labrador. The optimal configuration used quadrature variance, a 16-sample window, 896 retained chronological samples, and 30-h smoothing, achieving an RMSE of 0.152 m and a Pearson correlation of 0.978. This represents RMSE reductions of 32.1% and 18.7% relative to previously reported linear and second-order compensated ordered-statistics models, respectively. The results demonstrate robust time-domain SWH estimation without explicit Doppler-spectrum construction.

physics.ao-ph

KiloDA: Reconstructing kilometer-scale near-surface wind states from sparse station observations

Accurate kilometer-scale near-surface winds are important for understanding atmospheric processes over complex terrain, yet remain difficult to reconstruct from sparse and unevenly distributed observations. Here we introduce KiloDA, a diffusion framework for hourly kilometer-scale wind reconstruction from surface stations. KiloDA learns the statistical distribution and spatial structure of wind fields from historical 3-km Weather Research and Forecasting (WRF) model forecasts. At each reconstruction time, no contemporaneous WRF field is used. Instead, station observations provide the only constraints on the current atmospheric state and guide posterior sampling from the learned prior. In idealized WRF experiments, KiloDA recovers localized wind structures when only 0.24% of grid cells are observed and shows an overall advantage over conventional interpolation across terrain conditions and wind speed regimes. This capability largely transfers to real observations. In a fully withheld region, KiloDA reduces the median wind speed root mean square error (RMSE) by 19% relative to ERA5 reanalysis, using only observations outside the region, with the largest improvements over high-elevation and high-relief terrain. A random station holdout further confirms that this advantage extends across different complex-terrain locations and holdout configurations. These results show that historical model archives can provide useful structural knowledge for reconstructing kilometer-scale wind fields from sparse observations without requiring an accurate model estimate of the current atmospheric state.

physics.ao-ph