SearcharxivSearch

arXiv · 2403.03166

Long-window tandem variational data assimilation methods for chaotic climate models tested with the Lorenz 63 system

Abstract

4D-variational data assimilation is applied to the Lorenz '63 model to introduce a new method for parameter estimation in chaotic climate models. The approach aims to optimise an Earth system model (ESM), for which no adjoint exists, by utilising the adjoint of a different, potentially simpler ESM. This relies on the synchronisation of the model to observed data. Dynamical state and parameter estimation (DSPE) is used to stabilise the tangent linear system by reducing all positive Lyapunov exponents to negative values, thereby improving parameter estimation by enabling long assimilation windows. The method introduces a second layer of synchronisation between the two models, with and without an adjoint, to facilitate linearisation around the trajectory of the model for which no adjoint exists. This is achieved by synchronising two Lorenz '63 systems, one with and the other without an adjoint model. Results are presented for an idealised case of identical, perfect models and for a more realistic case in which they differ from one another. If employed on a high-resolution ESM for which a coarse resolution adjoint exists, the method will save computational resources as only one forward run with the full high-resolution ESM per iteration is needed. It is demonstrated that there is negligible error and uncertainty change compared to the traditional optimisation of a full ESM with an adjoint. Stemming from this approach, it is shown that the synchronisation between two identical models can be used to filter noisy data in a dynamical way which reduces the parametric uncertainty of the optimised model by approximately one third. Such a precision gain could prove valuable for seasonal, annual, and decadal predictions.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Philip David Kennedy, Abhirup Banerjee, Armin Köhl, Detlef Stammer. 2025-04-17. Long-window tandem variational data assimilation methods for chaotic climate models tested with the Lorenz 63 system. https://arxiv.org/abs/2403.03166

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

GPROF-IR: An Improved Single-Channel Infrared Precipitation Retrieval for Merged Satellite Precipitation Products

The Integrated Multi-Satellite Retrievals for the Global Precipitation Measurement (IMERG) product combines precipitation estimates from passive microwave (PMW) and infrared (IR) sensors to provide quasi-global precipitation estimates at half-hourly resolution. Because IR observations are primarily sensitive to cloud-top properties, however, IR-based precipitation estimates are generally less accurate than PMW estimates and can introduce artifacts into the merged precipitation fields. We introduce GPROF-IR, a neural-network-based precipitation retrieval designed to provide precipitation estimates from single-channel geostationary IR observations for the upcoming IMERG V08. GPROF-IR uses a convolutional neural network to exploit spatiotemporal information from sequences of half-hourly IR observations. We validate GPROF-IR against independent surface-based precipitation measurements over land and ocean. GPROF-IR substantially improves upon existing single-channel IR retrievals, including the IR retrieval used in IMERG V07 and more recent neural-network-based approaches. During overpasses of flagship PMW sensors, GPROF-IR is more accurate than the corresponding IMERG PMW estimates over CONUS and Austria, but not Korea. Over CONUS, GPROF-IR outperforms the merged IMERG V07 product for hourly and daily precipitation accumulations. Against shipborne disdrometer observations, GPROF-IR is more accurate than IMERG V07 in the tropics but slightly less accurate in the extratropics. Since geostationary IR observations are continuously available across much of the globe since 1983, GPROF-IR provides a promising basis for improving merged precipitation products and developing long-term, temporally consistent precipitation records.

physics.ao-ph

FAST-ML: A Hybrid Physics-Machine Learning Framework for Tropical Cyclone Intensity Forecasting

Rapid intensification (RI) remains one of the most consequential and difficult aspects of tropical cyclone (TC) forecasting. Although full-physics numerical weather prediction models can represent the processes governing RI, resolving storm-environment interactions remains computationally expensive, while purely data-driven approaches often lack physical interpretability. We present FAST-ML, a hybrid framework that bridges data-driven efficiency with physical constraints. A physically informed dual-stream neural parameterization ingests 3D ERA5 fields to diagnose ventilation controls---environmental wind shear and mid-level entropy deficit. By optimizing these parameters end-to-end through a differentiable FAST intensity model, this architecture establishes a robust new paradigm for observation-driven parameter optimization, ensuring storm evolution remains strictly governed by thermodynamic principles. By better capturing the storm's continuous intensity evolution, FAST-ML improves upon its physical baseline, reducing ensemble CRPS across forecast lead times, with a reduction of approximately 31% at 60 h and nearly halving the RI false alarm ratio without sacrificing detection skill. In a 100-member ensemble configuration, FAST-ML produces intensity forecasts comparable to FNV3 for selected storms under the evaluated input configurations. Furthermore, zero-shot tests on selected Eastern Pacific storms provide encouraging evidence of cross-basin transferability. FAST-ML provides a modular intensity forecasting framework that can be coupled with externally supplied storm tracks and environmental fields. It demonstrates that observation-driven parameter learning within physically constrained dynamics simultaneously enhances accuracy, interpretability, and computational efficiency.

physics.ao-ph

West-WRF AI 2-km: High-Resolution Prediction of Integrated Vapor Transport and Precipitation

We introduce a stretched-grid artificial intelligence (AI) weather forecasting model with 2-km resolution over the western United States and part of the Northeast Pacific and approximately 31-km resolution elsewhere globally. Forecasting over the western U.S. is challenging because complex topography and atmospheric rivers (ARs) strongly influence orographic precipitation. West-WRF AI 2-km builds on a global model pretrained with a 40-year European Centre for Medium-Range Weather Forecasts Reanalysis v5 (ERA5) dataset and is fine-tuned with the Center for Western Weather and Water Extremes (CW3E) 2-km regional reanalysis to produce autoregressive 6-hourly forecasts of precipitation and integrated vapor transport (IVT). Forecasts are evaluated over winters 2020-2023 using gridded precipitation observations, rain gauges, and AR Reconnaissance dropsondes and are benchmarked against coarser-resolution AI forecasts and regional and global numerical weather prediction (NWP) systems. West-WRF AI 2-km reproduces observed precipitation-intensity distributions, retains fine-scale spectral variability, and produces sharper narrow coastal precipitation bands and localized, terrain-sensitive extremes. Its broader-scale performance remains comparable to coarser-resolution configurations while preserving large-scale skill despite higher resolution. Dropsonde verification shows lower errors and improved categorical skill at the most extreme IVT threshold. Overall, West-WRF AI 2-km provides its greatest value for localized precipitation extremes and intense AR-related moisture transport.

physics.ao-ph