SearcharxivSearch

arXiv subjects

Gan Zhang

Publications and source records attributed to Gan Zhang.

10 recordsLinked to original sources

Generative Model Proposal based Particle Filtering for Data Assimilation

Data assimilation models state dynamics conditioned on sequential observations, and has wide-ranging scientific applications. In the filtering setting, the goal is to model the posterior over the current state given all observations so far. Classical solutions typically make simplifying distributional or functional assumptions, e.g., linear-Gaussian systems, which can be inaccurate in many scenarios. In principle, particle filters (PFs) remove these assumptions, yet often collapse in high dimensions. Recent generative approaches learn conditional state transitions, but without principled Bayesian updates they do not recover the correct filtering posterior and can accumulate error over long horizons. In this work, we introduce Flow Proposal Particle Filters (FPPF), which learn a conditional generative model based proposal approximating the variance-minimizing optimal proposal for particle propagation. Conditioning on observations steers particles toward high-likelihood regions before weighting, reducing weight variance and delaying degeneracy. Since our proposal admits tractable likelihood evaluation, FPPF computes accurate importance weights and retains a Bayesian update step. We further extend FPPF to high-dimensional problems through localization strategies, adressing another standard PF failure mode. Extensive experiments on a variety of dynamical systems show that FPPF outperforms statistical baselines and other generative methods in non-linear, non-Gaussian, and high-dimensional regimes.

cs.LG

WP-MIP: An Artificial Intelligence, Hybrid, and Physically Based Model Intercomparison Project for Weather Prediction

Rapid progress in the field of machine-learning for weather prediction has led to the emergence of algorithms whose forecasting skill can exceed that of traditional physically based models. This development represents an opportunity to improve the quality of forecasting services provided by operational centers, particularly given the speed at which machine-learning based models generate predictions. Despite the clear promise of these systems, questions remain about the ability of the current generation of machine-learning models to generate physically consistent predictions of the full suite of required forecast fields under all conditions. Answering these questions will require careful comparisons between the well-understood physically based models, current state-of-the-art machine-learning models, and the hybrid models that combine elements of these two archetypes. The Weather Prediction Model Intercomparison Project (WP-MIP) is a World Meteorological Organization-supported initiative whose initial goal is to create a centralized database of physically based, machine-learning, and hybrid model forecasts to enable a distributed assessment and evaluation effort. The first instance of WP-MIP focuses on global deterministic predictions using both center-specific and common initializations to facilitate sensitivity studies. Forecasts contributed by institutions across six continents will be used to develop AI-ready verification techniques that highlight the strengths and weaknesses of each class of prediction system, with the goal of establishing best-practice guidance to model developers and national weather centers. The broad engagement of the operational and forecast-evaluation communities in WP-MIP will ensure that the project results are highly relevant to the development and deployment of next-generation weather prediction systems.

physics.ao-ph

Impacts of Jet Stream Structure on Cyclone Merging and Persistent Anticyclones: Insights from Dry Idealized Simulations

Midlatitude jet streams exhibit substantial variability in latitude, width, and vertical depth on synoptic to multi-decadal timescales. While the upper-level dynamics of baroclinic waves have been extensively studied, the sensitivity of the extreme-generating, low-level phenomena to these variations remains underexplored. Here, we systematically investigate this sensitivity using dry, adiabatic idealized experiments with the GFDL FV3 dry dynamical core initialized with analytically specified jets. We identify jet variations that control synoptic-scale features of interest. Results indicate that poleward-shifted jets accelerate initial cyclone intensification and favor anticyclonic Rossby Wave Breaking (RWB). These wave-breaking tendencies are consistent with established baroclinic paradigms, validating the newly configured idealized simulations. Additionally, jet width regulates the likelihood of surface cyclone merging. Poleward-shifted, broader, and higher jets produce more frequent cyclone merging, generating intense wind extremes. Finally, we show that poleward-shifted, broad, deep jets dynamically precondition the flow for persistent stationary anticyclones in the absence of diabatic contributions. Together, these findings illustrate how changes in jet stream structure may modulate midlatitude weather extremes.

physics.ao-ph

Hierarchical Testing of a Hybrid Machine Learning-Physics Global Atmosphere Model

Machine learning (ML)-based models have demonstrated high skill and computational efficiency, often outperforming conventional physics-based models in weather and subseasonal predictions. While prior studies have assessed their fidelity in capturing synoptic-scale atmospheric dynamics, their performance across timescales and under out-of-distribution forcing, such as +3K or +4K uniform-warming forcings, and the sources of biases remain elusive, to establish the model reliability for Earth science. Here, we design three sets of experiments targeting synoptic-scale phenomena, interannual variability, and out-of-distribution uniform-warming forcings. We evaluate the Neural General Circulation Model (NeuralGCM), a hybrid model integrating a dynamical core with ML-based component, against observations and physics-based Earth system models (ESMs). At the synoptic scale, NeuralGCM captures the evolution and propagation of extratropical cyclones with performance comparable to ESMs. At the interannual scale, when forced by El Ni\~no-Southern Oscillation sea surface temperature (SST) anomalies, NeuralGCM successfully reproduces associated teleconnection patterns but exhibits deficiencies in capturing nonlinear response. Under out-of-distribution uniform-warming forcings, NeuralGCM simulates similar responses in global-average temperature and precipitation and reproduces large-scale tropospheric circulation features similar to those in ESMs. Notable weaknesses include overestimating the tracks and spatial extent of extratropical cyclones, biases in the teleconnected wave train triggered by tropical SST anomalies, and differences in upper-level warming and stratospheric circulation responses to SST warming compared to physics-based ESMs. The causes of these weaknesses were explored.

physics.ao-ph

Track-Dependent Links between Tropical Cyclones and Extratropical Predictability in Physical and AI Models

Global medium-range weather forecasts suffer occasional failures, often linked to tropical cyclones (TCs). We investigate TC influences on extratropical predictability by comparing forecasts from a physics-based model (ECMWF-IFS) and an AI-hybrid model (Google-NGCM) initialized near TC genesis. Analyzing 108 out-of-sample Northern Hemisphere cases reveals similar extratropical error growth patterns and comparable performance between the models. This suggests that the NGCM is capable of predicting the bulk upscale effects of tropical convection without directly representing convective processes. Leveraging the NGCM's computational efficiency, we compare forecasts initialized with and without TC genesis to isolate track-dependent forecast impacts. For Week-2 extratropical forecasts, TC impacts are highly time-, metric-, and track-dependent. The analysis confirms that some poleward-moving TCs degrade Week-2 US and European forecasts and suggests significant impacts from westward-moving TCs. The findings highlight the utility of the AI-hybrid model in predictability research and complex tropical-extratropical teleconnections that warrant future research.

physics.ao-ph

Navigating Through Turbulence: Charting Early Careers in Weather and Climate Science

The field of weather and climate science is at a pivotal moment, defined by simultaneous forces of institutional disruption and unprecedented technological advancements. While a shifting research and employment landscape has created career uncertainty, prompting many scientists to consider or pursue opportunities in the private sector, it has simultaneously spurred an expansion of the ecosystem through the emergence of new computational tools and the growing role of industry innovators and stakeholders. This perspective paper argues that this new, expanded ecosystem presents extraordinary opportunities for students and early-career professionals. We outline the emerging scientific frontiers powered by high-resolution simulations and artificial intelligence, suggest a practical path for navigating a more fluid career landscape, and propose how education and training must evolve. We argue that these changes expand rather than diminish the reader's capacity to do what drew most of us to this field: helping people prepare for what the atmosphere is about to do.

physics.ao-ph

Advancing Seasonal Prediction of Tropical Cyclone Activity with a Hybrid AI-Physics Climate Model

Machine learning (ML) models are successful with weather forecasting and have shown progress in climate simulations, yet leveraging them for useful climate predictions needs exploration. Here we show this feasibility using Neural General Circulation Model (NeuralGCM), a hybrid ML-physics atmospheric model developed by Google, for seasonal predictions of large-scale atmospheric variability and Northern Hemisphere tropical cyclone (TC) activity. Inspired by physical model studies, we simplify boundary conditions, assuming sea surface temperature (SST) and sea ice follow their climatological cycle but persist anomalies present at the initialization time. With such forcings, NeuralGCM can generate 100 simulation days in ~8 minutes with a single Graphics Processing Unit (GPU), while simulating realistic atmospheric circulation and TC climatology patterns. This configuration yields useful seasonal predictions (July to November) for the tropical atmosphere and various TC activity metrics. Notably, the predicted and observed TC frequency in the North Atlantic and East Pacific basins are significantly correlated during 1990 to 2023 (r=~0.7), suggesting prediction skill comparable to existing physical GCMs. Despite challenges associated with model resolution and simplified boundary forcings, the model-predicted interannual variations demonstrate significant correlations with the observation, including the sub-basin TC tracks (p<0.1) and basin-wide accumulated cyclone energy (p<0.01) of the North Atlantic and North Pacific basins. These findings highlight the promise of leveraging ML models with physical insights to model TC risks and deliver seamless weather-climate predictions.

physics.ao-ph

Confronting Contemporary Seasonality Changes in East Asian Tropical Cyclone Landfalls with a Multi-Century Historical Baseline

Paleoclimate records provide a critical long-term perspective on natural climate variability, essential for understanding contemporary climate change. However, existing paleoclimate proxies lack the spatial-temporal coverage for studying changes in high-impact weather extremes like tropical cyclones (TCs). Here we introduce a multi-source framework that confronts the contemporary changes in TC landfalls in East Asia with a multi-century baseline (1368-1911) reconstructed from historical documents. Leveraging pre-industrial and contemporary data, the analysis reveals that a relatively small shift toward earlier landfalls in the contemporary era (1946-2020). However, this shift falls well within the range of natural fluctuations documented historically (1651-1900). This low signal-to-noise ratio indicates the forced anthropogenic signal of TC landfall timing remains challenging to detect. Besides providing a template for assessing seasonality changes in extremes, our work shows consistent natural controls of TC timing in contemporary and pre-industrial eras, lending credibility to pre-industrial observational datasets and climate simulations.

physics.ao-ph

Amplified Summer Wind Stilling and Land Warming Compound Energy Risks in Northern Midlatitudes

Wind energy plays a critical role in mitigating climate change and meeting growing energy demands. However, the long-term impacts of anthropogenic warming on wind resources, particularly their seasonal variations and potential compounding risks, remain understudied. Here we analyze large-ensemble climate simulations in high-emission scenarios to assess the projected changes in near-surface wind speed and their broader implications. Our analyses show robust wind changes including a decrease of wind speed (i.e., stilling) up to ~15% during the summer months in Northern Midlatitudes. This stilling is linked to amplified warming of the midlatitude land and the overlying troposphere. Despite regional and model uncertainties, robust signals of warming-induced wind stilling will likely emerge from natural climate variations in the late 21st century of the high-emission scenarios. Importantly, the summertime wind stilling coincides with a projected surge in cooling demand, and their compounding may disrupt the energy supply-demand balance earlier. These findings highlight the importance of considering the seasonal responses of wind resources and the associated climate-energy risks in a warming climate. By integrating these insights into future energy planning decisions, we can better adapt to a changing climate and ensure a reliable and resilient energy future.

physics.ao-ph

Characteristics and Predictive Modeling of Short-term Impacts of Hurricanes on the US Employment

The physical and economic damages of hurricanes can acutely affect employment and the well-being of employees. However, a comprehensive understanding of these impacts remains elusive as many studies focused on narrow subsets of regions or hurricanes. Here we present an open-source dataset that serves interdisciplinary research on hurricane impacts on US employment. Compared to past domain-specific efforts, this dataset has greater spatial-temporal granularity and variable coverage. To demonstrate potential applications of this dataset, we focus on the short-term employment disruptions related to hurricanes during 1990-2020. The observed county-level employment changes in the initial month are small on average, though large employment losses (>30%) can occur after extreme storms. The overall small changes partly result from compensation among different employment sectors, which may obscure large, concentrated employment losses after hurricanes. Additional econometric analyses concur on the post-storm employment losses in hospitality and leisure but disagree on employment changes in the other industries. The dataset also enables data-driven analyses that highlight vulnerabilities such as pronounced employment losses related to Puerto Rico and rainy hurricanes. Furthermore, predictive modeling of short-term employment changes shows promising performance for service-providing industries and high-impact storms. In the examined cases, the nonlinear Random Forests model greatly outperforms the multiple linear regression model. The nonlinear model also suggests that more severe hurricane hazards projected by physical models may cause more extreme losses in US service-providing employment. Finally, we share our dataset and analytical code to facilitate the study and modeling of hurricane impacts in a changing climate.

econ.EM