Searcharxiv⌕ Search

arXiv subjects

Paul A. O'Gorman

Publications and source records attributed to Paul A. O'Gorman.

16 recordsLinked to original sources

Improved Precipitation Variability in the Community Atmosphere Model through Implementation of a Neural-Network Deep Convection Scheme

Conventional deep convection schemes remain a primary source of uncertainty in global climate models, yet replacing them with data-driven alternatives while maintaining physical consistency and numerical stability is an open challenge. We present a hybrid configuration of the Community Atmosphere Model version 6 (CAM6), in which a fully connected deep neural network replaces the Zhang-McFarlane deep convection scheme (ZM), while radiation, turbulence, and other cloud processes are left unchanged. The network is trained on output from a storm-resolving global model - the global System for Atmospheric Modeling (gSAM) - using a coarse-graining approach to derive subgrid-scale convective fluxes and tendencies. This data-driven parameterization is ported to CAM6 and found to run stably for more than a decade while conserving energy and moisture. It produces a broadly realistic climatology without retuning the remaining parameterizations. Relative to the default Zhang-McFarlane scheme, the neural network parameterization substantially improves some long-standing model deficiencies. In particular, the biases in light precipitation and extreme precipitation are markedly reduced, and the diurnal cycle of tropical land precipitation shifts from a spurious midday peak over many regions to the observed late-afternoon peak. These results support targeted ML-based convection schemes as a viable path toward reducing systematic model errors in next-generation climate models.

physics.ao-ph↗

Radiative and Dynamical Controls on the Land-Ocean Warming Contrast in Climate Models

Surface air over land warms substantially more than over the ocean under greenhouse forcing, a phenomenon known as the land-ocean warming contrast. Current explanations for this contrast are commonly expressed either in terms of energetic constraints, from top-of-atmosphere and surface energy balance, or dynamical constraints, from large-scale atmospheric dynamics. We show that these perspectives are complementary when viewed through the lens of atmospheric moist static energy (MSE) transport, and that connecting them yields new insight into the controls of the warming contrast and the spread in climate models. We use this framework to construct an interpretable emulator that reproduces the land-ocean warming response across 22 models from the latest Coupled Model Intercomparison Project (CMIP6). We find that the strength of the land-ocean warming contrast emerges from the interplay between a model-dependent radiative baseline and a robust dynamical restoring mechanism that favors greater warming over land. This interplay leads to two broad model regimes that align with climate sensitivity. In low-climate-sensitivity models, more stabilizing radiative feedbacks over the ocean directly favor greater land warming. In high-climate-sensitivity models, radiative feedbacks alone would instead favor greater ocean warming, but a strong MSE-transport feedback (approximately 0.2 PW/K) more than compensates for this tendency. The intermodel spread in the land-ocean warming contrast is closely related to the ratio of radiative feedbacks over land and ocean, highlighting a broader connection between climate sensitivity and the land-ocean warming contrast.

physics.ao-ph↗

Boosting Ensembles for Statistics of Tails at Conditionally Optimal Advance Split Times

Climate science needs more efficient ways to study high-impact, low-probability extreme events. Ensemble boosting, a form of rare event sampling, offers a novel strategy to extract more information from those occasional simulated events, by perturbing them slightly to probe alternative scenarios immediately instead of waiting many simulation-years for the next event. But statistical accuracy and efficiency depend on the perturbation details. In particular for sudden and transient events like precipitation, performance of boosting depends sensitively on the \emph{advance split time} (AST), which must be long enough before the event to let the ensemble diversify, but not so much as to destroy the event. In pursuit of principled guidelines, we study the effect of AST for sampling tracer fluctuations in a quasigeostrophic flow, an idealized but informative model of midlatitude storm track dynamics. We formulate AST selection as an optimization problem for statistical fidelity with a ground truth. Since ground truth is not known in practice, we propose a proxy objective function of \emph{thresholded entropy}, which rewards ensembles with both a high mean and a large spread. We show that ensemble boosting, when given a well-chosen AST and equipped with methods to estimate probabilities, can accurately sample extremes at long return periods. We furthermore find evidence that thresholded entropy successfully identifies an optimal AST, which is roughly 1-3 eddy turnover timescales in the quasigeostrophic system. Moreover, this proxy captures the \emph{variation} of AST with the target location of the tracer within the flow field, suggesting generalizability to climate models. Large-scale deployment of our method will require further development in adaptive optimization strategies, but our work here is an essential first step for establishing what must be optimized.

physics.ao-ph↗

Rare event sampling for moving targets: extremes of temperature and daily precipitation in a general circulation model

Extreme weather events epitomize high cost: to society through their physical impacts, and to computer servers that simulate them to assess risk and advance physical understanding. It costs hundreds of simulation years to sample a few once-per-century events with straightforward model integration, but that cost can be much reduced with \emph{rare event sampling}, which nudges ensembles of simulations to convert moderate events to severe ones, e.g., by steering a cyclone directly through a region of interest. With proper statistical accounting, rare event algorithms can provide quantitative climate risk assessment at reduced cost. But this can only work if ensemble members diverge fast enough. Sudden, transient events characteristic of Earth's midlatitude storm track regions, such as heavy precipitation and heat extremes, pose a particular challenge because they come and go faster than an ensemble can explore the possibilities. Here we extend standard rare event algorithms to handle this challenging case in an idealized atmospheric general circulation model, achieving $\sim5-10$ times sped-up estimation of long return periods for extremes of surface temperature and daily precipitation (e.g., a return period of 150 years from 20 years of simulation). The algorithm, called TEAMS (``trying-early adaptive multilevel splitting''), was developed previously with a toy chaotic system, and relies on a key parameter -- the advance split time -- which may be estimated based on simple diagnostics of ensemble dispersion rates. The results are promising for accelerated risk assessment across a wide range of physical hazards using more realistic and complex models with acute computational constraints.

physics.ao-ph↗

CERA: A Framework for Improved Generalization of Machine Learning Models to Changed Climates

Robust generalization under climate change remains a major challenge for machine learning applications in climate science. Most existing approaches struggle to extrapolate beyond the climate they were trained on, leading to a strong dependence on training data from model simulations of warm climates. Use of climate-invariant inputs improves generalization but requires challenging manual feature engineering. Here, we present CERA (Climate-invariant Encoding through Representation Alignment), a machine learning framework consisting of an autoencoder with explicit latent-space alignment, followed by a predictor for downstream process estimation. We test CERA on the problem of parameterizing moist-physics processes. Without training on labeled data from a +4K climate, CERA leverages labeled control-climate data and unlabeled warmer-climate inputs to improve generalization to the warmer climate, outperforming both raw-input and physically informed baselines in predicting key moisture and energy tendencies. It captures not only the vertical and meridional structures of the moisture tendencies, but also shifts in the intensity distribution of precipitation including extremes. Ablation experiments show that latent alignment improves both accuracy and the robustness across random seeds used in training. While some reduced skill remains in the boundary layer, the framework offers a data-driven alternative to manual feature engineering of climate invariant inputs. Beyond parameterizations used in hybrid ML-physics systems, the approach holds promise for other climate applications such as statistical downscaling.

physics.ao-ph↗

Dependence of convective precipitation extremes on near-surface relative humidity

Precipitation extremes produced by convection have been found to intensify with near-surface temperatures at a Clausius-Clapeyron rate of $6$ to $7\%$ K$^{-1}$ in simulations of radiative-convective equilibrium (RCE). However, these idealized simulations are typically performed over an ocean surface with a high near-surface relative humidity (RH) that stays roughly constant with warming. Over land, near-surface RH is lower than over ocean and is projected to decrease by global climate models. Here, we investigate the dependence of precipitation extremes on near-surface RH in convection-resolving simulations of RCE. We reduce near-surface RH by increasing surface evaporative resistance while holding free-tropospheric temperatures fixed by increasing surface temperature. This ``top-down'' approach produces an RCE state with a deeper, drier boundary layer, which weakens convective precipitation extremes in three distinct ways. First, the lifted condensation level is higher, leading to a small thermodynamic weakening of precipitation extremes. Second, the higher lifted condensation level also reduces positive buoyancy in the lower troposphere, leading to a dynamic weakening of precipitation extremes. Third, precipitation re-evaporates more readily when falling through a deeper, drier boundary layer, leading to a substantial decrease in precipitation efficiency. These three effects all follow from changes in near-surface relative humidity and are physically distinct from the mechanism that underpins the Clausius-Clapeyron scaling rate. Overall, our results suggest that changes in relative humidity must be taken into account when seeking to understand and predict changes in convective precipitation extremes over land.

physics.ao-ph↗

Bringing statistics to storylines: rare event sampling for sudden, transient extreme events

A leading goal for climate science and weather risk management is to accurately model both the physics and statistics of extreme events. These two goals are fundamentally at odds: the higher a computational model's resolution, the more expensive are the ensembles needed to capture accurate statistics in the tail of the distribution. Here, we focus on events that are localized in space and time, such as heavy precipitation events, which can start suddenly and decay rapidly. We advance a method for sampling such events more efficiently than straightforward climate model simulation. Our method combines elements of two recent approaches: adaptive multilevel splitting (AMS), a rare event algorithm that generates rigorous statistics at reduced cost, but that does not work well for sudden, transient extreme events; and "ensemble boosting" which generates physically plausible storylines of these events but not their statistics. We modify AMS by splitting trajectories well in advance of the event's onset following the approach of ensemble boosting, and this is shown to be critical for amplifying and diversifying simulated events in tests with the Lorenz-96 model. Early splitting requires a rejection step that reduces efficiency, but nevertheless we demonstrate improved sampling of extreme local events by a factor of order 10 relative to direct sampling in Lorenz-96. Our work makes progress on the challenge posed by fast dynamical timescales for rare event sampling, and it draws connections with existing methods in reliability engineering which, we believe, can be further exploited for weather risk assessment.

physics.ao-ph↗

Climate-Invariant Machine Learning

Projecting climate change is a generalization problem: we extrapolate the recent past using physical models across past, present, and future climates. Current climate models require representations of processes that occur at scales smaller than model grid size, which have been the main source of model projection uncertainty. Recent machine learning (ML) algorithms hold promise to improve such process representations, but tend to extrapolate poorly to climate regimes they were not trained on. To get the best of the physical and statistical worlds, we propose a new framework - termed "climate-invariant" ML - incorporating knowledge of climate processes into ML algorithms, and show that it can maintain high offline accuracy across a wide range of climate conditions and configurations in three distinct atmospheric models. Our results suggest that explicitly incorporating physical knowledge into data-driven models of Earth system processes can improve their consistency, data efficiency, and generalizability across climate regimes.

cs.LG↗

Non-local parameterization of atmospheric subgrid processes with neural networks

Subgrid processes in global climate models are represented by parameterizations which are a major source of uncertainties in simulations of climate. In recent years, it has been suggested that machine-learning (ML) parameterizations based on high-resolution model output data could be superior to traditional parameterizations. Currently, both traditional and ML parameterizations of subgrid processes in the atmosphere are based on a single-column approach, which only use information from single atmospheric columns. However, single-column parameterizations might not be ideal since certain atmospheric phenomena, such as organized convective systems, can cross multiple grid boxes and involve slantwise circulations that are not purely vertical. Here we train neural networks (NNs) using non-local inputs spanning over 3$\times$3 columns of inputs. We find that including the non-local inputs improves the offline prediction of a range of subgrid processes. The improvement is especially notable for subgrid momentum transport and for atmospheric conditions associated with mid-latitude fronts and convective instability. Using an interpretability method, we find that the NN improvements partly rely on using the horizontal wind divergence, and we further show that including the divergence or vertical velocity as a separate input substantially improves offline performance. However, non-local winds continue to be useful inputs for parameterizating subgrid momentum transport even when the vertical velocity is included as an input. Overall, our results imply that the use of non-local variables and the vertical velocity as inputs could improve the performance of ML parameterizations, and the use of these inputs should be tested in online simulations in future work.

physics.ao-ph↗

Tropical precipitation clusters as islands on a rough water-vapor topography

Tropical precipitation clusters exhibit power-law frequency distributions in area and volume (integrated precipitation), implying a lack of characteristic scale in tropical convective organization. However, it remains unknown what gives rise to the power laws and how the power-law exponents for area and volume are related to one another. Here, we explore the perspective that precipitation clusters are islands above a convective threshold on a rough column-water-vapor (CWV) topography. This perspective is supported by the agreement between the precipitation clusters and CWV islands in their frequency distributions as well as fractal dimensions. Power laws exist for CWV islands at different thresholds through the CWV topography, suggesting that the existence of power-laws is not specifically related to local precipitation dynamics, but is rather a general feature of CWV islands. Furthermore, the frequency distributions and fractal dimensions of the clusters can be reproduced when the CWV field is modeled to be self-affine with a roughness exponent of 0.3. Self-affine scaling theory relates the statistics of precipitation clusters to the roughness exponent; it also relates the power-law slopes for area and volume without involving the roughness exponent. Thus, the perspective of precipitation clusters as CWV islands provides a useful framework to consider many statistical properties of the precipitation clusters, particularly given that CWV is well-observed over a wide range of length scales in the tropics. However, the statistics of CWV islands at the convective threshold imply a smaller roughness than is inferred from the power spectrum of the bulk CWV field, and further work is needed to understand the scaling of the CWV field.

physics.ao-ph↗

Use of neural networks for stable, accurate and physically consistent parameterization of subgrid atmospheric processes with good performance at reduced precision

A promising approach to improve climate-model simulations is to replace traditional subgrid parameterizations based on simplified physical models by machine learning algorithms that are data-driven. However, neural networks (NNs) often lead to instabilities and climate drift when coupled to an atmospheric model. Here we learn an NN parameterization from a high-resolution atmospheric simulation in an idealized domain by coarse graining the model equations and output. The NN parameterization has a structure that ensures physical constraints are respected, and it leads to stable simulations that replicate the climate of the high-resolution simulation with similar accuracy to a successful random-forest parameterization while needing far less memory. We find that the simulations are stable for a variety of NN architectures and horizontal resolutions, and that an NN with substantially reduced numerical precision could decrease computational costs without affecting the quality of simulations.

physics.ao-ph↗

Stable machine-learning parameterization of subgrid processes for climate modeling at a range of resolutions

Global climate models represent small-scale processes such as clouds and convection using quasi-empirical models known as parameterizations, and these parameterizations are a leading cause of uncertainty in climate projections. A promising alternative approach is to use machine learning to build new parameterizations directly from high-resolution model output. However, parameterizations learned from three-dimensional model output have not yet been successfully used for simulations of climate. Here we use a random forest to learn a parameterization of subgrid processes from output of a three-dimensional high-resolution atmospheric model. Integrating this parameterization into the atmospheric model leads to stable simulations at coarse resolution that replicate the climate of the high-resolution simulation. The parameterization obeys physical constraints and captures important statistics such as precipitation extremes. The ability to learn from a fully three-dimensional simulation presents an opportunity for learning parameterizations from the wide range of global high-resolution simulations that are now emerging.

physics.ao-ph↗

Using machine learning to parameterize moist convection: potential for modeling of climate, climate change and extreme events

The parameterization of moist convection contributes to uncertainty in climate modeling and numerical weather prediction. Machine learning (ML) can be used to learn new parameterizations directly from high-resolution model output, but it remains poorly understood how such parameterizations behave when fully coupled in a general circulation model (GCM) and whether they are useful for simulations of climate change or extreme events. Here, we focus on these issues using idealized tests in which an ML-based parameterization is trained on output from a conventional parameterization and its performance is assessed in simulations with a GCM. We use an ensemble of decision trees (random forest) as the ML algorithm, and this has the advantage that it automatically ensures conservation of energy and non-negativity of surface precipitation. The GCM with the ML convective parameterization runs stably and accurately captures important climate statistics including precipitation extremes without the need for special training on extremes. Climate change between a control climate and a warm climate is not captured if the ML parameterization is only trained on the control climate, but it is captured if the training includes samples from both climates. Remarkably, climate change is also captured when training only on the warm climate, and this is because the extratropics of the warm climate provides training samples for the tropics of the control climate. In addition to being potentially useful for the simulation of climate, we show that ML parameterizations can be interrogated to provide diagnostics of the interaction between convection and the large-scale environment.

physics.ao-ph↗

Understanding decreases in land relative humidity with global warming: conceptual model and GCM simulations

Climate models simulate a strong land-ocean contrast in the response of near-surface relative humidity to global warming: relative humidity tends to increase slightly over oceans but decrease substantially over land. Surface energy balance arguments have been used to understand the response over ocean but are difficult to apply over more complex land surfaces. Here, a conceptual box model is introduced, involving moisture transport between the land and ocean boundary layers and evapotranspiration, to investigate the decreases in land relative humidity as the climate warms. The box model is applied to idealized and full-complexity (CMIP5) general circulation model simulations, and it is found to capture many of the features of the simulated changes in land relative humidity. The box model suggests there is a strong link between fractional changes in specific humidity over land and ocean, and the greater warming over land than ocean then implies a decrease in land relative humidity. Evapotranspiration is of secondary importance for the increase in specific humidity over land, but it matters more for the decrease in relative humidity. Further analysis shows there is a strong feedback between changes in surface-air temperature and relative humidity, and this can amplify the influence on relative humidity of factors such as stomatal conductance and soil moisture.

physics.ao-ph↗

Precipitation extremes under climate change

The response of precipitation extremes to climate change is considered using results from theory, modeling, and observations, with a focus on the physical factors that control the response. Observations and simulations with climate models show that precipitation extremes intensify in response to a warming climate. However, the sensitivity of precipitation extremes to warming remains uncertain when convection is important, and it may be higher in the tropics than the extratropics. Several physical contributions govern the response of precipitation extremes. The thermodynamic contribution is robust and well understood, but theoretical understanding of the microphysical and dynamical contributions is still being developed. Orographic precipitation extremes and snowfall extremes respond differently from other precipitation extremes and require particular attention. Outstanding research challenges include the influence of mesoscale convective organization, the dependence on the duration considered, and the need to better constrain the sensitivity of tropical precipitation extremes to warming.

physics.ao-ph↗

Water vapor and the dynamics of climate changes

Water vapor is not only Earth's dominant greenhouse gas. Through the release of latent heat when it condenses, it also plays an active role in dynamic processes that shape the global circulation of the atmosphere and thus climate. Here we present an overview of how latent heat release affects atmosphere dynamics in a broad range of climates, ranging from extremely cold to extremely warm. Contrary to widely held beliefs, atmospheric circulation statistics can change non-monotonically with global-mean surface temperature, in part because of dynamic effects of water vapor. For example, the strengths of the tropical Hadley circulation and of zonally asymmetric tropical circulations, as well as the kinetic energy of extratropical baroclinic eddies, can be lower than they presently are both in much warmer climates and in much colder climates. We discuss how latent heat release is implicated in such circulation changes, particularly through its effect on the atmospheric static stability, and we illustrate the circulation changes through simulations with an idealized general circulation model. This allows us to explore a continuum of climates, constrain macroscopic laws governing this climatic continuum, and place past and possible future climate changes in a broader context.

physics.ao-ph↗