SearcharxivSearch

arXiv subjects

Justin Willson

Publications and source records attributed to Justin Willson.

2 recordsLinked to original sources

Winter Precipitation Type Diagnosis and Uncertainty Quantification with a Physically Consistent Machine Learning Method

Accurately forecasting winter precipitation type and its transitions is critical for high-impact decision making. However, existing methods struggle in thermodynamically ambiguous regimes, and most do not quantify forecast uncertainty from a single model run. We developed an evidential neural network that predicts calibrated probabilities for four winter precipitation types (rain, snow, freezing rain, and ice pellets) along with epistemic uncertainty estimates at the computational cost of a standard neural network. The model was trained on quality-controlled and curated observations from the crowd-sourced mPING dataset paired with vertical thermodynamic profiles from the NOAA Rapid Refresh model analyses. Rigorous physical quality control removed thermodynamically implausible reports. Bulk evaluation against held-out mPING observations from June 2020 through June 2022 shows the ML model outperforms area-based deterministic methods in success ratio for freezing rain and ice pellets while maintaining comparable or better performance for rain and snow. A reduced freezing rain probability of detection reflects genuinely ambiguous thermodynamic environments rather than a uniform model deficiency and is more robustly represented through the full probability distribution than through the dominant predicted class alone. Thermodynamic regime analysis demonstrates that model prediction errors are physically structured and concentrated in interpretable regions of diagnostic space consistent with the known difficulty of freezing rain and ice pellet discrimination. We further demonstrate the model's physical consistency and operational utility through two contrasting mid-western U.S. winter storm case studies and an interactive visualization tool that enables dynamic interrogation of model predictions and uncertainty in real time.

physics.ao-ph

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Robust quantification of predictive uncertainty is critical for understanding factors that drive weather and climate outcomes. Ensembles provide predictive uncertainty estimates and can be decomposed physically, but both physics and machine learning ensembles are computationally expensive. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but do not account for epistemic uncertainty.. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainty with one model. This study compares the uncertainty derived from evidential neural networks to those obtained from ensembles. Through applications of classification of winter precipitation type and regression of surface layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods, while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. In order to encourage broader adoption of evidential deep learning in Earth System Science, we have developed a new Python package, MILES-GUESS (https://github.com/ai2es/miles-guess), that enables users to train and evaluate both evidential and ensemble deep learning.

cs.LG