SearcharxivSearch

arXiv subjects

Haixia Xiao

Publications and source records attributed to Haixia Xiao.

3 recordsLinked to original sources

Hurdle-RMIL: Addressing Zero Inflation and Long-Tailed Imbalance in Infrared Rainfall Retrieval

Imbalanced labels can cause frequent samples to dominate AI-based quantitative remote sensing, degrading rare-event retrieval. In rain-rate retrieval based on satellite infrared brightness temperatures, this imbalance leads to systematic underestimation of rare high-intensity rainfall. In this study, Hurdle-Retrieval Model Imbalanced Learning (RMIL) is proposed. Following a divide-and-conquer strategy, Hurdle-RMIL separates zero inflation from the long-tailed distribution of positive rain. A hurdle model handles zero inflation, whereas RMIL exploits invariance under fixed observation conditions of the rainfall-to-satellite forward process to derive a Bayes-based transformation linking conditional distributions under naturally long-tailed and hypothetical balanced rainfall. This transformation enables the balanced-distribution model to be learned from natural samples without constructing a balanced dataset. Comparisons with conventional learning, classification-regression modeling, cost-sensitive learning, and generative learning using test data from multiple regions in China show that Hurdle-RMIL mitigates systematic underestimation and improves detection of rare high-intensity and extreme rainfall without markedly degrading lower-threshold accuracy. At 0.1-10 mm per hour, its root mean square error remains close to those of the best baselines, and it yields the highest equitable threat score (ETS) at most evaluated thresholds, with its advantage becoming more pronounced at high thresholds. At 30 mm per hour, its ETS is 0.051 versus 0.015 for the best baseline, and its mean error is -25.41 mm per hour versus -28.98 mm per hour. Case studies further show improved representations of rainfall intensity and spatial extent, demonstrating that Hurdle-RMIL effectively addresses rainfall-distribution imbalance and improves the retrieval of rare high-intensity rainfall.

cs.LG

High-resolution ensemble retrieval of cloud properties for all-day based on geostationary satellite

Clouds play a critical role in Earth's hydrological and energy cycles, and accurately representing their properties is essential for effective numerical modeling and weather forecasting. Machine learning methods have been widely used for cloud property retrieval; however, most existing techniques are deterministic and do not incorporate uncertainty quantification. Generative machine learning has made significant advances in various domains, including natural language processing, image generation, and notably weather forecasting, where it has enabled ensemble predictions and the quantification of forecast uncertainty. This ability to quantify uncertainty offers valuable opportunities for cloud remote sensing. In this study, we propose a novel cloud property retrieval method, CloudDiff, based on a generative diffusion model. By leveraging thermal infrared observations from the Himawari-8 Advanced Himawari Imager (AHI), CloudDiff generates high spatiotemporal resolution cloud properties for both daytime and nighttime conditions, increasing the resolution of Himawari-8/AHI cloud retrievals from 2 km to 1 km. Unlike deterministic retrieval methods, CloudDiff generates multiple samples from the underlying probability distribution, allowing for a diverse range of plausible retrievals and taking steps towards providing uncertainty assessment. Additionally, CloudDiff produces sharper samples and better captures fine local features, enhancing the precision of cloud property retrieval. By averaging over the ensemble of generated samples, we demonstrate that both the accuracy and reliability of the retrievals are significantly improved. These high-resolution cloud properties have been successfully applied to analyze extreme weather events, such as typhoons, providing potentially valuable insights into atmospheric processes.

physics.ao-ph

Intelligent Shanghai Typhoon Model (ISTM): A generative probabilistic emulator for typhoon hybrid modeling

To address the systematic underestimation of typhoon intensity in artificial intelligence weather prediction (AIWP) models, we propose the Intelligent Shanghai Typhoon Model (ISTM): a unified regional-to-typhoon generative probabilistic forecasting system based on a two-stage UNet-Diffusion framework. ISTM learns a downscaling mapping from 4 years of 25 km ERA5 reanalysis to a 9 km high resolution typhoon reanalysis dataset, enabling the generation of kilometer-scale near-surface variables and maximum radar reflectivity from coarse resolution fields. The evaluation results show that the two-stage UNet-Diffusion model significantly outperforms both ERA5 and the baseline UNet regression in capturing the structure and intensity of surface winds and precipitation. After fine-tuning, ISTM can effectively map AIFS forecasts, an advanced AIWP model, to high-resolution forecasts from AI-physics hybrid Shanghai Typhoon Model, substantially enhancing typhoon intensity predictions while preserving track accuracy. This positions ISTM as an efficient AI emulator of hybrid modeling system, achieving fast and physically consistent downscaling. The proposed framework establishes a unified pathway for the co-evolution of AIWP and physics-based numerical models, advancing next-generation typhoon forecasting capabilities.

physics.ao-ph