arXiv subjects

Shu Tao

Publications and source records attributed to Shu Tao.

3 recordsLinked to original sources

arXiv2026

A Flexible Adaptive Stable Clustering Algorithm for Archive-Scale Online Mass Spectrometry

Modern online mass spectrometry generates multi-terabyte data streams critical for understanding Earth's environmental systems. However, extracting actionable chemical insights from these repositories is impeded by a computational bottleneck: existing clustering methods force a compromise among scalability, metric flexibility, and algorithmic stability. Here, we introduce Flexible Adaptive Stable Clustering (FASC), a dynamical systems framework that resolves these constraints by architecturally decoupling the similarity kernel from rigorous optimization logic. Unlike legacy heuristics that suffer from stochastic drift and algorithmic blending, FASC employs a Density-Augmented Similarity Selection rule and geometric constraints to guarantee deterministic, order-independent convergence. After validating FASC on canonical machine-learning ground truths (achieving >99.5% cluster purity and 0.99 Adjusted Rand Index), we deployed the framework on 25 million mass spectra of atmospheric aerosols. Demonstrating strictly linear empirical runtime scaling (O(N)), FASC autonomously mapped atmospheric aging pathways of secondary inorganic aerosols while isolating ultra-rare industrial tracers (<0.2% abundance), providing a scalable infrastructure for mining environmental big data.

cs.LG↗

arXiv2025

Vertical Profile Corrected Satellite NH3 Retrievals Enable Accurate Agricultural Emission Characterization in China

Ammonia (NH3) emissions significantly contribute to atmospheric pollution, yet discrepancies exist between bottom-up inventories and satellite-constrained top-down estimates, with the latter typically one-third higher. This study quantifies how assumptions about NH3 vertical distribution in satellite retrievals contribute to this gap. By implementing spatially and temporally resolved vertical profiles from the Community Multiscale Air Quality model to replace steep gradients in Infrared Atmospheric Sounding Interferometer (IASI) retrievals, we reduced satellite-model column discrepancies from 71% to 18%. We subsequently constrained NH3 emissions across China using a hybrid inversion framework combining iterative mass balance and four-dimensional variational methods. Our posterior emissions showed agreement with the a priori inventory (7.9% lower), suggesting that discrepancies between inventory approaches were amplified by overestimation of near-surface NH3 in baseline satellite retrievals, potentially causing a 43% overestimation of growing season emissions. Evaluation against ground-based measurements confirmed improved model performance, with normalized root-mean-square error reductions of 1-27% across six months. These findings demonstrate that accurate representation of vertical profiles in satellite retrievals is critical for robust NH3 emission estimates and can reconcile the long-standing discrepancy between bottom-up and top-down approaches. Our hybrid inversion methodology, leveraging profile-corrected satellite data, reveals that China's NH3 emissions exhibit greater spatial concentration than previously recognized, reflecting agricultural intensification. This advancement enables timely and accurate characterization of rapidly changing agricultural emission patterns, critical for implementing effective nitrogen pollution control measures.

physics.ao-ph↗

arXiv2020

Crossing Variational Autoencoders for Answer Retrieval

Answer retrieval is to find the most aligned answer from a large set of candidates given a question. Learning vector representations of questions/answers is the key factor. Question-answer alignment and question/answer semantics are two important signals for learning the representations. Existing methods learned semantic representations with dual encoders or dual variational auto-encoders. The semantic information was learned from language models or question-to-question (answer-to-answer) generative processes. However, the alignment and semantics were too separate to capture the aligned semantics between question and answer. In this work, we propose to cross variational auto-encoders by generating questions with aligned answers and generating answers with aligned questions. Experiments show that our method outperforms the state-of-the-art answer retrieval method on SQuAD.

cs.CL↗