SearcharxivSearch

arXiv subjects

Tianyu Zhao

Publications and source records attributed to Tianyu Zhao.

At least 19 recordsLinked to original sources

Self-supervised reconstruction of transients in data from space-borne gravitational-wave detectors

Space-based gravitational-wave (GW) data may contain transient signals whose waveform morphologies are not known in advance. Extracting these signals is important for characterizing new sources and mitigating instrumental anomalies. However, existing deep neural network (DNN)-based extraction approaches rely on clean training targets and waveform-class-specific examples, which may limit their applicability when the transient morphology is not specified in advance. This work develops a Noise2Noise (N2N)-inspired self-supervised framework that learns from noisy observations without clean training targets and requires no transient-specific waveform templates at inference. A single model trained on noisy massive black-hole binary (MBHB) observations provides high-overlap MBHB recovery and recovers the dominant morphologies of instrumental glitches and other GW transient signals such as cosmic string bursts in source-confused test data. Beyond waveform recovery, when independent information identifies a candidate transient as instrumental, its extracted waveform can be subtracted from the data without an anomaly-specific template. In a simulated continuous data stream, this procedure substantially suppresses the injected-anomaly power within the glitch-dominated frequency band. These results support the use of self-supervised extraction for initial waveform estimation of candidate transients with unknown morphologies, enabling subsequent characterization and, where appropriate, conditional subtraction of instrumental anomalies.

gr-qc

A unified reconstruction algorithm for reduced-frame structured illumination microscopy

Reduced-frame structured illumination microscopy (SIM) is attractive for live-cell imaging because it can improve temporal throughput and reduce photobleaching, but incomplete phase sampling makes reconstruction unstable and computationally demanding. Here we present URA-SIM, a unified reduced-acquisition framework that turns fixed reduced-frame measurements into pipeline- compatible raw stacks through model-consistent phase-domain completion. Instead of solving a large object-level inverse problem or replacing established SIM reconstruction, URA-SIM estimates the missing phase content on the low-dimensional phase-harmonic manifold required by the target modality and then delegates order separation and image formation to classical reconstruction pipeline. This design combines three practical advantages: fidelity from the SIM forward structure, lightweight online computation, and direct compatibility with existing reconstruction workflows. For 2D-SIM, URA-SIM uses the first-harmonic phase structure of three-phase SIM to estimate a shared zero-order field and complete missing phase samples by direction-wise harmonic fitting. On calibration and biological 2D-SIM data, reduced-frame reconstructions preserve resolvable structures and remain competitive on COS7 mitochondria comparison data. In live-cell COS7 mitochondria imaging, URA-SIM reconstructs each time point from five acquired raw frames and resolves mitochondrial cristae across different temporal sampling regimes. Experiments on 3D-SIM and nonlinear SIM further show that the same design principle can be transferred when the phase model and reconstruction-pipeline interface are adapted to the target modality. These results support URA-SIM as a transparent, model-consistent and computationally lightweight route from fixed reduced-frame acquisition to classical SIM reconstruction workflows.

physics.optics

BridgeAlign: Bridging Preference Alignment for Humanities and Social Sciences

While data synthesis for large language models (LLMs) is prevalent, it primarily targets domains with verifiable answers, overlooking open-ended humanities and social sciences (HSS), where nuanced quality judgments matter more than objective correctness. This makes preference alignment a natural paradigm for broad HSS tasks. Yet existing methods are either costly or not tailored to broad HSS disciplines. We thus propose BridgeAlign, among the first preference-alignment pipelines for broad HSS disciplines, with three phases: i) Seed Curation: curating HSS seed documents from web corpora via heuristic/LLM-based filtering and text refinement; ii) Preference Data Synthesis: generating preference triplets via persona-based instruction inversion with Q&A consistency checks; iii) Preference Optimization: moving beyond naive human-vs-model heuristics by first grounding preferences in HSS quality rubric, then generating transitional responses via controlled quality degradation to form near-boundary preference pairs for finer-grained quality discrimination. Aligning over 210k synthetic preference samples, BridgeAlign enables Qwen3-8B to achieve the best average across 17 benchmarks against 11 strong baselines; importantly, leading on both human-preference and knowledge-based capabilities at once, with no trade-off between them, as supported by extensive experiments and contextualized by existing theories.

cs.CL

HSS-Synth: Humanities and Social Sciences Data Synthesis for LLMs

High-quality, diverse data are vital for large language models (LLMs) but remain scarce and costly. Data synthesis is a viable alternative and succeeds on closed tasks, yet the humanities and social sciences (HSS) are overlooked, and their open-ended nature makes synthesis challenging. Moving beyond prior capability-centric, fragmented attempts, we adopt a subject-centric paradigm, define the first HSS domain system covering 14 mainstream fields, and introduce HSS-Synth, the first data synthesis pipeline for HSS. HSS-Synth comprises: (1) constructing seed documents from web corpora via multi-step filtering and text refinement evaluated by a judge; (2) specifying "requirements + persona" to backtranslate seed documents into diverse yet faithful instructions with a strict Q&A alignment check; and (3) breaking LLM response limits via teacher-forced Answering that feeds seed documents during response generation to anchor semantics, reduce hallucinations, and preserve tone and integrity. HSS-Synth yields 237k high-quality, diverse instruction-tuning samples that outperform 14 leading baselines on 16 benchmarks. The fine-tuned Qwen3-8B-Base sets a new SOTA and approaches the official Qwen3-8B, improving both human preference and knowledge capabilities without performance seesaws. Extensive experiments demonstrate HSS-Synth's robustness and transferability. Our code is publicly available at https://github.com/pengr/HSS-Synth.

cs.CL

Qwen-Audio-3.0-TTS: Freely Controllable and Highly Robust Speech Synthesis with Multi-Stage Training Paradigm

In this report, we present Qwen-Audio-3.0-TTS, a production-oriented speech synthesis system that jointly advances content consistency, speaker similarity, prosodic naturalness, audio quality, controllability, multilingual coverage, efficiency, and robustness. It combines a 12.5~Hz low-frame-rate speech tokenizer for reduced inference latency with a five-stage progressive training paradigm for coordinated language model (LM) and flow-matching model (FM) optimization. The model provides production-level control through free-style natural-language instructions and fine-grained inline tags, while supporting 16 languages, 20 Chinese dialect regions, one-pass long-form synthesis up to 3 minutes, and robust generation from noisy, reverberant, or unclear reference speech. Across SEED-TTS-Eval, CV3-Eval, instruction-following, long-form, and acoustic-robustness evaluations, Qwen-Audio-3.0-TTS achieves state-of-the-art performance on many reported dimensions or the strongest aggregate results. It also ranks first on the independent Artificial Analysis Text-to-Speech Leaderboard. These results establish Qwen-Audio-3.0-TTS as a strong foundation for production-level speech synthesis.

eess.AS

Contrastive Neural Algorithmic Reasoning for Graph Coloring

Graph coloring seeks to assigns colors to a graph's nodes so that adjacent nodes receive different colors, using as few colors as possible. Here, we study approximate $k$-coloring, where the goal is to use at most $k$ colors while minimizing the number of monochromatic edges. This problem is central to graph theory and has applications in areas such as scheduling and resource allocation. Recent unsupervised GNN approaches optimize each instance directly, precluding generalization across graph sizes and distributions. We instead propose a contrastive learning framework that learns transferable coloring geometry where the embeddings of same-color nodes align, while adjacent nodes' representations are pushed toward distinct directions. We analyze the resulting population objective over bounded-size graphs. For unit-norm embeddings, we show that its optima have a line-prototype structure: Representations of nodes of the same color collapse to a shared one-dimensional subspace, and edges connect orthogonal subspaces. This geometry yields stationarity conditions in the supervised setting and is preserved by projected subgradient dynamics under a balanced-coloring assumption. In an unnormalized variant, gradient descent has a max-margin bias governed by a quotient-graph hard-margin problem. Experiments on synthetic and real-world graphs show that contrastive GNN encoders generalize effectively and produce low-conflict colorings, matching and sometimes improving on greedy approaches.

cs.LG

Upper bounds on gaps between zeros of $L$-functions

We prove two unconditional upper bounds on the gaps between ordinates of consecutive non-trivial zeros of a general $L$-function $L(s)$. This extends previous work of Hall and Hayman (2000) on the Riemann zeta-function and work of Siegel (1945) on Dirichlet $L$-functions. Interestingly, we observe that while Hall and Hayman's method gives a sharper estimate when the degree of $L(s)$ is sufficiently small compared to the analytic conductor, Siegel's method does better in the other regime.

math.NT

Detection of Lensed Gravitational Waves in the Millihertz Band Using Frequency-Domain Lensing Feature Extraction Network

The space-based gravitational wave (GW) detectors are expected to observe lensed GW events, offering new opportunities for cosmology and fundamental physics.Across the millihertz band, lensing effects transition from the wave-optics regime at lower frequencies to the geometric-optics approximation at higher frequencies.Although traditional GW identification methods, such as matched filtering, are well established and effective, the intense computational resources required motivate the search for more efficient alternatives to accelerate candidate event screening. To address this bottleneck, we introduce a Dual-Channel Lensing feature extraction eXtended Long Short-Term Memory Network (DCL-xLSTM). Unlike conventional recurrent architectures, DCL-xLSTM uses a matrix-valued memory structure and a memory-mixing mechanism to effectively capture amplitude patterns that span the entire millihertz frequency band. Trained on data generated by Point Mass (PM) and Singular Isothermal Sphere (SIS) models accounting for the transition from wave-optics to geometric-optics, the proposed method achieves an area under the curve (AUC) exceeding 0.99, maintaining a true positive rate (TPR) above $98\%$ at a false positive rate (FPR) below $1\%$.The network is robust against variations in signal-to-noise ratio, lens type, and lens mass, establishing its viability as a high-efficiency tool for future space-based GW detection.

astro-ph.IM

Source localization realizes single frame super-resolution for fluorescence imaging

Existing super-resolution microscopy is often constrained by inherent trade-offs between resolution, acquisition speed, phototoxicity, and hardware complexity. Computational post-processing approaches offer a promising alternative, but they typically suffer from linearity distortion, high computational cost, reliance on pre-training data, or reconstruction artifacts. Here, we present Source Localization (SoLo), a novel single-frame super-resolution algorithm for fluorescence imaging without these limitations. Built on the principle of inferring fluorescent source positions via sampling-detection strategy, SoLo achieves non-iterative, parallelizable computation, enabling real-time live-cell imaging with high spatiotemporal resolution. The intensity linearity preservation of SoLo makes it compatible with quantitative analysis such as calcium imaging and fluorescence resonance energy transfer. We further extended this framework to 3D-SoLo for volumetric imaging and nonlinear SoLo (NL-SoLo) for high-density fluorescence fluctuation imaging. With its ease of parameter tuning and compatibility with existing imaging systems, SoLo offers an accessible solution for ordinary labs, enabling diverse biomedical imaging applications.

physics.optics

Unconditional estimates on the argument of Dirichlet $L$-functions with applications to low-lying zeros

We make explicit a result of Selberg on the argument of Dirichlet $L$-functions averaged over non-principal characters modulo a prime $q$. As a corollary, we show for all sufficiently large prime $q$ that the height of the lowest non-trivial zero of the corresponding family of $L$-functions is less than $1075\cdot \frac{2π}{\log q}$. Here the scaling factor $\frac{2π}{\log q}$ is the average spacing between consecutive low-lying zeros with height at most 1, say. We also obtain a lower bound on the proportion of $L$-functions whose first zero lies within a given multiple of the average spacing. These appear to be the first explicit unconditional results of their kinds.

math.NT

FluxMC: Rapid and High-Fidelity Inference for Space-Based Gravitational-Wave Observations

Bayesian inference in the physical sciences faces a fundamental challenge: the imperative for high-fidelity physical modeling often clashes with the intrinsic limitations of stochastic sampling algorithms. Complex, high-dimensional parameter spaces expose the universal vulnerability of conventional methods, e.g., Markov Chain Monte Carlo (MCMC), which struggle with the prohibitive costs of likelihood evaluations and the risk of entrapment in local optima. To resolve this impasse, we introduce FluxMC (Flow-guided Unbiased eXploration Monte Carlo), a machine learning-enhanced framework designed to shift the inference paradigm from blind local search to globally guided transport. It integrates Flow Matching with Parallel Tempering MCMC, effectively combining the global foresight of generative AI with the rigorous asymptotic convergence and local robustness of temperature-based sampling. We showcase the efficacy of this framework through the lens of space-based gravitational-wave (GW) astronomy -- a field representing the frontier of challenging parameter inversion. In the analysis of massive black hole binaries using high-fidelity waveforms (IMRPhenomHM), FluxMC achieves robust convergence in under five hours, whereas traditional Parallel Tempering MCMC fails to converge even after hundreds of hours, yielding high Jensen-Shannon divergences (JSD) of $O(10^{-1})$. Our method reduces the distributional error by two to three orders of magnitude. Furthermore, for computationally efficient models (IMRPhenomD), it eliminates systematic biases caused by local-optima entrapment. Ultimately, FluxMC removes the necessity to compromise between model accuracy and analysis speed, establishing a new computational foundation where scientific discovery is limited only by observational data quality, not by algorithmic capacity.

astro-ph.IM

APPA: Adaptive Preference Pluralistic Alignment for Fair Federated RLHF of LLMs

Aligning large language models (LLMs) with diverse human preferences requires pluralistic alignment, where a single model must respect the values of multiple distinct groups simultaneously. In federated reinforcement learning from human feedback (FedRLHF), these groups align a shared policy without centralizing preference data, which makes fair reward aggregation essential. Existing aggregation methods exhibit clear trade offs: average based aggregation systematically under aligns worst performing groups, while min aggregation prioritizes worst group performance at the cost of overall alignment. We propose APPA, an Adaptive Preference Pluralistic Alignment framework that dynamically reweights group level rewards based on historical alignment rewards. Our approach prioritizes under aligned groups without degrading well aligned ones, while requiring no access to raw preference data. Integrated into a proximal policy optimization (PPO) based FedRLHF pipeline and evaluated on GLOBALQA and OQA across three model families (Gemma 2 2B, Llama 3.2 3B, Qwen3 0.6B), APPA achieves strong fairness alignment trade offs, improving worst group alignment by up to 28% over average aggregation while maintaining higher overall alignment than min aggregation across most configurations.

cs.LG

The limits of bio-molecular modeling with large language models : a cross-scale evaluation

The modeling of bio-molecular system across molecular scales remains a central challenge in scientific research. Large language models (LLMs) are increasingly applied to bio-molecular discovery, yet systematic evaluation across multi-scale biological problems and rigorous assessment of their tool-augmented capabilities remain limited. We reveal a systematic gap between LLM performance and mechanistic understanding through the proposed cross-scale bio-molecular benchmark: BioMol-LLM-Bench, a unified framework comprising 26 downstream tasks that covers 4 distinct difficulty levels, and computational tools are integrated for a more comprehensive evaluation. Evaluation on 13 representative models reveals 4 main findings: chain-of-thought data provides limited benefit and may even reduce performance on biological tasks; hybrid mamba-attention architectures are more effective for long bio-molecular sequences; supervised fine-tuning improves specialization at the cost of generalization; and current LLMs perform well on classification tasks but remain weak on challenging regression tasks. Together, these findings provide practical guidance for future LLM-based modeling of molecular systems.

cs.LG

Conditional estimates on the argument of Dirichlet $L$-functions with applications to low-lying zeros

Under the generalized Riemann hypothesis, we use Beurling-Selberg extremal functions to bound the mean and mean square of the argument of Dirichlet $L$-functions to a large prime modulus $q$. As applications, we give alternative proofs of several results on low-lying zeros of $L(s,χ)$ and obtain a new lower bound on the proportion of $L(s,χ)$ modulo $q$ with zeros close to the central point $s=1/2$. In particular, we show conditionally that for any $β>1/4$, there exist a positive proportion of Dirichlet $L$-functions whose first zero has height less than $β$ times the average spacing between consecutive zeros.

math.NT

Density results for $r$-gaps between zeros of the Riemann zeta-function

Let $0<γ_1\leq γ_2\leq \ldots$ denote the positive ordinates of the non-trivial zeros of the Riemann zeta-function. A result first announced by Selberg states that there exist absolute constants $Θ, \vartheta>0$ such that for each $r\in \mathbb{N}$, \[ \limsup_{n\to \infty}\frac{γ_{n+r}-γ_n}{2πr/\log γ_n}\geq 1+\fracΘ{r^α} \qquad \text{and}\qquad \liminf_{n\to \infty}\frac{γ_{n+r}-γ_n}{2πr/\log γ_n}\leq 1-\frac{\vartheta}{r^α} \] where $α$ may be taken as $2/3$, or as $1/2$ if one assumes the Riemann hypothesis. This was recently proved by Conrey and Turnage-Butterbaugh under RH and by Inoue unconditionally. We prove that in fact a positive proportion of $r$-gaps are large (and small) to the above extent, and we provide explicit estimates for the sizes and proportions of these gaps. In the case $r=1$, this quantitatively improves an unconditional result of Simonič, Trudgian and Turnage-Butterbaugh.

math.NT

Train Short, Inference Long: Training-free Horizon Extension for Autoregressive Video Generation

Autoregressive video diffusion models have emerged as a scalable paradigm for long video generation. However, they often suffer from severe extrapolation failure, where rapid error accumulation leads to significant temporal degradation when extending beyond training horizons. We identify that this failure primarily stems from the spectral bias of 3D positional embeddings and the lack of dynamic priors in noise sampling. To address these issues, we propose FLEX (Frequency-aware Length EXtension), a training-free inference-time framework that bridges the gap between short-term training and long-term inference. FLEX introduces Frequency-aware RoPE Modulation to adaptively interpolate under-trained low-frequency components while extrapolating high-frequency ones to preserve multi-scale temporal discriminability. This is integrated with Antiphase Noise Sampling (ANS) to inject high-frequency dynamic priors and Inference-only Attention Sink to anchor global structure. Extensive evaluations on VBench demonstrate that FLEX significantly outperforms state-of-the-art models at 6x extrapolation (30s duration) and matches the performance of long-video fine-tuned baselines at 12x scale (60s duration). As a plug-and-play augmentation, FLEX seamlessly integrates into existing inference pipelines for horizon extension. It effectively pushes the generation limits of models such as LongLive, supporting consistent and dynamic video synthesis at a 4-minute scale. Project page is available at https://ga-lee.github.io/FLEX_demo.

cs.CV

TAP: A Token-Adaptive Predictor Framework for Training-Free Diffusion Acceleration

Diffusion models achieve strong generative performance but remain slow at inference due to the need for repeated full-model denoising passes. We present Token-Adaptive Predictor (TAP), a training-free, probe-driven framework that adaptively selects a predictor for each token at every sampling step. TAP uses a single full evaluation of the model's first layer as a low-cost probe to compute proxy losses for a compact family of candidate predictors (instantiated primarily with Taylor expansions of varying order and horizon), then assigns each token the predictor with the smallest proxy error. This per-token "probe-then-select" strategy exploits heterogeneous temporal dynamics, requires no additional training, and is compatible with various predictor designs. TAP incurs negligible overhead while enabling large speedups with little or no perceptual quality loss. Extensive experiments across multiple diffusion architectures and generation tasks show that TAP substantially improves the accuracy-efficiency frontier compared to fixed global predictors and caching-only baselines.

cs.CV

Towards Realistic Detection Pipelines of Taiji: New Challenges in Data Analysis and High-Fidelity Simulations of Space-Based Gravitational Wave Antenna

Taiji, a Chinese space-based gravitational wave (GW) detection project, aims to explore the millihertz GW universe with unprecedented sensitivity. By observing astrophysical and cosmological sources, including Galactic binaries, massive black hole binaries, extreme mass-ratio inspirals, and stochastic gravitational wave backgrounds, etc., Taiji is expected to deliver transformative insights into astrophysics, cosmology, and fundamental physics. However, Taiji's data analysis faces unique challenges compared to ground-based detectors like LIGO-Virgo-KAGRA, such as the overlap of numerous signals, extended data durations, more rigorous accuracy requirements for the waveform templates, incompletely characterized noise spectra, non-stationary noises, and various data anomalies. Taking Taiji as a representative example, this paper reviews the data characteristics and data analysis challenges of space-based GW detection, and introduces the second round of Taiji Data Challenge, a collection of simulation datasets designed as a shared platform for resolving these critical issues. This platform distinguishes itself from previous works by the systematic integration of orbital dynamics based on a full drag-free and attitude control simulation, extended noise sources, more complicated and overlapping GW signals, second-generation time-delay interferometry, and the coupling effect of time-varying arm-lengths, etc. Concurrently released is the open-source toolkit Triangle, which offers the capabilities for customized simulation of signals, noises, and other instrumental effects. By taking a step further towards realistic detection, Taiji Data Challenge II and Triangle altogether serve as a new testbed, supporting the development of Taiji's global analysis and end-to-end pipelines, and ultimately bridging the gaps between observation and scientific objectives.

gr-qc