Searcharxiv⌕ Search

arXiv subjects

Qingfeng Sun

Publications and source records attributed to Qingfeng Sun.

At least 19 recordsLinked to original sources

Quantum Variance for Hecke--Maass Cusp Forms on the Vertical Geodesic

Let $X=\mathrm{PSL}_2(\mathbb Z)\backslash\mathbb H$, and let $\{u_j\}$ be an orthonormal basis of even Hecke--Maass cusp forms on $X$ with Laplace eigenvalues $1/4+t_j^2$. For a real-valued $ψ\in C_c^\infty(0,\infty)$, define \[ μ_j(ψ)=\int_0^\inftyψ(y)|u_j(iy)|^2\,\frac{dy}{y}, \qquad M(ψ)=\frac6π\int_0^\inftyψ(y)\,\frac{dy}{y}. \] For $T\ge2$, $1\le U\le T$, and every $\varepsilon>0$, we prove \[ \sum_{\substack{u_j\ {\rm even}\\T 0$, if $T^θ\le U\le T$, then all but \[ O_{ψ,θ,η,\varepsilon} \!\left(T^{1+2η+\varepsilon}\right) \] of the even forms with $T<t_j\le T+U$ satisfy $μ_j(ψ)=M(ψ)+O(T^{-η})$. In particular, the exceptional proportion tends to zero in this short spectral interval.

math.NT↗

A $\mathrm{GL}_3$ level analog of Selberg's result for $S(t)$

Let $π$ be a spherical cuspidal $\mathrm{GL}_3$ newform of prime level $N$ and trivial central character, and define $S(t,π)=π^{-1}\arg L(1/2+\textrm{i}t,π)$. Assuming the generalized Riemann hypothesis for $L(s,π)$, we establish an asymptotic formula for each fixed weighted moment of $S(t,π)$ as $N\to\infty$, for fixed $t>0$. Consequently, under the same weights, $S(t,π)/\sqrt{\log\log N}$ converges in distribution to a centered Gaussian distribution of variance $1/(2π^2)$. The key input is a weighted orthogonality formula derived from the Kuznetsov formula of prime level.

math.NT↗

Hunyuan-A13B Technical Report

We present Hunyuan-A13B, an open-source large language model based on a Mixture-of-Experts architecture. It contains 80 billion total parameters but activates only 13 billion during inference, balancing model capability, computational efficiency, and deployment cost. The model is pretrained on a rigorously filtered 20T-token corpus with enhanced STEM data curation, improving factual reliability and reasoning ability. High-quality supervised fine-tuning and large-scale reinforcement learning further enhance its overall performance. Hunyuan-A13B also introduces a dual-mode Chain-of-Thought framework that adapts reasoning depth to task complexity: fast thinking for routine queries and slow thinking for complex, multi-step problems. Evaluations show competitive performance across mathematics, science, programming, general language understanding, and agent tasks, often approaching that of much larger models. Its high inference throughput makes it suitable for latency-sensitive applications. We release Hunyuan-A13B to support open research and practical LLM deployment.

cs.AI↗

VeriEvol: Scaling Multimodal Mathematical Reasoning via Verifiable Evol-Instruct

Scaling reinforcement learning for visual mathematical reasoning requires more than generating harder questions: as data volume grows, the reward labels themselves must remain reliable. Yet existing data pipelines scale supervision while trusting the labeller, and policy-side methods assume the underlying answers are already correct. We instead treat scaling as a verifiable data-construction problem and decouple two axes before any policy update: prompt difficulty, expanded by route-specific evolution operators, and answer reliability, enforced by offline hypothesis-test falsification. We instantiate this as VeriEvol, an iterative framework with two extensible components: a type-aware evolution module that rewrites low-difficulty image-question seeds into harder, image-grounded prompts; and HTV-Agent, a verifier that accepts an answer only after multi-source counter-evidence has failed to refute it. The resulting verified data scales in volume, extends by adding evolution routes or verifier channels, and plugs directly into existing GRPO-style RL recipes. On a five-benchmark visual-math suite, scaling evolved SFT data from 10K to 250K samples raises the mean accuracy from 35.42 to 54.73; then, with backbone, SFT initialization, and GRPO recipe held fixed, VeriEvol adds a cumulative +3.88 over an un-evolved RL baseline, of which +1.82 comes from evolved prompts and +2.06 from the HTV-Agent verifier. We release the prompts, data, models, code, and the full verifier trace of every sample, so that downstream work can scale and audit the pipeline rather than only inspect its outputs.

cs.AI↗

STARE: Surprisal-Guided Token-Level Advantage Reweighting for Policy Entropy Stability

Reinforcement Learning with Verifiable Rewards algorithms like GRPO have emerged as the dominant post-training paradigm for complex reasoning in LLMs, yet commonly suffer from policy entropy collapse during training. We conduct a first-order gradient analysis of token-level entropy dynamics under GRPO and identify a token-level credit assignment mismatch: the per-token entropy variation decomposes into the product of the trajectory-level advantage and an entropy sensitivity function over the next-token distribution, yielding an advantage-surprisal four-quadrant structure and a near-criticality property. Motivated by it, we propose STARE (Surprisal-guided Token-level Advantage Reweighting for policy Entropy stability), which identifies entropy-critical token subsets via batch-internal surprisal quantiles, selectively reweights their effective advantages, and incorporates a target-entropy closed-loop gate for stable entropy regulation. Across model scales from 1.5B to 32B and three task families (Short CoT, Long CoT, and Multi-Turn Tool Use), STARE sustains stable RL training over thousands of steps while maintaining policy entropy within the target band. On AIME24 and AIME25, STARE outperforms DAPO and other competitive baselines by 4%-8% in average accuracy, with reflection tokens and response length growing in tandem, indicating sustained exploration-exploitation balance that further unlocks RL training potential.Code is available at https://github.com/hp-luo/STARE.

cs.LG↗

On $\rm GL_3$ Fourier coefficients over values of mixed powers

Let $A_π(n,1)$ be the $(n,1)$-th Fourier coefficient of the Hecke-Maass cusp form $π$ for $\rm SL_3(\mathbb{Z})$ and $ ω(x)$ be a smooth compactly supported function. In this paper, we prove a nontrivial upper bound for the sum $$ \sum_{n_1,\cdots,n_\ell,n_{\ell+1}\in \mathbb{Z}_+ \atop n=n_1^r+\cdots+n_{\ell}^r+n_{\ell+1}^s} A_π(n,1)ω\left(n/X\right), $$ where $r\geq2$, $s\geq 2$ and $\ell\geq 2^{r-1}$ are integers.

math.NT↗

On a level analog of Selberg's result on $S(t)$

Let $S(t,f)=π^{-1}\arg L(1/2+it, f)$, where $f$ is a holomorphic Hecke cusp form of weight $2$ and prime level $q$. In this paper, we establish an unconditional asymptotic formula for the moments of $S(t,f)$, providing a level aspect analogue of Selberg's classical work on $S(t)$. As a consequence, we derive a weighted central limit theorem for the distribution of $S(t,f)$ normalized by $\sqrt{\log\log q}$. To this end, we develop a precise approximation for $S(t,f)$ via a truncated Dirichlet series and employ a weighted zero-density estimate for the corresponding family of $L$-functions.

math.NT↗

RubricBench: Aligning Model-Generated Rubrics with Human Standards

As Large Language Model (LLM) alignment evolves from simple completions to complex, highly sophisticated generation, Reward Models are increasingly shifting toward rubric-guided evaluation to mitigate surface-level biases. However, the community lacks a unified benchmark to assess this evaluation paradigm, as existing benchmarks lack both the discriminative complexity and the ground-truth rubric annotations required for rigorous analysis. To bridge this gap, we introduce RubricBench, a curated benchmark with 1,147 pairwise comparisons specifically designed to assess the reliability of rubric-based evaluation. Our construction employs a multi-dimensional filtration pipeline to target hard samples featuring nuanced input complexity and misleading surface bias, augmenting each with expert-annotated, atomic rubrics derived strictly from instructions. Comprehensive experiments reveal a substantial capability gap between human-annotated and model-generated rubrics, indicating that even state-of-the-art models struggle to autonomously specify valid evaluation criteria, lagging considerably behind human-guided performance.

cs.AI↗

AgentMath: Empowering Mathematical Reasoning for Large Language Models via Tool-Augmented Agent

Large Reasoning Models (LRMs) like o3 and DeepSeek-R1 have achieved remarkable progress in reasoning tasks with long cot. However, they remain computationally inefficient and struggle with accuracy when solving problems requiring complex mathematical operations. In this work, we present AgentMath, an agent framework that seamlessly integrates language models' reasoning capabilities with code interpreters' computational precision to efficiently tackle complex mathematical problems. Our approach introduces three key innovations: (1) An automated method that converts natural language chain-of-thought into structured tool-augmented trajectories, generating high-quality supervised fine-tuning (SFT) data to alleviate data scarcity; (2) A novel agentic reinforcement learning (RL) paradigm that dynamically interleaves natural language generation with real-time code execution. This enables models to autonomously learn optimal tool-use strategies through multi-round interactive feedback, while fostering emergent capabilities in code refinement and error correction; (3) An efficient training system incorporating innovative techniques, including request-level asynchronous rollout scheduling, agentic partial rollout, and prefix-aware weighted load balancing, achieving 4-5x speedup and making efficient RL training feasible on ultra-long sequences with scenarios with massive tool invocation. The evaluations show that AgentMath achieves state-of-the-art performance on challenging mathematical competition benchmarks including AIME24, AIME25, and HMMT25. Specifically, AgentMath-30B-A3B attains 90.6%, 86.4%, and 73.8% accuracy respectively, surpassing OpenAI-o3-mini and Claude-Opus-4.0-Thinking while remaining competitive with OpenAI-o3, Gemini-2.5-Pro, and DeepSeek-R1-671B-0528.These results validate the effectiveness of our approach and pave the way for building scalable mathematical reasoning agents.

cs.AI↗

Beyond Length Scaling: Synergizing Breadth and Depth for Generative Reward Models

Recent advancements in Generative Reward Models (GRMs) have demonstrated that scaling the length of Chain-of-Thought (CoT) reasoning considerably enhances the reliability of evaluation. However, current works predominantly rely on unstructured length scaling, ignoring the divergent efficacy of different reasoning mechanisms: Breadth-CoT (B-CoT, i.e., multi-dimensional principle coverage) and Depth-CoT (D-CoT, i.e., substantive judgment soundness). To address this, we introduce Mix-GRM, a framework that reconfigures raw rationales into structured B-CoT and D-CoT through a modular synthesis pipeline, subsequently employing Supervised Fine-Tuning (SFT) and Reinforcement Learning with Verifiable Rewards (RLVR) to internalize and optimize these mechanisms. Comprehensive experiments demonstrate that Mix-GRM establishes a new state-of-the-art across five benchmarks, surpassing leading open-source RMs by an average of 8.2\%. Our results reveal a clear divergence in reasoning: B-CoT benefits subjective preference tasks, whereas D-CoT excels in objective correctness tasks. Consequently, misaligning the reasoning mechanism with the task directly degrades performance. Furthermore, we demonstrate that RLVR acts as a switching amplifier, inducing an emergent polarization where the model spontaneously allocates its reasoning style to match task demands. The synthesized data and models are released at \href{https://huggingface.co/collections/DonJoey/mix-grm}{Hugging Face}, and the code is released at \href{https://github.com/Don-Joey/Mix-GRM}{Github}.

cs.AI↗

OffSeeker: Online Reinforcement Learning Is Not All You Need for Deep Research Agents

Deep research agents have shown remarkable potential in handling long-horizon tasks. However, state-of-the-art performance typically relies on online reinforcement learning (RL), which is financially expensive due to extensive API calls. While offline training offers a more efficient alternative, its progress is hindered by the scarcity of high-quality research trajectories. In this paper, we demonstrate that expensive online reinforcement learning is not all you need to build powerful research agents. To bridge this gap, we introduce a fully open-source suite designed for effective offline training. Our core contributions include DeepForge, a ready-to-use task synthesis framework that generates large-scale research queries without heavy preprocessing; and a curated collection of 66k QA pairs, 33k SFT trajectories, and 21k DPO pairs. Leveraging these resources, we train OffSeeker (8B), a model developed entirely offline. Extensive evaluations across six benchmarks show that OffSeeker not only leads among similar-sized agents but also remains competitive with 30B-parameter systems trained via heavy online RL.

cs.AI↗

On an unconditional $\rm GL_3$ analog of Selberg's result

Let $F$ be a Hecke--Maass cusp form for $\mathrm{SL}_3(\mathbb{Z})$ with the Langlands parameter $μ_{F}=\big(μ_{F,1},μ_{F,2},μ_{F,3}\big)$ and the associated $L$-function $L(s, F)$. Define $S_F(t)=π^{-1}\arg L(1/2+\mathrm{i}t, F)$. When $μ_{F}$ is in generic position, we establish an unconditional asymptotic formula for the moments of $S_F(t)$. Previously, such a formula was only known to hold under the Generalized Riemann Hypothesis. The key ingredient is a weighted zero-density estimate in the spectral aspect for $L(s, F)$, which has recently been proved by Sun and Wang in arXiv:2412.02416.

math.NT↗

Equidistribution of holomorphic cusp forms on thin sets

We find some equidistribution results connected to restriction quantum unique ergodicity problem in this paper. We shows that \begin{align*} \frac{1}{|\mathcal{B}_k|}\sum_{f\in \mathcal{B}_k} \int_{R}y^{k}|f(z)|^{2}ψ(z) dμ_{R}(z)\to \frac{3}π\int_{R}ψ(z) dμ_{R}(z) \end{align*} where $R$ is some subset of $\mathbb{H}$, $ψ$ is a nice function relative to $R$, $dμ_{R}(z)$ is a suitable measure on $R$, and $\mathcal{B}_k$ is an orthonormal basis of the cusp forms for group $Γ$ with respect to weight $k$.

math.NT↗

Zero Reinforcement Learning Towards General Domains

Zero Reinforcement Learning (Zero-RL) has proven to be an effective approach for enhancing the reasoning capabilities of large language models (LLMs) by directly applying reinforcement learning with verifiable rewards on pretrained models, without the need for a supervised fine-tuning phase. However, current research on zero-RL primarily focuses on domains with easily verifiable reward signals, such as mathematics, programming, and other reasoning tasks. The challenge of eliciting reasoning abilities in more diverse scenarios, where verification is not straightforward, remains underexplored. To address this gap, we propose a novel zero-RL paradigm designed to improve a model's reasoning ability across both verifiable and non-verifiable domains. By combining verifiable rewards with a generative reward model, we conduct multi-task zero-RL training across both domains, facilitating the transfer of reasoning capabilities between them. Furthermore, to mitigate reward hacking in the generative reward model, we design a smooth length penalty that encourages the generation of more comprehensive thinking tokens in general domains. Experimental results on Qwen3-8B-Base and Qwen3-14B-Base demonstrate that our approach achieves superior reasoning performance, not only on tasks requiring extensive reasoning but also on more general tasks.

cs.AI↗

Hunyuan-TurboS: Advancing Large Language Models through Mamba-Transformer Synergy and Adaptive Chain-of-Thought

As Large Language Models (LLMs) rapidly advance, we introduce Hunyuan-TurboS, a novel large hybrid Transformer-Mamba Mixture of Experts (MoE) model. It synergistically combines Mamba's long-sequence processing efficiency with Transformer's superior contextual understanding. Hunyuan-TurboS features an adaptive long-short chain-of-thought (CoT) mechanism, dynamically switching between rapid responses for simple queries and deep "thinking" modes for complex problems, optimizing computational resources. Architecturally, this 56B activated (560B total) parameter model employs 128 layers (Mamba2, Attention, FFN) with an innovative AMF/MF block pattern. Faster Mamba2 ensures linear complexity, Grouped-Query Attention minimizes KV cache, and FFNs use an MoE structure. Pre-trained on 16T high-quality tokens, it supports a 256K context length and is the first industry-deployed large-scale Mamba model. Our comprehensive post-training strategy enhances capabilities via Supervised Fine-Tuning (3M instructions), a novel Adaptive Long-short CoT Fusion method, Multi-round Deliberation Learning for iterative improvement, and a two-stage Large-scale Reinforcement Learning process targeting STEM and general instruction-following. Evaluations show strong performance: overall top 7 rank on LMSYS Chatbot Arena with a score of 1356, outperforming leading models like Gemini-2.0-Flash-001 (1352) and o4-mini-2025-04-16 (1345). TurboS also achieves an average of 77.9% across 23 automated benchmarks. Hunyuan-TurboS balances high performance and efficiency, offering substantial capabilities at lower inference costs than many reasoning models, establishing a new paradigm for efficient large-scale pre-trained models.

cs.CL↗

WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct

Large language models (LLMs), such as GPT-4, have shown remarkable performance in natural language processing (NLP) tasks, including challenging mathematical reasoning. However, most existing open-source models are only pre-trained on large-scale internet data and without math-related optimization. In this paper, we present WizardMath, which enhances the mathematical CoT reasoning abilities of LLMs without using external python tools, by applying our proposed Reinforcement Learning from Evol-Instruct Feedback (RLEIF) method to the domain of math. Through extensive experiments on two mathematical reasoning benchmarks, namely GSM8k and MATH, we reveal the extraordinary capabilities of our model. Remarkably, WizardMath-Mistral 7B surpasses top-tier open-source LLMs by a substantial margin with higher data efficiency. Furthermore, WizardMath 70B even outperforms GPT-3.5-Turbo, Claude 2, Gemini Pro and GPT-4-early-version. Additionally, our preliminary exploration highlights the pivotal role of instruction evolution and process supervision in achieving exceptional math performance. For more details refer to https://github.com/nlpxucan/WizardLM

cs.CL↗

A Selberg-type zero-density result for twisted $\rm GL_2$ $L$-functions and its application

Let $f$ be a fixed holomorphic primitive cusp form of even weight $k$, level $r$ and trivial nebentypus $χ_r$. Let $q$ be an odd prime with $(q,r)=1$ and let $χ$ be a primitive Dirichlet character modulus $q$ with $χ\neqχ_r$. In this paper, we prove an unconditional Selberg-type zero-density estimate for the family of twisted $L$-functions $L(s, f \otimes χ)$ in the critical strip. As an application, we establish an asymptotic formula for the even moments of the argument function $S(t, f \otimes χ)=π^{-1}\arg L(1/2+ıt, f\otimesχ)$ and prove a central limit theorem for its distribution over $χ$ of modulus $q$.

math.NT↗

WizardLM: Empowering large pre-trained language models to follow complex instructions

Training large language models (LLMs) with open-domain instruction following data brings colossal success. However, manually creating such instruction data is very time-consuming and labor-intensive. Moreover, humans may struggle to produce high-complexity instructions. In this paper, we show an avenue for creating large amounts of instruction data with varying levels of complexity using LLM instead of humans. Starting with an initial set of instructions, we use our proposed Evol-Instruct to rewrite them step by step into more complex instructions. Then, we mix all generated instruction data to fine-tune LLaMA. We call the resulting model WizardLM. Human evaluations on a complexity-balanced test bed and Vicuna's testset show that instructions from Evol-Instruct are superior to human-created ones. By analyzing the human evaluation results of the high complexity part, we demonstrate that outputs from our WizardLM are preferred to outputs from OpenAI ChatGPT. In GPT-4 automatic evaluation, WizardLM achieves more than 90\% capacity of ChatGPT on 17 out of 29 skills. Even though WizardLM still lags behind ChatGPT in some aspects, our findings suggest that fine-tuning with AI-evolved instructions is a promising direction for enhancing LLMs. Our code and data are public at https://github.com/nlpxucan/WizardLM

cs.CL↗