SearcharxivSearch

arXiv subjects

Shuang Su

Publications and source records attributed to Shuang Su.

6 recordsLinked to original sources

TuringLLM: Efficiently Scaling Foundation Models Toward Physical AI

We present Turing-20B-A2B, a 20B-parameter Mixture-of-Experts language model that activates approximately 2B parameters per token, designed for long-context and latency-sensitive physical AI applications. The model adopts Quantile Routing in a dynamic top-k configuration, enabling token-adaptive expert allocation while maintaining balanced expert utilization and a controlled average compute budget. During deployment, we further apply capacity-constrained routing to prompt prefill for more regular and efficient expert execution, while retaining dropless routing during pretraining. Turing-20B-A2B also employs a hybrid attention architecture that combines Lightning Attention with a small number of full-attention layers for efficient long-context modeling. The model is pretrained with a progressive three-stage curriculum and extended to a native context length of 128K through continued pretraining, with further inference-time extension to 512K using YaRN. Despite its compact active-parameter budget, Turing-20B-A2B achieves, at the base-model stage, overall general capability exceeding Qwen3-8B Base and approaching Qwen3.5-9B Base, while maintaining strong long-context performance and favorable prefill-latency scaling. These results demonstrate an effective balance among model capability, long-context scalability, and practical inference efficiency.

cs.AI

TuringViT: Making SOTA Vision Transformers Accessible to All

Modern VLMs and VLA systems commonly adopt off-the-shelf ViTs such as SigLIP2 as visual encoders, but diverse downstream requirements in latency, temporal modeling, and VLM integration often call for customized SOTA-level ViTs. Training such encoders remains beyond the reach of much of the community, as it requires massive image-text data, while standard softmax attention makes high-resolution or dynamic-resolution pretraining prohibitively costly and often forces low-resolution pretraining followed by post-hoc adaptation. TuringViT addresses these challenges with three key designs: Turing Linear Attention (TLA) for efficient sequence modeling, VISTA-Curation to construct supervision-rich image-video training data, and native dynamic-resolution pretraining that supports flexible inputs from the start and transfers seamlessly to downstream VLMs. As a result, TuringViT outperforms leading open-source ViT baselines with only 10% of the data, achieves stronger downstream VLM performance, and delivers substantially better latency scaling on high-resolution inputs. Our scaling-law analysis further shows that TuringViT continues to improve predictably with curated data scale, far from saturation. Its fast adaptation, hardware-friendly design, and efficient deployment have made it a unified visual foundation across XPeng's AI systems. More broadly, TuringViT provides a reproducible pipeline that dramatically lowers the cost for the community to train, customize, and deploy SOTA-level ViTs, moving toward making such Vision Transformers accessible to all.

cs.CV

Singularity of non-pluripolar cohomology classes

We establish a relation between Lelong numbers and the full mass property of relative non-pluripolar products. We use this relation to prove that if the restricted volume of a big class $\alpha$ along an effective divisor $D$ is of full mass, then the Lelong numbers of the non-pluripolar class $\langle \alpha^{n-1}\rangle$ at every point in the support of $D$ are zero. In particular, we obtain that on projective manifolds, the Lelong numbers of the non-pluripolar class $\langle \alpha^{n-1}\rangle$ of a big class $\alpha$ are zero.

math.CV

Relative non-pluripolar product of currents on compact Hermitian manifolds

Let $(X,\omega)$ be a compact Hermitian manifold. Assume that the Hermitian form $\omega$ satisfies $\partial \overline{\partial} \omega=0$, $\partial \omega \wedge \overline{\partial}\omega=0$. We prove that the relative non-pluripolar product is well-defined on $X$ and satisfies the monotonicity property, generalizing Vu's results in the K\"ahler setting.

math.DG

Singularities of currents of full mass intersection

In this paper, we study currents that have full mass intersection with respect to given currents in the mixed setting on a compact K\"ahler manifold. We compare their singularities by using Lelong numbers. Our main theorems generalize some results of Vu.

math.CV

Volumes of components of Lelong upper level sets II

Let $X$ be a compact Kähler manifold of dimension $n$, and let $T$ be a closed positive $(1,1)$-current in a nef cohomology class on $X$. We establish an optimal upper bound for the volume of components of Lelong upper level sets of $T$ in terms of cohomology classes of non-pluripolar self-products of $T$.

math.CV