Searcharxiv⌕ Search

arXiv subjects

Xiaoyao Huang

Publications and source records attributed to Xiaoyao Huang.

8 recordsLinked to original sources

EStream: Fast and Memory-Efficient MoE Prefill through Expert Virtualization on Mobile NPUs

Mobile vendors and application developers increasingly deploy LLMs on smartphones for diverse prefill-only services. Yet current systems rely mainly on dense models whose regular computation maps efficiently to mobile NPUs, leaving more capable MoEs underused. MoE prefill does not fit mobile NPUs: NPU graphs are fixed at compile time, yet MoE picks experts at runtime; and one request touches most experts, more than a phone can hold in memory. We present EStream, which resolves both by separating what the NPU must fix from what MoE decides at runtime. A single compiled expert graph serves every expert, with each expert's routed tokens and weight address bound at call time, so dynamic MoE execution runs entirely on the NPU without padding or CPU/GPU fallback. Expert virtualization keeps the expert pool in UFS flash storage and pages it through a fixed-size NPU-addressable arena, group by group, with loading hidden behind computation, so memory is bounded by the arena rather than by the model. It further introduces a hardware-aware configuration algorithm that automatically configures the UFS--NPU pipeline and maximizes loading--computation overlap. Across 18 comparative settings covering three 7B--16B MoEs and 256--4,096-token prompts, we evaluate EStream on a commercial Snapdragon smartphone. Compared to the fastest baseline at each setting, EStream achieves a 2.25--27.57X pure-prefill TTFT speedup and reduces peak physical memory by 1.19--12.29X. EStream further scales to MoE models with up to 46.7B parameters.

cs.DC↗

A Necessary and Sufficient Hall Condition for Hypergraphs

We prove a necessary and sufficient Hall condition for a family $A=(A_e)_{e\in E(G)}$ of hypergraphs indexed by the edges of a forest \(G\). This restriction on the index graph is sharp. The loop-only case recovers the classical Hall's Theorem with multiplicities for arbitrary finite set systems, while the loopless case shows that full rainbow matching is polynomial time solvable under this forest structure, although the problem is NP-complete in general. As another application, we prove every $5$-tough chordal graph is Hamilton-connected, improving toughness bounds of $18$ for Hamiltonicity (1998) and $10$ for Hamilton-connectedness (2017).

math.CO↗

CLASP: Closed-loop Asynchronous Spatial Perception for Open-vocabulary Desktop Object Grasping

Robot grasping of desktop object is widely used in intelligent manufacturing, logistics, and agriculture.Although vision-language models (VLMs) show strong potential for robotic manipulation, their deployment in low-level grasping faces key challenges: scarce high-quality multimodal demonstrations, spatial hallucination caused by weak geometric grounding, and the fragility of open-loop execution in dynamic environments. To address these challenges, we propose Closed-Loop Asynchronous Spatial Perception(CLASP), a novel asynchronous closed-loop framework that integrates multimodal perception, logical reasoning, and state-reflective feedback. First, we design a Dual-Pathway Hierarchical Perception module that decouples high-level semantic intent from geometric grounding. The design guides the output of the inference model and the definite action tuples, reducing spatial illusions. Second, an Asynchronous Closed-Loop Evaluator is implemented to compare pre- and post-execution states, providing text-based diagnostic feedback to establish a robust error-correction loop and improving the vulnerability of traditional open-loop execution in dynamic environments. Finally, we design a scalable multi-modal data engine that automatically synthesizes high-quality spatial annotations and reasoning templates from real and synthetic scenes without human teleoperation. Extensive experiments demonstrate that our approach significantly outperforms existing baselines, achieving an 87.0% overall success rate. Notably, the proposed framework exhibits remarkable generalization across diverse objects, bridging the sim-to-real gap and providing exceptional robustness in geometrically challenging categories and cluttered scenarios.

cs.RO↗

Comparing Left and Right Quotient Sets in Groups

For a finite subset $A$ of a group $G$, we define the right quotient set and the left quotient set of $A$, respectively, as $AA^{-1} := \{a_1a_2^{-1}:a_1,a_2\in A\}$, $A^{-1}A := \{a_1^{-1}a_2:a_1,a_2\in A\}$. While the right and left quotient sets are equal if $G$ is abelian, subtleties arise when $G$ is a nonabelian group, where the cardinality difference $|AA^{-1}| - |A^{-1}A|$ may be take on arbitrarily large values. Using the results of Martin and O'Bryant on the cardinality differences of sum sets and difference sets in $\mathbb{Z}$, we prove in the infinite dihedral group, $D_\infty \cong \mathbb{Z} \rtimes \mathbb{Z}/2\mathbb{Z}$, every integer difference is achievable. Further, we prove that in $F_2$, the free group on $2$ generators, an integer difference is achievable if and only if that integer is even, and we explicitly construct subsets of $F_2$ that achieve every even integer. We further determine the minimum cardinality of $A \subset G$ so that the difference between the cardinalities of the left and right quotient sets is nonzero, depending on the existence of order $2$ elements in $G$. To prove these results, we construct difference graphs $D_A$ and $D_{A^{-1}}$ which encode equality, respectively, in the right and left quotient sets. We observe a bijection from edges in $D_A$ to edges in $D_{A^{-1}}$ and count connected components in order to obtain our results on cardinality differences $|AA^{-1}| - |A^{-1}A|$.

math.NT↗

Centered Moments of Weighted One-Level Densities of $GL(2)$ $L$-Functions

Katz and Sarnak conjectured that the behavior of zeros near the central point of any family of $L$-functions is well-modeled by the behavior of eigenvalues near $1$ of some classical compact group (either the symplectic, unitary, or even, odd, or full orthogonal group). In 2018, Knightly and Reno proved that the symmetry group can vary depending on how the $L$-functions in the family are weighted. They observed both orthogonal and symplectic symmetry in the one-level densities of families of cuspidal newform $L$-functions for different choices of weights. We observe the same dependence of symmetry on weights in the $n^{\text{th}}$ centered moments of these one-level densities, for smooth test functions whose Fourier transforms are supported in $\left(-\frac{1}{2n}, \frac{1}{2n}\right)$. To treat the new terms that emerge in our $n$-level calculations when $n>1$, i.e., the cross terms that emerge from $n$-fold products of primes rather than individual primes, we generalize Knightly and Reno's weighted trace formula from primes to arbitrary positive integers. We then perform a delicate analysis of these cross terms to distinguish their contributions to the main and error terms of the $n^{\text{th}}$ centered moments. The final novelty here is an elementary combinatorial trick that we use to rewrite the main number theoretic terms arising from our analysis, facilitating comparisons with random matrix theory.

math.NT↗

Signal recovery using Gabor frames

We present a novel probabilistic framework for the recovery of discrete signals with missing data, extending classical Fourier-based methods. While prior results, such as those of Donoho and Stark; see also Logan's method, guarantee exact recovery under strict deterministic sparsity constraints, they do not account for stochastic patterns of data loss. Our approach combines a row-wise Gabor transform with a probabilistic model for missing frequencies, establishing near-certain recovery when losses occur randomly. The key innovation is a maximal row-support criterion that allows unique reconstruction with high probability, even when the overall signal support significantly exceeds classical bounds. Specifically, we show that if missing frequencies are independently distributed according to a binomial law, the probability of exact recovery converges to $1$ as the signal size grows. This provides, to our knowledge, the first rigorous probabilistic recovery guarantee exploiting row-wise signal structure. Our framework offers new insights into the interplay between sparsity, transform structure, and stochastic loss, with immediate implications for communications, imaging, and data compression. It also opens avenues for future research, including extensions to higher-dimensional signals, adaptive transforms, and more general probabilistic loss models, potentially enabling even more robust recovery guarantees.

math.CA↗

Breaking Universality in the Lower Order Terms in the 1-level and 2-level Density of Holomorphic Cusp Newforms

The Katz-Sarnak density conjecture states that, as the analytic conductor $R \to \infty$, the distribution of the normalized low-lying zeros (those near the central point $s = 1/2$) converges to the scaling limits of eigenvalues clustered near 1 of subgroups of $U(N)$. There is extensive evidence supporting this conjecture for many families, including the family of holomorphic cusp newforms. Interestingly, there are very few choices for the main term of the limiting behavior. In 2009, S. J. Miller computed lower-order terms for the 1-level density of families of elliptic curve $L$-functions and compared to cuspidal newforms of prime level; while the main terms agreed, the lower order terms depended on the arithmetic of the family. We extend his work by identifying family-dependent lower-order correction terms in the weighted 1-level and 2-level densities of holomorphic cusp newforms up to $O\left(1/\log^4 R\right)$ error, sharpening Miller's $O\left(1/\log^3 R\right)$ error. We consider cases where the level is prime or when the level is a product of two, not necessarily distinct, primes. We show that the rates at which the prime factors of the level tend to infinity lead to different lower-order terms, breaking the universality of the main behavior.

math.NT↗

Efficient Distributed Retrieval-Augmented Generation for Enhancing Language Model Performance

Small language models (SLMs) support efficient deployments on resource-constrained edge devices, but their limited capacity compromises inference performance. Retrieval-augmented generation (RAG) is a promising solution to enhance model performance by integrating external databases, without requiring intensive on-device model retraining. However, large-scale public databases and user-specific private contextual documents are typically located on the cloud and the device separately, while existing RAG implementations are primarily centralized. To bridge this gap, we propose DRAGON, a distributed RAG framework to enhance on-device SLMs through both general and personal knowledge without the risk of leaking document privacy. Specifically, DRAGON decomposes multi-document RAG into multiple parallel token generation processes performed independently and locally on the cloud and the device, and employs a newly designed Speculative Aggregation, a dual-side speculative algorithm to avoid frequent output synchronization between the cloud and device. A new scheduling algorithm is further introduced to identify the optimal aggregation side based on real-time network conditions. Evaluations on real-world hardware testbed demonstrate a significant performance improvement of DRAGON-up to 1.9x greater gains over standalone SLM compared to the centralized RAG, substantial reduction in per-token latency, and negligible Time to First Token (TTFT) overhead.

cs.LG↗