Searcharxiv⌕ Search

arXiv subjects

Yang Xu

Publications and source records attributed to Yang Xu.

At least 109 records · Page 6Linked to original sources

Emergence of a symmetry-broken Chern insulator near a moiré Kondo breakdown

Moiré semiconductors built on angle-aligned transition metal dichalcogenide (TMD) heterobilayers provide a physical realization of the Kondo lattice model, in which one TMD layer is prepared in a Mott insulating state supporting a lattice of local magnetic moments and the other layer in a metallic state supporting itinerant carriers. The artificial Kondo lattice enables the exploration of exotic states of matter near a continuously tunable Kondo breakdown. Here we report the emergence of a symmetry-broken Chern insulator at a moiré hole filling factor 4/3 in angle-aligned MoTe2/WSe2 moiré bilayers, which realize a chiral Kondo lattice. The symmetry-broken Chern insulator, which exhibits integer quantized Hall conductance at a fractional moiré filling, breaks the translational symmetry of the lattice spontaneously; it also appears only near a magnetic field-induced Kondo breakdown in the mixed-valence regime of the material. We further demonstrate that the magnetic field required to induce the Kondo breakdown and to stabilize the symmetry-broken Chern insulator is twist angle dependent. The results present new opportunities for exploring the subtle interplay between topology and Kondo interactions in moiré semiconductors.

cond-mat.mes-hall↗

Paraphrase Types Elicit Prompt Engineering Capabilities

Much of the success of modern language models depends on finding a suitable prompt to instruct the model. Until now, it has been largely unknown how variations in the linguistic expression of prompts affect these models. This study systematically and empirically evaluates which linguistic features influence models through paraphrase types, i.e., different linguistic changes at particular positions. We measure behavioral changes for five models across 120 tasks and six families of paraphrases (i.e., morphology, syntax, lexicon, lexico-syntax, discourse, and others). We also control for other prompt engineering factors (e.g., prompt length, lexical diversity, and proximity to training data). Our results show a potential for language models to improve tasks when their prompts are adapted in specific paraphrase types (e.g., 6.7% median gain in Mixtral 8x7B; 5.5% in LLaMA 3 8B). In particular, changes in morphology and lexicon, i.e., the vocabulary used, showed promise in improving prompts. These findings contribute to developing more robust language models capable of handling variability in linguistic expression.

cs.CL↗

LH-Deception: Simulating and Understanding LLM Deceptive Behaviors in Long-Horizon Interactions

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to capture the long-horizon interactions in which deceptive strategies typically unfold. We introduce a new simulation framework, LH-Deception, for a systematic, empirical quantification of deception in LLMs under extended sequences of interdependent tasks and dynamic contextual pressures. LH-Deception is designed as a multi-agent system: a performer agent tasked with completing tasks and a supervisor agent that evaluates progress, provides feedback, and maintains evolving states of trust. An independent deception auditor then reviews full trajectories to identify when and how deception occurs. We conduct extensive experiments across 11 frontier models, spanning both closed-source and open-source systems, and find that deception is model-dependent, increases with event pressure, and consistently erodes supervisor trust. Qualitative analyses further reveal emergent, long-horizon phenomena, such as ``chains of deception", which are invisible to static, single-turn evaluations. Our findings provide a foundation for evaluating future LLMs in real-world, trust-sensitive contexts.

cs.CL↗

A Unified View of Attention and Residual Sinks: Outlier-Driven Rescaling is Essential for Transformer Training

We investigate the functional role of emergent outliers in large language models, specifically attention sinks (a few tokens that consistently receive large attention logits) and residual sinks (a few fixed dimensions with persistently large activations across most tokens). We hypothesize that these outliers, in conjunction with the corresponding normalizations (\textit{e.g.}, softmax attention and RMSNorm), effectively rescale other non-outlier components. We term this phenomenon \textit{outlier-driven rescaling} and validate this hypothesis across different model architectures and training token counts. This view unifies the origin and mitigation of both sink types. Our main conclusions and observations include: (1) Outliers function jointly with normalization: removing normalization eliminates the corresponding outliers but degrades training stability and performance; directly clipping outliers while retaining normalization leads to degradation, indicating that outlier-driven rescaling contributes to training stability. (2) Outliers serve more as rescale factors rather than contributors, as the final contributions of attention and residual sinks are significantly smaller than those of non-outliers. (3) Outliers can be absorbed into learnable parameters or mitigated via explicit gated rescaling, leading to improved training performance (average gain of 2 points) and enhanced quantization robustness (1.2 points degradation under W4A4 quantization).

cs.CL↗

TaQ-DiT: Time-aware Quantization for Diffusion Transformers

Transformer-based diffusion models, dubbed Diffusion Transformers (DiTs), have achieved state-of-the-art performance in image and video generation tasks. However, their large model size and slow inference speed limit their practical applications, calling for model compression methods such as quantization. Unfortunately, existing DiT quantization methods overlook (1) the impact of reconstruction and (2) the varying quantization sensitivities across different layers, which hinder their achievable performance. To tackle these issues, we propose innovative time-aware quantization for DiTs (TaQ-DiT). Specifically, (1) we observe a non-convergence issue when reconstructing weights and activations separately during quantization and introduce a joint reconstruction method to resolve this problem. (2) We discover that Post-GELU activations are particularly sensitive to quantization due to their significant variability across different denoising steps as well as extreme asymmetries and variations within each step. To address this, we propose time-variance-aware transformations to facilitate more effective quantization. Experimental results show that when quantizing DiTs' weights to 4-bit and activations to 8-bit (W4A8), our method significantly surpasses previous quantization methods.

eess.IV↗

Systematicity between Forms and Meanings across Languages Supports Efficient Communication

Languages vary widely in how meanings map to word forms. These mappings have been found to support efficient communication; however, this theory does not account for systematic relations within word forms. We examine how a restricted set of grammatical meanings (e.g. person, number) are expressed on verbs and pronouns across typologically diverse languages. Consistent with prior work, we find that verb and pronoun forms are shaped by competing communicative pressures for simplicity (minimizing the inventory of grammatical distinctions) and accuracy (enabling recovery of intended meanings). Crucially, our proposed model uses a novel measure of complexity (inverse of simplicity) based on the learnability of meaning-to-form mappings. This innovation captures fine-grained regularities in linguistic form, allowing better discrimination between attested and unattested systems, and establishes a new connection from efficient communication theory to systematicity in natural language.

cs.CL↗

Engineering of Orbital Hybridization: An Exotic Strategy to Manipulate Orbital Current

Current-induced spin-orbit torque (SOT) plays a crucial role in the next-generation spin-orbitronics. Enhancing its efficiency is both fundamentally and practically interesting and remains a challenge to date. Recently, orbital counterparts of spin effects that do not rely on the spin-orbit coupling (SOC) have been found as an alternative mechanism to realize it. This work highlights the engineering of copper oxidation states for manipulating the orbital current and its torque in the CuO$_x$-based heterostructures. The orbital hybridization and thus the orbital-Rashba-Edelstein effect at the CuO$_x$/Cu interfaces are significantly enhanced by increasing the copper oxidation state, yielding a torque efficiency that is almost ten times larger than the conventional heavy metals. The Cu$_4$O$_3$/Cu interface, rather than the widely accepted CuO/Cu interface, is revealed to account for the enhanced SOT performance in the CuO$_x$-based heterostructures. In addition, the torque efficiency can be alternatively switched between high and low thresholds through the redox reaction. The current results establish an exotic and robust strategy for engineering the orbital current and SOT for spin-orbitronics, which applies to other weak-SOC materials.

cond-mat.mtrl-sci↗

VoCodec: An Efficient Lightweight Low-Bitrate Speech Codec

Recent advancements in end-to-end neural speech codecs enable compressing audio at extremely low bitrates while maintaining high-fidelity reconstruction. Meanwhile, low computational complexity and low latency are crucial for real-time communication. In this paper, we propose VoCodec, a speech codec model featuring a computational complexity of only 349.29M multiply-accumulate operations per second (MACs/s) and a latency of 30 ms. With the competitive vocoder Vocos as its backbone, the proposed model ranked fourth on Track 1 in the 2025 LRAC Challenge and achieved the highest subjective evaluation score (MUSHRA) on the clean speech test set. Additionally, we cascade a lightweight neural network at the front end to extend its capability of speech enhancement. Experimental results demonstrate that the two systems achieve competitive performance across multiple evaluation metrics. Speech samples can be found at https://acceleration123.github.io/.

eess.AS↗

A non-equilibrium strategy for the general synthesis of single-atom catalysts

Single-atom catalysts (SACs) maximize atom efficiency and exhibit unique electronic structures, yet realizing precise and scalable atomic dispersion remains a key challenge. Here, we report a non-equilibrium strategy for the scalable synthesis of SACs via ion implantation, enabling precise stabilization of metal atoms on diverse supports. Using an industrial-grade ion source, wafer-scale ion implantation with milliampere-level beam currents enables high-throughput fabrication of SACs, while the synergistic energy-mass effects stabilize isolated metal atoms in situ. A library of 36 SACs was constructed, and the resulting Pt/MoS2 exhibits outstanding hydrogen evolution performance with an overpotential of only 26 mV at 10 mA cm-2 and exceptional long-term stability, surpassing commercial Pt/C. This work demonstrates ion implantation as a versatile platform bridging fundamental SACs design and scalable manufacturing, providing new opportunities for high-performance catalysts in energy conversion applications.

cond-mat.mtrl-sci↗

Judge Q: Trainable Queries for Optimized Information Retention in KV Cache Eviction

Large language models (LLMs) utilize key-value (KV) cache to store historical information during sequence processing. The size of KV cache grows linearly as the length of the sequence extends, which seriously affects memory usage and decoding efficiency. Current methods for KV cache eviction typically utilize the last window from the pre-filling phase as queries to compute the KV importance scores for eviction. Although this scheme is simple to implement, it tends to overly focus on local information, potentially leading to the neglect or omission of crucial global information. To mitigate this issue, we propose Judge Q, a novel training method which incorporates a soft token list. This method only tunes the model's embedding layer at a low training cost. By concatenating the soft token list at the end of the input sequence, we train these tokens' attention map to the original input sequence to align with that of the actual decoded tokens. In this way, the queries corresponding to the soft tokens can effectively capture global information and better evaluate the importance of the keys and values within the KV cache, thus maintaining decoding quality when KV cache is evicted. Under the same eviction budget, our method exhibits less performance degradation compared to existing eviction approaches. We validate our approach through experiments conducted on models such as Llama-3.1-8B-Instruct and Mistral-7B-Instruct-v0.3, using benchmarks including LongBench, RULER, and Needle-in-a-Haystack. Results indicate an improvement of approximately 1 point on the LongBench and over 3 points on RULER. This proposed methodology can be seamlessly integrated into existing open-source models with minimal training overhead, thereby enhancing performance in KV cache eviction scenarios.

cs.CL↗

HAPNet: Toward Superior RGB-Thermal Scene Parsing via Hybrid, Asymmetric, and Progressive Heterogeneous Feature Fusion

Data-fusion networks have shown significant promise for RGB-thermal scene parsing. However, the majority of existing studies have relied on symmetric duplex encoders for heterogeneous feature extraction and fusion, paying inadequate attention to the inherent differences between RGB and thermal modalities. Recent progress in vision foundation models (VFMs) trained through self-supervision on vast amounts of unlabeled data has proven their ability to extract informative, general-purpose features. However, this potential has yet to be fully leveraged in the domain. In this study, we take one step toward this new research area by exploring a feasible strategy to fully exploit VFM features for RGB-thermal scene parsing. Specifically, we delve deeper into the unique characteristics of RGB and thermal modalities, thereby designing a hybrid, asymmetric encoder that incorporates both a VFM and a convolutional neural network. This design allows for more effective extraction of complementary heterogeneous features, which are subsequently fused in a dual-path, progressive manner. Moreover, we introduce an auxiliary task to further enrich the local semantics of the fused features, thereby improving the overall performance of RGB-thermal scene parsing. Our proposed HAPNet, equipped with all these components, demonstrates superior performance compared to all other state-of-the-art RGB-thermal scene parsing networks, achieving top ranks across three widely used public RGB-thermal scene parsing datasets. We believe this new paradigm has opened up new opportunities for future developments in data-fusion scene parsing approaches.

cs.CV↗

PTalker: Personalized Speech-Driven 3D Talking Head Animation via Style Disentanglement and Modality Alignment

Speech-driven 3D talking head generation aims to produce lifelike facial animations precisely synchronized with speech. While considerable progress has been made in achieving high lip-synchronization accuracy, existing methods largely overlook the intricate nuances of individual speaking styles, which limits personalization and realism. In this work, we present a novel framework for personalized 3D talking head animation, namely "PTalker". This framework preserves speaking style through style disentanglement from audio and facial motion sequences and enhances lip-synchronization accuracy through a three-level alignment mechanism between audio and mesh modalities. Specifically, to effectively disentangle style and content, we design disentanglement constraints that encode driven audio and motion sequences into distinct style and content spaces to enhance speaking style representation. To improve lip-synchronization accuracy, we adopt a modality alignment mechanism incorporating three aspects: spatial alignment using Graph Attention Networks to capture vertex connectivity in the 3D mesh structure, temporal alignment using cross-attention to capture and synchronize temporal dependencies, and feature alignment by top-k bidirectional contrastive losses and KL divergence constraints to ensure consistency between speech and mesh modalities. Extensive qualitative and quantitative experiments on public datasets demonstrate that PTalker effectively generates realistic, stylized 3D talking heads that accurately match identity-specific speaking styles, outperforming state-of-the-art methods. The source code and supplementary videos are available at: PTalker.

cs.CV↗

Embedding Samples Dispatching for Recommendation Model Training in Edge Environments

Training deep learning recommendation models (DLRMs) on edge workers brings several benefits, particularly in terms of data privacy protection, low latency and personalization. However, due to the huge size of embedding tables, typical DLRM training frameworks adopt one or more parameter servers to maintain global embedding tables, while leveraging the edge workers cache part of them. This incurs significant transmission cost for embedding transmissions between workers and parameter servers, which can dominate the training cycle. In this paper, we investigate how to dispatch input embedding samples to appropriate edge workers to minimize the total embedding transmission cost when facing edge-specific challenges such as heterogeneous networks and limited resources. We develop ESD, a novel mechanism that optimizes the dispatch of input embedding samples to edge workers based on expected embedding transmission cost. We propose HybridDis as the dispatch decision method within ESD, which combines a resource-intensive optimal algorithm and a heuristic algorithm to balance decision quality and resource consumption. We implement a prototype of ESD and compare it with state-of-the-art mechanisms on real-world workloads. Extensive experimental results show that ESD reduces the embedding transmission cost by up to 36.76% and achieves up to 1.74 times speedup in end-to-end DLRM training.

cs.DC↗

Scalable low-latency entanglement distribution for distributed quantum computing

Practical distributed quantum computing and error correction require quantum networks with high-qubit-rate, high-fidelity, and low-reconfiguration-latency. Unfortunately, current approaches are limited by fundamental constraints: single-channel entanglement rates remain at the MHz level with millisecond-level reconfiguration, which is insufficient for fault-tolerant distributed quantum computing. Here, we propose a quantum network architecture that leverages reconfigurable quantum interfaces and wavelength-selective switches to overcome bandwidth and latency constraints. By tuning the frequency and temporal modes of photonic qubits across dense wavelength division multiplexing (DWDM) channels, our protocol achieves an entanglement generation rate of up to 183.4 MHz based on our comprehensive modeling of the networked cold atom computing systems. Our architecture enables nanosecond-scale network reconfiguration with low loss, low infidelity, and high dimensionality. Our modeling and simulation are designed for deployable distributed quantum computing and error correction, integrating the quantum interface, network switching, circuit compilation, and execution into a unified framework. The proposed architecture is fully compatible with industry-standard DWDM infrastructure, providing a scalable and cost-effective foundation for distributed quantum computing.

quant-ph↗

Electrified EHL line contact with dielectric breakdown of lubricant -- a numerical model

With the rapid growth of the electric vehicles with drive systems with higher voltages, power outputs, frequencies, and speeds, mitigating electrically induced bearing damage (EIBD) in electric motors has become critical. In this study, a novel numerical model characterizing discharge-induced current density and voltage drop at the elastohydrodynamic lubrication line contact interface is presented. The current density and voltage drop constitute a linear complimentarily problem, which is efficiently solved using the conjugate gradient method. This paper sheds light on electrical characteristics at the inaccessible lubrication interface during discharge, highlighting the significance of roughness radius of curvature on current density. This numerical model lays the groundwork for future research on mitigating or even permanently solving EIBD problems in electric motor bearings.

physics.app-ph↗

Investigating the origin of topological-Hall-like resistivity in Zn-doped Mn2Sb ferrimagnet

Skyrmions and other chiral spin textures have been extensively studied as potential building blocks for novel spintronic devices. Hall-resistivity anomalies that deviate from magnetization scaling, known as the topological Hall effect, have been widely employed as evidence for the presence of chiral spin textures in magnetic materials. However, recent studies on magnetic thin films have revealed a drawback of this approach, as the presumed topological Hall contribution may in fact originate from trivial mechanisms. Here, we investigate the magnetic and transport properties of a Zn-doped Mn2Sb ferrimagnet, whose related compounds have previously been suggested to exhibit a topological Hall effect arising from chiral spin textures. Hall-resistivity anomalies are also observed in our sample, yet they show little correlation with the magnetic or metamagnetic transitions and are therefore clearly distinct from those in magnetic compounds hosting chiral spin textures. Most importantly, additional Lorentz transmission electron microscopy measurements rule out the existence of chiral spin textures in this ferrimagnet. Therefore, instead of a nontrivial origin, we attribute the Hall-resistivity anomalies to the combined effect of multiple anomalous Hall channels resulting from sample inhomogeneity. Our work shows that the difficulties of identifying chiral spin textures through transport measurements also apply to bulk systems, prompting some existing results to be revisited.

cond-mat.str-el↗

Anomalous Hall effect and rich magnetic phase diagram of Mn$_{100-x}$Rh$_{x}$ epitaxial films

A series of Mn$_{100-x}$Rh$_x$ ($20 \le x \le 50$) thin films were epitaxially grown on the MgO substrate using magnetron sputtering technique, and were systematically investigated by magnetization, longitudinal electrical resistivity, and transverse Hall resistivity. After optimizing the growth conditions, phase-pure Mn$_{100-x}$Rh$_x$ films with a cubic CsCl-type structure were obtained, and their magnetic phase diagram was built. The manipulation of Rh content leads to a rich magnetic phase diagram, where three different regimes can be identified: for $x < 40$, Mn$_{100-x}$Rh$_x$ films undergo a ferromagnetic (FM) transition below $T_\mathrm{C} \approx$ 330-350 K; for $40 \le x \le 45$, in addition to the FM transition at $T_\mathrm{C} \approx$ 200 K, Mn$_{100-x}$Rh$_x$ films undergo a FM-to-antiferromagnetic (AFM) transition at $T_\mathrm{N} \approx$ 120 K; finally for $x > 45$, only one AFM transition at $T_\mathrm{N} \approx$ 150 K can be tracked. All the Mn$_{100-x}$Rh$_x$ films exhibit distinct anomalous Hall effect in their magnetically ordered state, which is most likely due to the intrinsic Berry-curvature mechanism. In addition, all the anomalous Hall transport properties, including the resistivity, conductivity, and angle exhibit a strong correlation with the magnetic properties of Mn$_{100-x}$Rh$_x$ films, which become most evident for $x$ = 35. Our systematic investigations suggest a strong correlation between magnetic properties and electronic band topology in Mn$_{100-x}$Rh$_x$ films, highlighting their great potential for AFM spintronics.

cond-mat.str-el↗

Finite-Sample Analysis of Policy Evaluation for Robust Average Reward Reinforcement Learning

We present the first finite-sample analysis of policy evaluation in robust average-reward Markov Decision Processes (MDPs). Prior work in this setting have established only asymptotic convergence guarantees, leaving open the question of sample complexity. In this work, we address this gap by showing that the robust Bellman operator is a contraction under a carefully constructed semi-norm, and developing a stochastic approximation framework with controlled bias. Our approach builds upon Multi-Level Monte Carlo (MLMC) techniques to estimate the robust Bellman operator efficiently. To overcome the infinite expected sample complexity inherent in standard MLMC, we introduce a truncation mechanism based on a geometric distribution, ensuring a finite expected sample complexity while maintaining a small bias that decays exponentially with the truncation level. Our method achieves the order-optimal sample complexity of $\tilde{\mathcal{O}}(ε^{-2})$ for robust policy evaluation and robust average reward estimation, marking a significant advancement in robust reinforcement learning theory.

stat.ML↗