Searcharxiv⌕ Search

arXiv subjects

Shuai Yuan

Publications and source records attributed to Shuai Yuan.

At least 19 recordsLinked to original sources

Gamer: A Generalist Vision-Language-Action Foundation Model for Long-Horizon Real-Time Game Agent

We introduce Gamer, a generalist agent framework built for long-horizon tasks in complex interactive environments. Its end-to-end architecture combines perception, memory management, and multi-step reasoning. A shared training and deployment pipeline supports interaction with both conventional 2D graphical interfaces and complex 3D simulated worlds. We first continue pre-training on a dataset constructed from tens of thousands of hours of device-level keyboard and mouse interaction. These trajectories span simulated games and embodied environments, allowing the model to learn environmental dynamics across both physical and virtual domains. Sparse-thinking instruction tuning then substantially reduces redundant computation while preserving the reasoning needed for complex decisions. We train the policy for long-horizon interaction with a stable multi-turn reinforcement learning method that addresses finite context windows, accumulated rollout errors, and sparse rewards. For real-time interaction, a cloud-edge inference engine serves numerous simulated game environments concurrently, supports unbounded-context execution, and keeps online inference latency low. Across multiple challenging 3D open-world games, Gamer demonstrates solid generalization and operational efficiency comparable to skilled players. It also achieves competitive results on a range of conventional 2D game benchmarks. These results suggest that even repetitive keyboard and mouse trajectories can support substantial gains from scaling data and learning algorithms. Training on these trajectories helps Gamer learn complex skills more steadily in environments with both physical and digital properties. This approach offers a path toward generalist agents that can interact across digital and physical worlds.

cs.CL↗

Probing the inhomogeneous phases in magnetized quark matter via the bosonic two-point function

We investigate the stability of homogeneous chiral condensates in magnetized quark matter within the two-flavor Nambu-Jona-Lasinio model. By expanding the effective action to quadratic order, we derive the full momentum-dependent bosonic two-point function in a constant magnetic field. At zero temperature, our analytical results show that each occupied Landau level produces a sharp logarithmic divergence at its corresponding Fermi momentum. This severe Peierls instability is driven by one-dimensional Fermi surface nesting within the effectively 1+1-dimensional subsystems created by Landau quantization. Numerically, we map out the momentum-space topography of the two-point function across varying magnetic fields and temperatures. We find that strong magnetic fields induce deep negative canyons. While thermal fluctuations smooth these canyons into shallower valleys as the temperature increases, the negative regions remain robust at intermediate temperatures and only vanish entirely at sufficiently high temperatures. Intriguingly, at larger chemical potentials where the system is strictly stable, a broad positive basin with a flat curvature at the origin persists at non-zero momentum. This non-monotonic dispersion is the hallmark of a moat regime, acting as a precursor state that strongly signals a residual tendency toward inhomogeneous chiral symmetry breaking. Our findings provide valuable insights into the phase structure of dense, magnetized quark matter.

hep-ph↗

Evaluating Instrument-Centered AI Agents for Table-Top Science Experiments

Reliable evaluation of AI agents for table-top science experiments has remained elusive because live instruments are hard to reset and share at scale, while instrument statefulness and safety constraints complicate evaluation. We introduce instrMCP and q-devBench, an evaluation stack for instrument-centered AI agents in table-top experiments. instrMCP connects coding agents to scientific instruments through the Model Context Protocol, serving as the instrument-access harness. q-devBench reconstructs 37 real experimental tasks from condensed-matter physics as virtual QCoDeS instruments covering quantum electronic transport, scanning probe imaging, and calibration workflows. q-devBench exposes reproducible failure modes in laboratory-agent systems while preserving realistic instrument-control workflows. Across a range of commercial coding-agent configurations, current systems already show substantial operational competence, satisfying 70-83% of measurement-related rubric criteria. The main bottleneck is scientific analysis, where performance falls to 28-46%. In an analysis-only ablation in which agents receive clean reference datasets without running the virtual measurement session, analysis performance improves substantially, closing roughly two thirds of the difference between the measurement and analysis scores. This suggests that much of the deficit arises from the measurement-session context, including tool-use overhead, longer context, measurement-planning decisions, and possible acquisition errors, while a residual scientific-reasoning gap remains. Together, instrMCP and q-devBench provide a practical sandbox for benchmarking, diagnosing, and improving laboratory AI harnesses, and establish a route from controlled virtual evaluation to future live-hardware validation.

cond-mat.mes-hall↗

MCSplat: Multi-View Photometric and Geometric Consistent Feed-Forward Gaussian Splatting for Driving Scenes

Driving-scene reconstruction via feed-forward Gaussian splatting from sparse multi-view images remains challenging due to two factors. First, cross-camera photometric inconsistency, caused by variations in exposure, ISP, and illumination, can be incorrectly absorbed into Gaussian geometry. Second, unreliable local geometric supervision arises from normal-based constraints near depth discontinuities. To address these issues, we present \textbf{MCSplat}, a multi-view consistent feed-forward Gaussian splatting framework for driving scenes. MCSplat constructs a canonical appearance space from depth-guided multi-camera correspondences to decouple geometry learning from camera-specific appearance. A multi-scale Bilateral Grid Transformer restores raw camera appearance from canonical renderings, enabling photometric supervision without contaminating Gaussian geometry. To improve local geometric reliability, we estimate Fisher-information-based uncertainty from photometric sensitivity and use it to adaptively weight surface-oriented self-supervision. Extensive experiments demonstrate improved reconstruction quality and generalization across driving datasets. Geometry-oriented evaluations further reveal enhanced cross-view depth consistency and local surface-normal agreement, while qualitative results show fewer geometric artifacts and more coherent structures across overlapping views.

cs.CV↗

CRT-HMAR: Causal Requirement Tracing-Guided Hierarchical Multi-Agent Regulation for Open-Task-Aware Infrared-Visible Image Fusion

Infrared and visible (IR-VIS) image fusion integrates complementary multimodal information into a single fused image to support downstream vision tasks. However, existing methods are typically tailored to seen tasks within a fixed task set and struggle to generalize to unseen tasks, which restricts their applicability in real-world open-task scenarios. To address this issue, this paper proposes CRT-HMAR, a Causal Requirement Tracing-Guided Hierarchical Multi-Agent Regulation Framework for open-task-aware IR-VIS image fusion. CRT-HMAR introduces a Causal Requirement Tracing Task Localization mechanism, which actively intervenes in key image information and observes task-network response variations to map task-specific semantic preferences into image-level causal requirement maps. Based on these maps, a requirement analysis agent aggregates task-specific requirement knowledge to adaptively guide requirement-customized image fusion. Moreover, CRT-HMAR incorporates History-Analysis Multi-Objective Balancing and Task-Level-Correction Conflict Mitigation mechanisms, jointly constructing a hierarchical regulation chain of "requirement interpretation - task balancing - conflict mitigation". Through multiple collaborative agents, CRT-HMAR dynamically regulates key processes including open-task requirement modeling, multi-task balanced optimization, and gradient conflict mitigation. Extensive experiments on open-task scenarios involving five downstream tasks demonstrate that CRT-HMAR significantly improves generalization to unseen tasks while maintaining the performance and balance of seen tasks. Overall, CRT-HMAR shifts IR-VIS image fusion from task-oriented modeling toward requirement-oriented modeling, promoting its extension from closed-task settings to real-world open-task scenarios.

cs.CV↗

Remote magnon sensing detects the universal phase stiffness jump in Bi$_2$Sr$_2$CaCu$_2$O$_{8+δ}$

Phase stiffness governs macroscopic quantum coherence in superfluids and superconductors, providing a sensitive probe of condensate depletion, fluctuations, and phase transitions. However quantitative and spatially resolved measurements remain challenging. Here we report a contactless, local, all-optical measurement of superconducting phase stiffness using propagating antiferromagnetic magnons as remote sensors. In CrSBr, strong exciton-magnon coupling enables optical excitation and detection of magnon wavepackets and precise determination of their group velocity. When CrSBr is interfaced with underdoped Bi$_2$Sr$_2$CaCu$_2$O$_{8+δ}$, we find that the magnon group velocity is substantially enhanced below the superconducting transition and quantitatively encodes the phase stiffness through Meissner screening currents. Using this capability, we identify a parallel-field-induced Berezinskii-Kosterlitz-Thouless transition through direct observation of the universal phase-stiffness jump, revealing a field-controlled route to expose intrinsic two-dimensional phase-ordering physics in a bulk cuprate. Our work establishes propagating magnons as local probes of superconducting electrodynamics and phase-coherent phenomena in low-dimensional quantum materials.

cond-mat.supr-con↗

A Finite-Entropy Criterion for the Entropic Conditional Central Limit Theorem

We prove a finite-entropy criterion for the entropic conditional central limit theorem. Let $(ξ_i,η_i)_{i\geq 1}$ be independent copies of a pair $(ξ,η)$, and set $W_n=n^{-1/2}\sum_{i=1}^n ξ_i$ and $\boldsymbolη_n=(η_1,\ldots,η_n)$. Under the assumptions that $\mathbb{E}\operatorname{Var}(ξ\midη)<\infty$ and that the conditional law of $ξ$ given $η$ is absolutely continuous almost surely, we show that $\mathbb{E}h(W_n\mid\boldsymbolη_n)$ converges to the Gaussian entropy $\frac12\log(2πeσ^2)$, where $σ^2=\mathbb{E}\operatorname{Var}(ξ\midη)$, if and only if $\mathbb{E}h(W_{n_0}\mid\boldsymbolη_{n_0})>-\infty$ for some $n_0$. The main technical ingredient is a continuity theorem for Fisher information under Gaussian smoothing, which allows us to replace the finite expected conditional Fisher-information assumption by a necessary and sufficient finite-entropy condition.

math.PR↗

Candidate for a Fractional Topological Insulator in Twisted MoTe2

The interplay among electronic correlation, topology, and time-reversal-symmetry (TRS) often leads to exotic quantum states of matter, as highlighted by the discoveries of fractional Chern insulators (FCIs) in twisted bilayer MoTe2 (tMoTe2). Among the FCIs in tMoTe2, the most robust is at a hole filling factor of v=-2/3 per moiré unit cell. Here, employing pump-probe circular dichroism (CD) measurement on tMoTe2 at twist angles (3.9 and 3.7 degrees), we show that a correlated state at v =-4/3 exhibits an unusual Ising antiferromagnet behavior. The v =-4/3 state with no net magnetization undergoes first order phase transitions at extremely low magnetic fields of ~ 2-6 mT to partially valley polarized (PVP) states. This behavior is notably absent for all other correlated states in tMoTe2 and also disappears for v =-4/3 at higher or lower twist angles (4.0 or 3.3 degree). The observed magnetic signature is consistent with a theoretically proposed fractional topological insulator (FTI), consisting of two copies of v =-2/3 FCIs with opposite chirality in the two K valleys. The experimental results are supported by interacting continuum model calculations that reveal the extreme closeness in energy ( < 1 meV) between the putative FTI and PVP states. Our findings present a candidate FTI with TRS and call for advanced transport and imaging measurements to establish the quantized helical edge modes.

cond-mat.str-el↗

Perturbation Power Selection for First-Error Delay Maximization in Enhanced SC Decoding

In this paper, we analyze the effect of perturbation power in delaying the first error position, i.e., the first information bit incorrectly decoded by the successive cancellation (SC) decoding. It is conducted over the finite-length perturbation-enhanced SC (PE-SC) decoding paradigm. We show that the FEP delaying probability exhibits a non-monotonic dependence on the perturbation power \(σ_{p}^{2}\). Based on this property, an efficient perturbation power selection algorithm that maximizes the delay probability is proposed to enhance the perturbation efficiency. It results in a more efficient perturbation power selection in finite-length PE-SC decoding.

cs.IT↗

MSP-Net: Manifold-Guided Spectral Prompt Network for Hyperspectral Object Tracking

Hyperspectral object tracking leverages abundant spectral information to provide unique advantages for target discrimination in complex scenes. However, existing methods typically treat hyperspectral images as multi-channel extensions of RGB images, performing feature fusion in fixed band order. This approach leads to models dependent on specific sensor configurations while neglecting manifold relationships between bands, making generalization to heterogeneous sensors difficult. Moreover, the discriminative contribution of bands dynamically changes with target attributes and scene variations, further limiting the representational capacity of static fusion strategies. To address this, we propose the Manifold-Guided Spectral Prompt Network (MSP-Net). This network first reconstructs band relationships and forms adaptive spectral grouping through graph-driven manifold routing, then jointly integrates grouped spectral statistics with template appearance to construct target-related dynamic conditional prompts, enhancing target features while suppressing background interference. Furthermore, as tracking progresses, spectral conditions continuously evolve based on intermediate target representations, enabling target prompts to adapt in real-time to appearance and scene changes. Meanwhile, reliable historical states are used to constrain target localization and scale fluctuations, significantly improving temporal stability in cross-sensor tracking. Experiments on HOT2020 and HOT2023 demonstrate that MSP-Net achieves AUC and Precision exceeding 0.80 and 0.96, respectively, exhibiting exceptional robustness under heterogeneous sensors, target deformation, and complex background conditions. The code will be released at https://github.com/GGML668897/MSP-Net.

cs.CV↗

Speculative Pipeline Decoding: Higher-Accuracy Drafting with Hidden Latency via Pipeline Parallelism

Speculative Decoding (SD) accelerates low-concurrency LLM inference with a draft-then-verify paradigm. Mainstream methods, however, rely on multi-token prediction, which incurs compounding prediction difficulty and exposed draft latency. We propose Speculative Pipeline Decoding (SPD), which partitions the target LLM into $n$ pipeline stages so that $n$ tokens of a single sequence advance in parallel. To keep the pipeline saturated, a Pipeline Draft Module (PDM) aggregates multi-depth target features to predict the next token and runs concurrently with each pipeline step, yielding bounded prediction difficulty, higher acceptance, and hidden draft latency. Experiments show that SPD achieves higher theoretical and wall-clock speedup than EAGLE-3 at moderate pipeline width, while more aggressive widths still leave room for further gains. Our code is available at https://github.com/yuyijiong/speculative_pipeline_decoding

cs.CL↗

CosFly-VLA: A Spatially Aware Vision-Language-Action Model for UAV Tracking

Dynamic target tracking is essential for Unmanned Aerial Vehicles (UAVs) operating in complex urban environments, where both the target and the camera viewpoint change continuously. Existing Vision-Language-Action (VLA) policies can track visible targets effectively, but their performance often degrades when buildings, vegetation, or roadside objects block the line of sight. During sustained occlusion, a policy may lose the target state, execute actions toward an incorrect region, and amplify this error through subsequent observations until re-acquisition becomes impossible. To this end, we present CosFly-VLA, a spatially aware VLA model that jointly grounds the target, estimates its visibility, and generates continuous flight actions through a structured prediction interface. To train this policy, we use a large-scale recipe over diverse data sources. Spatially Grounded Continued Pretraining (CPT) on a 500k mixed pool injects UAV-view depth, distance, and 3-D spatial reasoning. A three-stage Curriculum-based Supervised Fine-Tuning (SFT) process then specializes the tracker through multi-head warm-up followed by two-stage curriculum learning over natural and hard / long-occlusion data. Chain-of-Thought (CoT) training subsequently teaches recovery-oriented reasoning traces before structured answers. Finally, a closed-loop Reinforcement Learning (RL) stage optimizes tracking behavior with a multi-component reward covering stand-off tracking, grounding quality, collision avoidance, and task success. Relative to OpenVLA, CosFly-VLA-0.8B reduces open-loop Average Displacement Error (ADE) by 34.1% on seen-test and 35.3% on unseen-test. Closed-loop optimization improves Success Rate (SR) by 29.8% and 2.5%, respectively. These results demonstrate progress from visible-frame imitation toward spatially grounded action-closed-loop control, evaluated under a shared oracle state history.

cs.RO↗

OnePath: Efficient and Privacy-Preserving Decision Tree Inference in the Cloud

The vast storage capacity and computational power of cloud servers have led to the widespread outsourcing of machine learning inference services. While offering significant operational benefits, this practice also introduces privacy risks, such as the exposure of proprietary models and sensitive user data. In this paper, we present OnePath, a framework for secure and efficient decision tree inference in cloud environments. Unlike existing methods that traverse all internal nodes of a decision tree, our traversal protocol processes only the nodes on the prediction path, significantly improving inference efficiency while preserving privacy. To further optimize privacy and performance, OnePath is the first to employ functional encryption for evaluating decision tree nodes. Notably, our protocol enables both model providers and users to remain offline during the inference phase, offering a crucial advantage for practical deployment. We provide formal security analysis to demonstrate that OnePath provides comprehensive privacy protections during the model inference process. Extensive experimental results show that our approach processes query data in microseconds, highlighting its efficiency. OnePath offers a practical solution that strikes a balance between security and performance, making it a promising option for a wide range of cloud-based decision tree inference applications.

cs.CR↗

Electron-beam Writing of Spectrally Uniform Green Single-photon Emitters in Hexagonal Boron Nitride

Scalable quantum photonic technologies require single-photon emitters whose positions and emission energies can be engineered simultaneously. Hexagonal boron nitride (hBN) is an attractive room-temperature host, but deterministic creation of spectrally reproducible emitters remains challenging. Here, we use a standard scanning electron microscope as a direct-writing tool to activate bright green single-photon emitters in hBN at predefined sites, without ion implantation or post-fabrication thermal annealing. The written emitters exhibit reproducible zero-phonon-line emission centered near 536 nm, room-temperature antibunching with g(2)(0) as low as 0.08, high brightness, strong linear polarization, and stable emission. Thickness-dependent activation, stacking experiments, cathodoluminescence spectroscopy, and first-principles calculations support a carbon-related defect complex as the most plausible origin of the emission. As a proof of nanophotonic compatibility, we further activate emitters in a nanoparticle-on-mirror plasmonic nanocavity and observe photoluminescence enhancement accompanied by shortened emission lifetimes. These results establish electron-beam direct writing as a practical route to site-selective, spectrally uniform green quantum emitters in hBN, offering a promising basis for integrated room-temperature quantum photonic architectures.

physics.optics↗

Nonlinearity-Aware LoRA: Structured Gate Adaptation under Low-Rank Constraints

Low-rank adaptation (LoRA) is commonly viewed as an update-space approximation to full fine-tuning, yet this view is incomplete for self-gated Transformer feed-forward networks. In gated FFNs, a low-rank residual can change not only projected features but also the nonlinear selection weights that determine which channels contribute to the output. We formalize this effect as selection misalignment and connect it to the local effective homogeneity of self-gated activations. This motivates a nonlinearity-aware principle for parameter-efficient fine-tuning: low-rank updates should allocate capacity to gate channels whose nonlinear states remain responsive and should shape the temporal evolution of selection. We propose NA-LoRA, a training-only method with two lightweight mechanisms: a derivative-based temporal-importance mask for gate-related LoRA updates and an activation-specific step-scaling rule when a meaningful coarse effective-homogeneity partition is available. NA-LoRA adds no auxiliary loss and incurs no inference-time overhead. Experiments on language-model fine-tuning and vision-language transfer benchmarks show that NA-LoRA consistently improves over vanilla LoRA and is competitive with or better than strong PEFT variants.

cs.LG↗

EO-WM: A Physically Informed World Model for Probabilistic Earth Observation Forecasting

Earth Observation (EO) forecasting aims to predict future Earth surface dynamics from satellite observations under changing meteorological conditions. In this paper, we view this task as a partially observed, weather-driven world modeling problem, in which weather acts as a conditioning signal, while forecasting remains uncertain due to sparse observations and unobserved land-surface states. However, existing methods do not fully capture this setting: deterministic models collapse uncertainty into a single future prediction, while diffusion-based methods typically treat weather variables as undifferentiated conditioning signals, and existing benchmarks focus mainly on reconstruction accuracy rather than whether forecasts respond correctly to changed weather forcing.We introduce EO-WM, a video diffusion transformer for multispectral EO forecasting. EO-WM incorporates a physically informed conditioning framework that represents meteorological forcing through a climatological baseline, weather anomalies, and cumulative physical stress signals. Specifically, it separates baseline and anomaly through distinct conditioning pathways, and accumulates anomalous forcing over time to capture sustained heat and drought stress. To evaluate weather-response behavior beyond standard metrics, we introduce two diagnostic benchmarks: an Extreme Summer Benchmark for severity-aware prediction of vegetation degradation under extreme weather, and a Seasonal Matched-Pair Benchmark for testing response fidelity under changed weather forcing. Experiments show that EO-WM reduces the error in predicted Normalized Difference Vegetation Index (NDVI) decline amplitude by a relative 5.63% and improves directional hit rate by a relative 7.80%, while remaining competitive on standard pixel-level metrics. The benchmarks and model will be made open-source at https://github.com/Luo-Z13/EO-WM.

cs.AI↗

Electrically Programmable Correlated Topology and Magnetism in a Moiré Trilayer

Strong electron-electron interactions underlie a wide range of quantum many-body phenomena, including magnetism, superconductivity, and charge fractionalization. A central goal is to achieve in situ control over lattice geometry, bandwidth, and band topology within a single platform. Here we realize such an electrically programmable quantum many-body system in an alternating twisted trilayer MoTe$_2$, where an out-of-plane displacement field continuously modifies the layer polarization, effective lattice, and topology of the moiré bands. At zero displacement field, the system realizes a triangular lattice hosting a correlated insulator at one hole per moiré unit cell ($ν= -1$). Doping this state produces strongly asymmetric magnetic responses: double-exchange-like ferromagnetism for $|ν| > 1$, and signatures of spin polarons and antiferromagnetism for $|ν| < 1$. At large displacement field, interlayer hybridization reconstructs the electronic structure into a honeycomb lattice with a flat Chern band, supporting integer and fractional Chern insulators. Magneto-optical measurements further reveal the signatures of gap closure and Landau-level formation from a spin-polarized Fermi surface near the crossover between the two regimes. These results establish a unified, electrically tunable platform in which correlated magnetism and topological states emerge from a single controllable band structure.

cond-mat.mes-hall↗

SurroundNEXO: Ego-Centric Metric Bridging for Spatially Consistent Geometry in Autonomous Driving

Modern autonomous driving depends on accurate metric 3D understanding for perception, reconstruction, and planning, which in turn requires reliable multi-camera depth prediction. However, the outward-facing nature of vehicle-mounted surround-view camera rigs inherently limits visual overlap across views, challenging the correspondence-based assumptions that underpin conventional multi-view geometry. To bridge this gap, we present SurroundNEXO, named after the Spanish word nexo for a geometric link, a low-overlap multi-camera metric depth framework that grounds cross-view reasoning in ego-centric geometry rather than dense visual correspondences. Instead of directly enforcing early global fusion, SurroundNEXO first assigns image tokens globally comparable ego-frame viewing directions through Ego-Ray Positional Encoding, then uses sparse LiDAR measurements as metric anchors to propagate absolute scale cues, and finally expands feature interaction progressively from view-local modeling to decomposed spatio-temporal reasoning and global integration. This design enables metric-scale depth prediction with improved spatial consistency across weakly overlapping cameras. Across low-overlap autonomous driving benchmarks, including NuScenes, Waymo and DDAD, SurroundNEXO reduces single-view error by 33.2%, improves cross-view consistency by 10.5%, and enhances metric reconstruction quality by 25.6% compared with SOTA methods. It further remains robust under extremely sparse depth prompts and exhibits strong zero-shot generalization to unseen camera layouts.

cs.CV↗