Searcharxiv⌕ Search

arXiv subjects

Yuxiang Gao

Publications and source records attributed to Yuxiang Gao.

At least 19 recordsLinked to original sources

Robotic Spatiotemporal Editing: A Unified Interface for Controllable Action Generation via Masked Action Reconstruction

Generative policies can synthesize robot behaviors, yet controlling and editing them through diverse spatiotemporal references remains challenging. In the real world, human intent requires robot behaviors that satisfy constraints on where, when, and how actions are executed. Our key insight is that spatiotemporal control references, such as keypoints, flows, orientations, and keyposes, can be viewed as partial specifications of the same temporal Cartesian action space. We introduce the MAP (Masked Action Space) interface to unify these action references and formulate controllable manipulation as an action inpainting problem. Our Inpainting Policy (IP) reconstructs missing action dimensions of the end-effector, combining progress-guided alignment with multi-mask training supporting unseen action-constraint combinations. We further adopt a training-free RePaint variant that iteratively inpaints the action during denoising to reduce control error. On ManiSkill and LIBERO-10, our policy achieves average task success rates of 92.67% and 64.67%, respectively.Real-world experiments demonstrate spatiotemporal control with average positional and rotational errors of 44.3 mm and 7°, respectively, showing that our policy can use diverse references to guide executable robot behaviors.

cs.RO↗

BAT-WAM: Bridging Action and Touch in World-Action Models for Dexterous Hands

Dexterous manipulation with world action models (WAMs) relies on hand configuration and contact information, yet joint-state and whole-hand tactile observations may be partially or entirely missing. RGB images provide scene context and hand-object geometry but are insufficient to reliably recover these missing modalities. We further observe a correlation between hand state and tactile information. Motivated by this observation, we introduce BAT-WAM, a framework that bridges visual, joint-state, and tactile representations for WAMs. BAT-WAM learns separate codebooks and decoders for the tactile and action streams. An RGB-conditioned continuous latent bridge connects the two streams for bidirectional learning, while visual information serves as continuous context. Under the HTBench evaluation protocol, BAT-WAM reduces the root mean squared error (RMSE) of tactile reconstruction by 34.73% under fully masked conditions and 38.84% under partially masked conditions, relative to an image-conditioned HandTouch checkpoint. For future tactile prediction conditioned on target-time RGB and historical actions, it reduces mean RMSE by 85.56% relative to OpenWAM with HandTouch. Real-robot experiments further show that BAT-WAM consistently outperforms related WAM baselines in dexterous manipulation. Generalization experiments on unseen objects and scenes also demonstrate substantial improvements over baseline models. These findings support joint modeling of visual context, hand state, and touch as a representation approach for multimodal WAMs.

cs.RO↗

HiLo-WAM: Decoupling Long-Horizon Task Evolution and Local Dynamics in World Action Models

World Action Models (WAMs) improve robotic manipulation by jointly modeling visual dynamics and robot actions. However, most existing WAMs model dense short-horizon visual dynamics, capturing local interactions but providing limited long-range task context. Extending prediction horizons increases uncertainty and computation while entangling task-level evolution with fine-grained local dynamics, obscuring their dependencies and distinct roles in action generation. We propose HiLo-WAM, which decouples long-horizon task evolution from local visual dynamics while jointly modeling their interaction with robot actions. A sparse long-horizon visual stream captures historical task context and future evolution, while a dense local dynamics visual stream models short-horizon robot-object interactions. The two streams operate at different temporal scales within a unified dual-DiT architecture and guide actions through structured cross-stream attention. Progressive inference further reduces unnecessary computation through stream-wise partial denoising, joint denoising, and dynamic skipping. Experiments demonstrate strong long-horizon manipulation performance: HiLo-WAM achieves a 93.70% average success rate on RoboTwin 2.0 and a 17.43 progress score on RoboDojo long-horizon tasks, with robust in-domain and OOD performance on the Fourier GR-3 robot. Ablations confirm the complementary contributions of long-horizon task evolution and local interaction dynamics, while temporal-scale analyses highlight the importance of balancing temporal coverage and resolution. Progressive inference further achieves a 2.93x speedup while improving performance.

cs.RO↗

LOGIV: Graph-Verified Execution with Causal Local Repair for Long-Horizon Robot Tasks

Agentic robots must turn a high-level goal into actions while keeping the physical conditions needed for future steps valid. A completed action does not ensure that its effects will persist: a later disturbance can invalidate support that the remaining plan still assumes. We present LOGIV, a graph engineering framework for agentic robot execution that uses an explicit task graph to connect symbolic planning, observation-based verification, and embodied action. LOGIV compiles a validated plan into condition-support and resource-ordering edges, checks their physical validity during execution, and uses dependency tracing to determine what must be restored after a failure. Repair is constrained by retained unfinished actions, and the combined continuation is symbolically validated before execution resumes. The framework operates above existing Vision-Language-Action (VLA) and World Action Model (WAM) policies without adding trainable components. Across 20 dual-arm tasks from RoboTwin V2 and BiCoord with three execution backbones, LOGIV improves mean task success without injected disturbances by 10.67 and 15.33 percentage points, respectively. Under predefined perturbations, it achieves higher task completion and condition restoration than three adapted recovery baselines for every backbone on both benchmarks. On three real-robot tasks, successful trials increase from 12/30 to 17/30. These results support explicit, continuously checked task dependencies as a practical interface for reliable agentic robot execution.

cs.RO↗

ACTOR: Action-Centered Temporal Organization for Literary Role-Playing Agents

Large language agents for literary role-playing are typically modeled around dialogue generation, leaving characters' non-dialogue behaviors and their dynamic evolution over story time underrepresented. In this paper, we propose ACTOR (Action-Centered Temporal Organization for Literary Role-Playing Agents), an automated framework for constructing such behavior trajectories from raw novel texts. ACTOR extracts dialogue and persona-relevant non-dialogue behaviors, represents each behavior using a Thought-Action-Observation structure, and organizes behavior trajectories according to the internal temporal order of the story. We build a behavior dataset from 143 diverse literary works. For each source behavior, we generate counterfactual behaviors that are contextually plausible yet inconsistent with the character's persona. We find that existing models struggle to reliably infer character-consistent actions from historical behaviors and evolving character states. Using these behavior pairs, we train models with Regularized Preference Optimization (RPO), which augments DPO with a negative log-likelihood loss on the source behavior to jointly optimize behavior preference and generation. We further design a four-way next-behavior selection task to evaluate the model's ability to faithfully mimic character actions. Across 17,560 evaluation instances, the model trained on ACTOR's preference pairs achieves substantially improved accuracy. This result demonstrates that structured, temporally organized supervision enables models to leverage character profiles and prior behaviors to infer subsequent actions, greatly advancing literary role-playing beyond mere dialogue imitation. Code and data are available at https://github.com/SilentStar233/ACTOR.

cs.CL↗

BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries

World Action Models (WAMs) commonly couple video and action experts through dense, layer-wise Mixture-of-Transformers (MoT) attention, exposing action prediction to irrelevant visual features while enforcing matched expert depths. This coupling hinders selective visual-feature use and introduces redundant computation. We introduce Bridge-of-Experts (BoE), instantiated as BridgeWAM, which aggregates visual, language, and proprioceptive priors through 32 Latent Bridge Queries (LBQs) into a shared, limited latent space. Joint video-action supervision lets action gradients guide the Video Expert toward representations better suited for action prediction, while the Action Expert learns to selectively retrieve task-relevant information through cross-attention. Decoupling expert depths and reusing LBQs during action denoising yield a 5.06B model with a 30-layer Video Expert and a two-layer Action Expert, achieving 98.25% success on LIBERO and 72.24% pooled success on LIBERO-Plus, demonstrating effective task execution and strong generalization with an ultralight action head. Ablations support joint representation adaptation and unified LBQ conditioning. Relative to Fast-WAM, BridgeWAM reduces single-sample inference FLOPs by 28.72% in simulation profiling and real-robot latency to 77.1 ms (a 2.47-fold speedup). Qualitative experimental results further indicate preferential attention to target objects and task destinations across perturbations.

cs.RO↗

Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation

Long-horizon compositional manipulation has become increasingly important for real-world robot deployment, where a single task involves multiple coordinated subtasks. Existing world-action models (WAMs) jointly predict short-horizon visual futures and actions, but typically lack explicit subtask-level reasoning. We propose Visual Goal-conditioned Action Reasoning (ViGAR), a hierarchical framework that factorizes manipulation into a visual subgoal planner and a subgoal executor. Given the current observation and global instruction, the subgoal planner predicts a visual subgoal for the next subtask. The subgoal executor then jointly generates future visual trajectories and actions conditioned on the predicted subgoal. Both components share a pretrained world-model representation, enabling task-level planning and action generation to benefit from common physical knowledge. Moreover, our framework naturally supports in-context learning: using a global goal image as context can induce different subtask decompositions and behaviors without parameter updates. On the RoboTwin Clean2Random benchmark, ViGAR achieves 82.00% and 67.02% success rates under the Clean and Random settings, respectively, surpassing the strongest baseline by 12.86 percentage points in average success rate. Real-world robot experiments on five compositional and two in-context learning tasks further confirm the effectiveness of ViGAR.

cs.RO↗

Chemical-space completeness through iterative crystal-structure generation and model adaptation

The emergence of deep learning has brought large-scale exploration of crystalline materials closer to practical realization. Yet, universal atomistic models face a practical trade-off between chemical generality and the accuracy, efficiency, and adaptability required for intensive exploration of specific materials systems. Within a bounded chemical system, this trade-off can be relaxed by exploiting its limited chemical complexity. Guided by this intuition, we propose a chemical-system-centric strategy that couples crystal-structure generative models with machine-learned force fields (MLFFs) in an iterative generation-evaluation-refinement loop. Using Li--P--S as a test case, we generate approximately 70,000 candidate structures, including more than 10,000 stable-unique-novel structures. The diversity of near-equilibrium local environments saturates within the first few iterations, accompanied by convergence of MLFF prediction errors, providing an operational measure of chemical-space completeness within bounded systems. The exploration also recovers chemically plausible P--S motifs that are absent from the pretraining databases but supported by earlier experiments. The resulting system-adapted models and structures further enable finite-$P$--$T$ phase-stability calculations, Li-ion transport screening, and electronic-structure prediction. These results suggest that chemical-system-centric exploration provides a practical route toward data-efficient and high-fidelity modeling within bounded chemical spaces.

cond-mat.mtrl-sci↗

A Strategy Toward Room Temperature Topological Hall Effect via Local Moment Magnetism

Topological spin textures in local moment systems hold great promise for technological applications due to their large magnetic moments, strong spin-orbit coupling (SOC), and high tunability. Finding new spin textures that are stable near room temperature is paramount to maximizing their potential for applications. Here, we provide a strategy for realizing topological spin textures at high temperatures by identifying rare earth ($R$) magnets ordering at or near room temperature. We demonstrate the feasibility of this strategy in one of these magnets, hexagonal Gd$_5$Pb$_3$, which orders at $T_C$ = 285 K. The indication for topological spin textures comes from topological Hall effect (THE), which, in Gd$_5$Pb$_3$, occurs between $T$ = 100 - 200 K, an order of magnitude higher temperature than in other reported $R$-based systems. Our results present an opportunity to explore the role of SOC, anisotropic exchange, geometric frustration, and magnetic interactions in stabilizing topological spin textures, and provide a pathway toward realizing them near room temperature in $R$-based magnets.

cond-mat.mtrl-sci↗

4D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields

Building on recent advances in world models, World Action Models (WAMs) jointly model video prediction and action generation. However, they typically represent videos in 2D pixel space, creating a representation gap with 3D space in which robotic actions are executed. Recent 3D approaches introduce 3D information, but fail to fully exploit the dynamics of 3D structures. In this work, we propose 4D-WAM, a model-agnostic training strategy that injects spatiotemporal knowledge from 3D trajectory fields into WAMs through representation alignment. To this end, we introduce two complementary objectives: 1) motion alignment, which aligns temporal feature variations across adjacent frames and encourages the model to build local 4D awareness during training, and 2) destination alignment, which guides the model to infer the final destination from the source frame by minimizing the gap between their attention-like similarity distributions. Together, these objectives provide both local motion supervision and long-horizon goal guidance, enabling WAMs to learn trajectory-level spatiotemporal representations. Extensive in-distribution and out-of-distribution experiments across different base models demonstrate the model's improvements in spatial understanding, execution precision, robustness, generalization, and versatility.

cs.RO↗

Is Forward Prediction Enough? Physical State Grounding for JEPA World Models

Learning structured and control-relevant latent representations remains a key challenge for world models. Recent JEPA-based world models learn action-conditioned predictive latent dynamics from observation sequences. However, their forward-prediction objectives do not explicitly enforce reliable identifiability of robot-centric physical state from individual latents or state changes from latent pairs, which can limit downstream planning and policy performance. We propose PSG-JEPA, a physically grounded JEPA world model that shapes its latent space with two complementary grounding objectives beyond forward prediction: grounding individual latents in robot proprioceptive state, and grounding latent pairs in multi-horizon joint-angle changes. Both objectives are applied only during training, leaving the inference architecture and computational cost unchanged. To comprehensively evaluate PSG-JEPA, we conduct experiments at three levels: (1) latent identifiability via probing, (2) goal-conditioned planning on frozen latents, and (3) policy learning in simulation and on a real robot. Experiments demonstrate that our PSG-JEPA consistently outperforms state-of-the-art latent world-model baselines at all three levels.

cs.RO↗

DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matching

Vision-Language-Action (VLA) models that encode actions using a discrete tokenization scheme have been widely adopted for robotic manipulation, but existing decoding paradigms remain fundamentally limited. Whether actions are decoded sequentially by autoregressive VLAs or in parallel by discrete diffusion VLAs, once a token is generated, it is typically fixed and cannot be revised in subsequent iterations. Consequently, early token errors cannot be effectively corrected later. We propose DFM-VLA, a discrete flow matching VLA that iteratively refines action tokens. DFM-VLA models a token-level probability velocity field that dynamically updates the full action sequence across refinement iterations. We investigate two approaches to constructing the velocity field: an auxiliary velocity-head formulation and an embedding-guided formulation. To further improve prediction accuracy, we introduce a metric-aligned action tokenizer (MAAT) tailored to the coarse-to-fine nature of DFM, together with a two-stage decoding strategy. Extensive experiments on CALVIN, LIBERO, LIBERO-Plus, and real-world manipulation tasks demonstrate the effectiveness of our approach. Our project is available at https://chris1220313648.github.io/DFM-VLA/.

cs.RO↗

DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation

Vision-Language-Action (VLA) models have become a powerful paradigm for robot manipulation, but training a single generalist policy for heterogeneous robot embodiments remains an open problem. Existing methods have two main limitations. First, they underuse dynamics priors shared across diverse visual and interaction data, limiting cross-embodiment transfer. Second, they require extensive manual preprocessing to convert embodiment-specific actions into a common format. To overcome these limitations, we propose DyPES-VLA, a cross-embodiment VLA that learns shared Dynamics Priors and Embodiment-Specific control. First, we learn shared dynamics priors by training the vision-language model (VLM) with a future-prediction objective on cross-embodiment data, driving the shared query representation to capture object motion, contact, and interaction-induced scene changes. Second, an embodiment-specific Mixture-of-Experts (MoE) action head translates these shared dynamics priors into executable controls directly in each embodiment's native action space, without manually pre-aligning heterogeneous actions into a common format. This head shares attention layers to capture common temporal action structures, while its embodiment-specific feed-forward experts resolve the unique kinematic constraints and control semantics of distinct embodiments. As a generalist policy, our \ourmethod achieves state-of-the-art performance across simulation and real-world evaluations, reaching 98.0% success on LIBERO, 59.25% on RoboCasa-GR1, and 89.02% on RoboTwin~2.0.

cs.RO↗

Uniaxial strain tuned magnetism of the altermagnet candidate h-FeS

Altermagnets are collinear magnetic materials with 'alter'nating local crystalline environments, characterized by joint spin and crystalline symmetries that enable ferromagnetic-like transport properties but with vanishing net magnetization. Hexagonal FeS (h-FeS) is a recently identified altermagnet candidate that shows a spontaneous anomalous Hall effect (AHE) accompanied by a tiny net magnetization. Here, we show that both the spontaneous AHE and magnetization can be effectively suppressed by an in-plane compressive strain. Since neutron diffraction measurements show that the applied uniaxial strain only modifies the in-plane domain population but does not affect the in-plane magnetic structure, the major effect of the applied strain is to tune the small $c$-axis ferromagnetic moment. Our results demonstrate a strong correlation between the tiny net magnetization and the spontaneous AHE in h-FeS, and show that uniaxial strain provides an effective knob to tune both properties in this altermagnet candidate for spintronic applications.

cond-mat.mtrl-sci↗

Atomically-sharp magnetic soliton in the square-net lattice EuRhAl$_{4}$Si$_{2}$

Topological spin textures are hallmark manifestations of competing interactions in magnetic matter. Their effective description by nonlinear field theories reflects an energetic frustration that destabilizes uniform order while selecting finite-size, topologically nontrivial configurations as stationary states. Among the most extreme realizations are atomically-sharp domain wall excitations, namely one-dimensional (1D) magnetic solitons, which represent the ultimate scaling limit of magnetic textures. Such solitons may emerge in magnetic systems where effective exchange interactions compete directly with uniaxial magnetic anisotropy. Here we show that the square-net rare earth compound EuRhAl$_{4}$Si$_{2}$ realizes a very susceptible regime where the magnetic anisotropy competes with highly frustrated exchange interactions stabilizing a rare ferrimagnetic $\uparrow\uparrow\downarrow$ state that, under applied magnetic field, supports the formation of atomically-sharp soliton defects. We confirm the bulk response of the 1D magnetic solitons via magnetization and electrical transport measurements. We establish both the zero- and in-field $\uparrow\uparrow\downarrow$ order via neutron diffraction, while magnetic force microscopy visualizes its real-space evolution into a stripe-like array. To elucidate the microscopic origin of the soliton, we relate the Ruderman-Kittel-Kasuya-Yosida (RKKY)-driven exchange interactions and the magnetic anisotropy through density functional theory, and we construct an effective 1D $J_{1}$-$J_{2}$-$K$ model whose atomistic spin dynamics simulations reproduce the observed soliton states as a function of external field. Our results demonstrate that EuRhAl$_{4}$Si$_{2}$ hosts atomically-sharp, field-driven 1D magnetic solitons, providing a new platform for studying 1D topological excitations at the atomic length scale.

cond-mat.str-el↗

Pre-training, fine-tuning, and distillation (PFD): Automatically generating machine learning force fields from universal models

Universal force fields generalizable across the periodic table represent a new trend in computational materials science. However, the applications of universal force fields in material simulations are limited by their slow inference speed and the lack of first-principles accuracy. Instead of building a single model simultaneously satisfying these characteristics, a strategy that quickly generates material-specific models from the universal model may be more feasible. Here, we propose a new workflow pattern, PFD (Pre-training, Fine-tuning, and Distillation), which automatically generates machine-learning force fields for specific materials from a pre-trained universal model through fine-tuning and distillation. By fine-tuning the pre-trained model, our PFD workflow generates force fields with first-principles accuracy while requiring one to two orders of magnitude less training data compared to traditional methods. The inference speed of the generated force field is further improved through distillation, meeting the requirements of large-scale molecular simulations. Comprehensive testing across diverse materials including complex systems, such as amorphous carbon, interface, etc., reveals marked enhancements in training efficiency, which suggests the PFD workflow a practical and reliable approach for force field generation in computational material sciences.

cond-mat.mtrl-sci↗

Quantum oscillations and anisotropic magnetoresistance in the quasi-two-dimensional Dirac nodal line superconductor $\mathrm{YbSb_2}$

Recent interest in quantum materials has focused on systems exhibiting both superconductivity and non-trivial band topology as material candidates to realize topological or unconventional superconducting states. So far, superconductivity in most topological materials has been identified as type II. In this work, we present magnetotransport studies on the quasi-two-dimensional type I superconductor $\mathrm{YbSb_2}$. Combined ab initio DFT calculations and quantum oscillation measurements confirm that $\mathrm{YbSb_2}$ is a Dirac nodal line semimetal in the normal state. The complex Fermi surface morphology is evidenced by the non-monotonic angular dependence of both the quantum oscillation amplitude and the magnetoresistance. Our results establish $\mathrm{YbSb_2}$ as a candidate material platform for exploring the interplay between band topology and superconductivity.

cond-mat.supr-con↗

Fermi surface and Berry phase analysis for Dirac nodal line semimetals: cautionary tale to SrGa$_2$ and BaGa$_2$

A Berry phase of odd multiples of $π$ inferred from quantum oscillations (QOs) has often been treated as evidence for nontrivial reciprocal space topology. However, disentangling the Berry phase values from the Zeeman effect and the orbital magnetic moment is often challenging. In centrosymmetric compounds, the case is simpler as the orbital magnetic moment contribution is negligible. Although the Zeeman effect can be significant, it is usually overlooked in most studies of QOs in centrosymmetric compounds. Here, we present a detailed study on the non-magnetic centrosymmetric $\mathrm{SrGa_2}$ and $\mathrm{BaGa_2}$, which are predicted to be Dirac nodal line semimetals (DNLSs) based on density functional theory (DFT) calculations. Evidence of the nontrivial topology is found in magnetotransport measurements. The Fermi surface topology and band structure are carefully studied through a combination of angle-dependent QOs, angle-resolved photoemission spectroscopy (ARPES), and DFT calculations, where the nodal line is observed in the vicinity of the Fermi level. Strong de Haas-van Alphen fundamental oscillations associated with higher harmonics are observed in both compounds, which are well-fitted by the Lifshitz-Kosevich (LK) formula. However, even with the inclusion of higher harmonics in the fitting, we found that the Berry phases cannot be unambiguously determined when the Zeeman effect is included. We revisit the LK formula and analyze the phenomena and outcomes that were associated with the Zeeman effect in previous studies. Our experimental results confirm that $\mathrm{SrGa_2}$ and $\mathrm{BaGa_2}$ are Dirac nodal line semimetals. Additionally, we highlight the often overlooked role of spin-damping terms in Berry phase analysis.

cond-mat.mtrl-sci↗