Shitong Liu | Searcharxiv

arXiv2026

Unified Motion-Action Modeling for Heterogeneous Robot Learning

We present Unified Motion-Action (UMA) Model, an approach that uses 3D object motion trajectories as a shared interface to bridge visuomotor control and dynamics modeling. UMA treats object motion and robot actions as co-evolving variables under a masked generative objective, in which the mask pattern determines both the supervision regime during pretraining and the inference mode at deployment. Using hindsight-relabeled motion contexts and a contrastive objective that disentangles task intent from scene geometry, UMA enables multi-task pretraining across heterogeneous data sources without requiring manually annotated task instructions. At deployment, the same pretrained parameters support motion-conditioned visuomotor control, motion-based dynamics modeling, and task adaptation from few-shot demonstrations. Pretrained on a mixture of robot demonstrations, human videos, and simulated data, UMA consistently outperforms state-of-the-art baselines specialized for each inference mode.

cs.RO↗

arXiv2026

GA-Field: Geometry-Aware Vehicle Aerodynamic Field Prediction

Accurate aerodynamic field prediction is crucial for vehicle drag evaluation, but the computational cost of high-fidelity CFD hinders its use in iterative design workflows. While learning-based methods enable fast and scalable inference, accurately aerodynamic fields modeling remains challenging, as it demands capturing both long-range geometric effects and fine-scale flow structures. Existing approaches typically encode geometry only once at the input and formulate prediction as a one-shot mapping, which often leads to diluted global shape awareness and insufficient resolution of sharp local flow variations. To address these issues, we propose GA-Field, a Geometry-Aware Field prediction network that introduces two complementary design components: (i) a global geometry injection mechanism that repeatedly conditions the network on a compact 3D geometry embedding at multiple stages to preserve long-range geometric consistency, and (ii) a coarse-to-fine field refinement strategy to recover sharp local aerodynamic details. GA-Field achieves new state-of-the-art performance on ShapeNet-Car and the large-scale DrivAerNet++ benchmark for surface pressure, wall shear stress, and 3D velocity prediction tasks, while exhibiting strong out-of-distribution generalization across different vehicle categories.

cs.CE↗