Searcharxiv⌕ Search

arXiv subjects

Wensong Xu

Publications and source records attributed to Wensong Xu.

2 recordsLinked to original sources

GraSLA: A Lightweight Spatial-Language-Action Model with Grasp Hypotheses as Geometric Priors

This paper focuses on improving the effectiveness and generalization of language-conditioned manipulation policies learned through imitation learning. Recently, continuous-control policies have become mainstream in robotic manipulation, but the lack of diverse demonstrations tends to restrict their generalization. To address this limitation, explicit geometric targets can provide additional guidance for action prediction. In particular, 6-DoF grasp detection generates diverse grasp hypotheses that suggest possible approach directions for the gripper. This motivates us to integrate them into continuous-control policies. To this end, we propose GraSLA, a lightweight and effective spatial-language-action model with grasp hypotheses as geometric priors. In particular, we employ spatial and language foundation models to encode scene geometry and task semantics, and integrate them with grasp hypotheses through bidirectional cross-attention for continuous action prediction. Simulation experiments demonstrate that our approach outperforms existing baselines on LIBERO, LIBERO+, and LIBERO-Pro, achieving average success rates of 99.30%, 73.7%, and 53.33%, respectively.

cs.RO↗

Puzzle: One Pass Is Not Enough for Open-Vocabulary Remote Sensing Segmentation

Open-vocabulary remote sensing image segmentation (OVRSIS) enables the segmentation of unseen classes without additional annotation or retraining. By analyzing the predictions of existing OVRSIS methods, we find that many misclassified patches coexist with visually similar, correctly classified patches of the same class within the same image. Unfortunately, most of these methods stop after a single inference rather than using their predictions to guide further inference. Motivated by this observation, we propose \textbf{Puzzle}, a plug-and-play iterative re-inference framework that combines prediction history with a visual-similarity prior to progressively refine patch-level attention. Puzzle employs a lightweight history-conditioned controller to regulate each patch's contribution as an information source and its reliance on visually similar patches, while an adaptive stopping rule determines when to stop. It keeps the segmentation model frozen and reuses the same controller across different models and datasets without retraining. Extensive experiments demonstrate consistent performance improvements across diverse OVRSIS models and datasets, highlighting the strong transferability of Puzzle. Moreover, Puzzle can further improve the performance of SOTA methods.

cs.CV↗