arXiv subjects

Sizhe Zhao

Publications and source records attributed to Sizhe Zhao.

3 recordsLinked to original sources

arXiv2026

Memory as Plans: World-Action Modeling with Memory-Grounded Planning

Mainstream robotic policies often adopt a Markovian formulation, but many complex real-world manipulation tasks are inherently non-Markovian, requiring long-horizon memory beyond the current observation. Existing memory mechanisms often rely on language summaries, growing visual windows, or their combinations, and may therefore lose fine-grained visual evidence or face a trade-off between history coverage and execution efficiency. We introduce MaP-WAM, a Memory-as-Plans framework that decomposes memory-dependent world-action modeling into memory-grounded planning and plan-conditioned execution, and uses long-term multimodal episodic context as planning-time evidence rather than repeatedly conditioning the executor on the full history. MaP-WAM represents memory as completed segment records containing language instructions and sparse visual context, and converts this episodic memory into compact plans comprising the next segment-level language plan and corresponding visual guidance. A World-Action-Progress (WAP) model executes each plan over an unknown duration by jointly predicting action chunks and corresponding execution progress at inference time, calibrating predicted progress through plan-observation alignment for adaptive segment transitions and closed-loop context updates. MaP-WAM keeps the executor context length fixed, while structured attention further enables key-value caching in both planning and execution. MaP-WAM achieves state-of-the-art performance on RMBench with an 83.3% success rate and attains 78.0% success on real-robot tasks, while maintaining approximately constant executor inference latency as task history grows.

cs.RO↗

arXiv2026

TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation

Existing embodied control research demonstrates remarkable performance improvements by scaling training data and model size. We instead explore inference-time strategy as an alternative axis. Non-deterministic generative models, such as diffusion and autoregressive models, have been widely adopted in the field of embodied control. However, the single-shot inference paradigm limits their performance. In this paper, we propose \textbf{TapSampling}, a plug-and-play framework for inference-time sampling. First, we introduce an Action-VAE that represents actions in a low-dimensional latent space by mapping policy-generated initial actions into a compressed posterior distribution, from which any number of latent samples can be drawn and decoded into candidate actions that approximate the true action distribution. Second, we formulate action verification as task-progress outcome prediction, using the intrinsic sequential structure of robotic datasets to train a semantically grounded verifier for interpretable action selection. Furthermore, TapSampling is a policy-agnostic framework. Extensive experiments in both simulated and real-world environments demonstrate that our method substantially improves multiple generalist policies without further policy finetuning. Code and models are available at the project page.

cs.RO↗

arXiv2026

Tianwen-2 target asteroid (469219) Kamo'oalewa probably develops an Itokawa-compositional but ultra-highly space-weathered surface

China's Tianwen-2 mission plans to return samples from a small, rapidly spinning Earth quasi-satellite (469219) Kamo'oalewa. Previous studies linked Kamo'oalewa to lunar composition and origin. Here, we propose another scenario. We reanalyzed the reflectance spectrum of Kamo'oalewa and obtained an absorption band center at 1.001+-0.028 um (error is 1sigma), consistent with LL chondrites. We then conducted space weathering (SW) experiments on meteorites and found that highly space-weathered LL chondrite powder (but not slab) successfully reproduced the reflectance spectrum of Kamo'oalewa. We further traced the dynamical origin of Kamo'oalewa and found that it probably originated from the v6 secular resonance, and more specifically, the Flora family. Kamo'oalewa exhibits a similar composition to Itokawa and 7 objects in the Flora family, but with a higher degree of space weathering. We, therefore, proposed that Kamo'oalewa probably originated from the Flora family and developed an Itokawa-compositional, highly space-weathered, fine-regolith-dominated surface.

astro-ph.EP↗