TY - RPRT TI - Beyond Imitation: Self-Improving Robot Policies via Off-Policy Q-Planning AU - Varun Giridhar AU - Anant Khandelwal AU - Jeremy A. Collins AU - Ignat Georgiev AU - Animesh Garg PY - 2026 UR - https://arxiv.org/abs/2608.21204 ID - 2608.21204 ER -