TY - RPRT TI - Anatomy of Off-Policy Policy Gradient: Importance Sampling, KL Regularization, and Baselines AU - Haoqun Cao AU - Yurun Yuan AU - Tengyang Xie PY - 2026 UR - https://arxiv.org/abs/2610.25725 ID - 2610.25725 ER -