TY - RPRT TI - RL Excursions during Pre-Training: Re-examining Policy Optimization for LLM training AU - Rachit Bansal AU - Clara Mohri AU - Tian Qin AU - David Alvarez-Melis AU - Sham Kakade PY - 2026 UR - https://arxiv.org/abs/2606.04272 ID - 2606.04272 ER -