TY - RPRT TI - Preventing Learning Stagnation in PPO by Scaling to 1 Million Parallel Environments AU - Michael Beukman AU - Khimya Khetarpal AU - Zeyu Zheng AU - Will Dabney AU - Jakob Foerster AU - Michael Dennis AU - Clare Lyle PY - 2026 UR - https://arxiv.org/abs/2603.06009 ID - 2603.06009 ER -