TY - RPRT TI - Revisiting Self-Play Preference Optimization: On the Role of Prompt Difficulty AU - Yao Xiao AU - Jung-jae Kim AU - Roy Ka-wei Lee AU - Lidong Bing PY - 2026 UR - https://arxiv.org/abs/2510.05534 ID - 2510.05534 ER -