TY - RPRT TI - Difficulty-Based Preference Data Selection by DPO Implicit Reward Gap AU - Xuan Qi AU - Rongwu Xu AU - Zhijing Jin PY - 2026 UR - https://arxiv.org/abs/2508.04149 ID - 2508.04149 ER -