TY - RPRT TI - Understanding the Performance Gap in Preference Learning: A Dichotomy of RLHF and DPO AU - Ruizhe Shi AU - Minhak Song AU - Runlong Zhou AU - Zihan Zhang AU - Maryam Fazel AU - Simon S. Du PY - 2026 UR - https://arxiv.org/abs/2505.19770 ID - 2505.19770 ER -