TY - RPRT TI - Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model AU - Junshu Pan AU - Wei Shen AU - Shulin Huang AU - Qiji Zhou AU - Yue Zhang PY - 2025 UR - https://arxiv.org/abs/2504.15843 ID - 2504.15843 ER -