TY - RPRT TI - Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback AU - Hamish Ivison AU - Yizhong Wang AU - Jiacheng Liu AU - Zeqiu Wu AU - Valentina Pyatkin AU - Nathan Lambert AU - Noah A. Smith AU - Yejin Choi AU - Hannaneh Hajishirzi PY - 2024 UR - https://arxiv.org/abs/2406.09279 ID - 2406.09279 ER -