TY - RPRT TI - Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization AU - Noam Razin AU - Sadhika Malladi AU - Adithya Bhaskar AU - Danqi Chen AU - Sanjeev Arora AU - Boris Hanin PY - 2025 UR - https://arxiv.org/abs/2410.08847 ID - 2410.08847 ER -