TY - RPRT TI - Understanding Likelihood Over-optimisation in Direct Alignment Algorithms AU - Zhengyan Shi AU - Sander Land AU - Acyr Locatelli AU - Matthieu Geist AU - Max Bartolo PY - 2024 UR - https://arxiv.org/abs/2410.11677 ID - 2410.11677 ER -