TY - RPRT TI - Offline Preference Optimization via Maximum Marginal Likelihood Estimation AU - Saeed Najafi AU - Alona Fyshe PY - 2026 UR - https://arxiv.org/abs/2510.22881 ID - 2510.22881 ER -