TY - RPRT TI - Direct Preference Optimization with Unobserved Preference Heterogeneity: The Necessity of Ternary Preferences AU - Keertana Chidambaram AU - Karthik Vinary Seetharaman AU - Vasilis Syrgkanis PY - 2025 UR - https://arxiv.org/abs/2510.15716 ID - 2510.15716 ER -