TY - RPRT TI - Direct Preference Optimization With Unobserved Preference Heterogeneity: The Necessity of Ternary Preferences AU - Keertana Chidambaram AU - Karthik Vinay Seetharaman AU - Vasilis Syrgkanis PY - 2025 UR - https://arxiv.org/abs/2405.15065 ID - 2405.15065 ER -