TY - RPRT TI - Soft Preference Optimization: Aligning Language Models to Expert Distributions AU - Arsalan Sharifnassab AU - Saber Salehkaleybar AU - Sina Ghiassian AU - Surya Kanoria AU - Dale Schuurmans PY - 2024 UR - https://arxiv.org/abs/2405.00747 ID - 2405.00747 ER -