TY - RPRT TI - Semiparametric Preference Optimization: Your Language Model is Secretly a Single-Index Model AU - Nathan Kallus PY - 2026 UR - https://arxiv.org/abs/2512.21917 ID - 2512.21917 ER -