TY - RPRT TI - What Is Preference Optimization Doing, and Why? AU - Yue Wang AU - Qizhou Wang AU - Zizhuo Zhang AU - Gang Niu AU - Bo Han AU - Masashi Sugiyama PY - 2026 UR - https://arxiv.org/abs/2512.00778 ID - 2512.00778 ER -