TY - RPRT TI - Beyond Pairs: Your Language Model is Secretly Optimizing a Preference Graph AU - Ning Liu AU - Chuanneng Sun AU - Kristina Klinkner AU - Shervin Malmasi PY - 2026 UR - https://arxiv.org/abs/2605.08037 ID - 2605.08037 ER -