TY - RPRT TI - How Well Can Preference Optimization Generalize Under Noisy Feedback? AU - Shawn Im AU - Sharon Li PY - 2026 UR - https://arxiv.org/abs/2510.01458 ID - 2510.01458 ER -