TY - RPRT TI - Distortion of AI Alignment: Does Preference Optimization Optimize for Preferences? AU - Paul Gölz AU - Nika Haghtalab AU - Kunhe Yang PY - 2025 UR - https://arxiv.org/abs/2505.23749 ID - 2505.23749 ER -