TY - RPRT TI - Which Preferences to Train On? End-to-End Multi-Objective Alignment with an Adversarial Preference Distribution AU - Minjae Lee AU - Kyunghyun Cho AU - Sangdon Park PY - 2026 UR - https://arxiv.org/abs/2610.04845 ID - 2610.04845 ER -