TY - RPRT TI - A Good Plan is Hard to Find: Aligning Models with Preferences is Misaligned with What Helps Users AU - Nishant Balepur AU - Matthew Shu AU - Yoo Yeon Sung AU - Seraphina Goldfarb-Tarrant AU - Shi Feng AU - Fumeng Yang AU - Rachel Rudinger AU - Jordan Lee Boyd-Graber PY - 2025 UR - https://arxiv.org/abs/2509.18632 ID - 2509.18632 ER -