TY - RPRT TI - Towards Bridging the Gap Between Offline and Iterative Alignment via Preference Distillation AU - Wenbo Zhang AU - Wenzhuo Zhou AU - Hengrui Cai AU - Zhengling Qi PY - 2026 UR - https://arxiv.org/abs/2609.06893 ID - 2609.06893 ER -