TY - RPRT TI - Is On-Policy Data always the Best Choice for Direct Preference Optimization-based LM Alignment? AU - Zetian Sun AU - Dongfang Li AU - Xuhui Chen AU - Baotian Hu AU - Min Zhang PY - 2026 UR - https://arxiv.org/abs/2508.10530 ID - 2508.10530 ER -