TY - RPRT TI - Distributed Direct Preference Optimization AU - Zhanhong Jiang PY - 2026 UR - https://arxiv.org/abs/2605.20696 ID - 2605.20696 ER -