TY - RPRT TI - When In-Distribution Gains Fail: Evaluating Weak-to-Strong Reward Models under Preference Shift AU - Khoi Le AU - Tri Cao AU - Phong Nguyen AU - Cong-Duy Nguyen AU - Anh Tuan Luu AU - Miao Chunyan AU - See-Kiong Ng AU - Thong Nguyen PY - 2026 UR - https://arxiv.org/abs/2605.25629 ID - 2605.25629 ER -