TY - RPRT TI - One Bias After Another: Mechanistic Reward Shaping and Persistent Biases in Language Reward Models AU - Daniel Fein AU - Max Lamparth AU - Violet Xiang AU - Mykel J. Kochenderfer AU - Nick Haber PY - 2026 UR - https://arxiv.org/abs/2603.03291 ID - 2603.03291 ER -