TY - RPRT TI - Why is Your Language Model a Poor Implicit Reward Model? AU - Noam Razin AU - Yong Lin AU - Jiarui Yao AU - Sanjeev Arora PY - 2026 UR - https://arxiv.org/abs/2507.07981 ID - 2507.07981 ER -