TY - RPRT TI - Rethinking KL Regularization in RLHF: From Value Estimation to Gradient Optimization AU - Kezhao Liu AU - Jason Klein Liu AU - Mingtao Chen AU - Yiming Liu PY - 2025 UR - https://arxiv.org/abs/2510.01555 ID - 2510.01555 ER -