TY - RPRT TI - Catastrophic Goodhart: regularizing RLHF with KL divergence does not mitigate heavy-tailed reward misspecification AU - Thomas Kwa AU - Drake Thomas AU - AdriĆ  Garriga-Alonso PY - 2024 UR - https://arxiv.org/abs/2407.14503 ID - 2407.14503 ER -