TY - RPRT TI - Adaptive Margin RLHF via Preference over Preferences AU - Yaswanth Chittepu AU - Prasann Singhal AU - Greg Durrett AU - Scott Niekum PY - 2026 UR - https://arxiv.org/abs/2509.22851 ID - 2509.22851 ER -