TY  - RPRT
TI  - Policy Optimization in RLHF: The Impact of Out-of-preference Data
AU  - Ziniu Li
AU  - Tian Xu
AU  - Yang Yu
PY  - 2024
UR  - https://arxiv.org/abs/2312.10584
ID  - 2312.10584
ER  -