TY - RPRT TI - Towards Improved Preference Optimization Pipeline: from Data Generation to Budget-Controlled Regularization AU - Zhuotong Chen AU - Fang Liu AU - Jennifer Zhu AU - Wanyu Du AU - Yanjun Qi PY - 2024 UR - https://arxiv.org/abs/2411.05875 ID - 2411.05875 ER -