TY - RPRT TI - Towards Understanding Valuable Preference Data for Large Language Model Alignment AU - Zizhuo Zhang AU - Qizhou Wang AU - Shanshan Ye AU - Jianing Zhu AU - Jiangchao Yao AU - Bo Han AU - Masashi Sugiyama PY - 2026 UR - https://arxiv.org/abs/2510.13212 ID - 2510.13212 ER -