TY - RPRT TI - From "Weak" Signals to Strong Models: Preference Delta Aggregation with LoRA Merging AU - Qi Sun AU - Siyue Zhang AU - Yulin Chen AU - Yuxiang Xue AU - Ru Peng AU - Chen Zhao PY - 2026 UR - https://arxiv.org/abs/2606.00357 ID - 2606.00357 ER -