TY - RPRT TI - When Weak LLMs Speak with Confidence, Preference Alignment Gets Stronger AU - Amirabbas Afzali AU - Myeongho Jeon AU - Maria Brbic PY - 2026 UR - https://arxiv.org/abs/2603.04968 ID - 2603.04968 ER -