TY - RPRT TI - Dr. SoW: Density Ratio of Strong-over-weak LLMs for Reducing the Cost of Human Annotation in Preference Tuning AU - Guangxuan Xu AU - Kai Xu AU - Shivchander Sudalairaj AU - Hao Wang AU - Akash Srivastava PY - 2025 UR - https://arxiv.org/abs/2411.02481 ID - 2411.02481 ER -