arXiv · 2401.07345
Can an LLM Learn Preferences from Choice Data?
Abstract
Can large language models (LLMs) learn a decision maker's preferences from observed choices and generate preference-consistent recommendations in new situations? We propose a portable Simulate-Recommend-Evaluate framework that tests preference learning from revealed-choice data by comparing LLM recommendations with optimal choices implied by known preference primitives. We apply the framework to choice under uncertainty using the disappointment aversion model. Recommendation accuracy improves as models observe more choices, but learning is heterogeneous across preference types and LLMs: GPT learns risk aversion better than disappointment aversion, Gemini performs best in high disappointment-aversion regions, and Claude shows the broadest effective learning across parameter regions.
Explore related subjects
Keep this discovery
Jeongbin Kim, Matthew Kovach, Kyu-Min Lee, Euncheol Shin, Hector Tzavellas. 2024-01-14. Can an LLM Learn Preferences from Choice Data?. https://arxiv.org/abs/2401.07345
Cite the original work for its findings. Save a collection to share your selection of sources.