arXiv · 2611.14901
Understanding the Effects of Multi-Agent Deliberation for Human-AI Decision-Making
Abstract
Multi-agent deliberation (MAD), where multiple LLMs engage in structured discussion, improves AI performance on many benchmarks, but whether it helps humans make better decisions remains untested. We conduct two user studies on LLM-response-verification and fact-checking. We first compare MAD against common AI decision-support methods that isolate its two defining dimensions --- multiple AIs and multi-round interaction. We find MAD outperformed single-round AI assistance on both tasks; multi-round interaction was the main driver of this benefit, while a second AI added value when the single AI had room to improve. Then, we study two design choices in MAD --- AI persona and human engagement level --- finding a devil's advocate persona to lower accuracy and user experience, while humans' active participation in MAD improved accuracy in one task at the cost of frustration. We conclude by discussing implications for when, why, and how multi-agent deliberation can support human decision-making.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Harry Yizhou Tian, Ming Yin. 2026-11-11. Understanding the Effects of Multi-Agent Deliberation for Human-AI Decision-Making. https://searcharxiv.com/abs/2611.14901
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.