arXiv · 2610.27114
Joint Constraint Aggregation for Qualifier-Sensitive Retrieval-Augmented QA
Abstract
Retrieval-augmented QA can fail even when the correct answer is in the retrieved evidence. This can happen when a competing answer satisfies some, but not all, of the question's requirements and is mentioned frequently in the retrieved documents, which can make it appear to be the best-supported answer. To test whether this retrieval skew actually affects the decision, we manipulate it directly: increasing the prevalence of passages that favor the competing answer makes the model more likely to select it. This points to a decision problem that candidate-level support alone cannot resolve. We therefore introduce Joint Constraint Aggregation (JCA), which compares candidates against the same question-derived requirements using the retrieved evidence. Across three evaluation settings and three instruction-tuned backbones, JCA improves overall accuracy, and its advantage grows when retrieval favors a competing answer. Together, these results suggest that when partial matches and retrieval prominence pull models toward a competing answer, comparing candidates against the question's full requirements can make selection more reliable.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Jennifer Hsia, Zachary C. Lipton, Aarti Singh. 2026-10-19. Joint Constraint Aggregation for Qualifier-Sensitive Retrieval-Augmented QA. https://searcharxiv.com/abs/2610.27114
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.