Searcharxiv⌕ Search

arXiv subjects

Shiyu Gu

Publications and source records attributed to Shiyu Gu.

1 recordsLinked to original sources

Evidence-Calibrated Selective Decoding for Reliable Visual Question Answering

Visual question answering systems can produce confident responses that are weakly supported by their input images. Contrastive decoding can reduce this dependence on language priors, but a fixed correction may also overturn a correct answer, while selective answering can conceal errors by reducing coverage. We develop evidence-calibrated selective decoding, a framework that separates three decisions: whether local visual evidence supports a candidate, how strongly to correct the original distribution, and whether the resulting answer should be released under a verification budget. Evidence Verification across Crops (EVC) measures visual support and disagreement; Adaptive Contrast Correction (ACC) applies a bounded modification within the backbone's plausible candidate set; Budgeted Selective Answering (BSA) calibrates an answer-admission threshold on held-out images. We provide a complete mathematical specification, bounded-perturbation analysis, and an evaluation protocol that distinguishes forced answering from selective risk. Our quantitative analysis re-examines published baselines on POPE instantiated over MSCOCO, A-OKVQA, and GQA, together with four MME subtasks. These public measurements reveal variation across backbones, tasks, and correction settings that motivates adaptive control. The proposed framework has not yet undergone model-level evaluation; its effectiveness remains a falsifiable hypothesis rather than an established empirical result.

cs.CV↗