Searcharxiv⌕ Search

arXiv subjects

Yuruo Gong

Publications and source records attributed to Yuruo Gong.

2 recordsLinked to original sources

AITHER: Authority-Informed Evidence Routing for Mixed-Authority Vision-Language Reasoning

Reliable vision-language reasoning requires a control decision that conventional grounding methods leave implicit: which input is entitled to determine the answer? Auxiliary text may be a defeasible claim about an image, a binding task instruction, or compatible context. Correcting every image-text conflict toward the image therefore repairs false claims but overwrites valid task rules. We formalize this setting as mixed-authority vision-language reasoning and introduce AITHER, an Authority-Informed Text-Image Hierarchy for Evidence Routing. Its final policy, the Semantic-Frame Router, is a training-free black-box control layer that (i) compiles explicit task directives, (ii) recovers standardized spatial frames from metadata-scrubbed pixels, (iii) resolves the semantic polarity of remaining notes, and (iv) routes among frozen observable candidates with fail-closed semantics. This ordered decomposition converts authority arbitration from an unconstrained prompt preference into a reproducible inference program. Across 1,620 MATRIX predictions, AITHER reaches 95.1% accuracy, exceeding the strongest task-and-frame baseline by 9.1 points with a 95% record-cluster interval of 6.8-11.5 points and no harmed records. It further reaches 100.0% on 1,800 controlled FRAME predictions and 93.3% on GQA-MATRIX. The results show that explicit authority routing can simultaneously improve false-claim correction, preserve task-defined answers, and eliminate clean-context overcorrection.

cs.CV↗

UNMATCH: Selective Unbalanced Token-Patch Matching for Forensic Image-Claim Verification

Contextual image misuse pairs an image with a misleading claim. We study image-claim correspondence in fact-checked pairs containing out-of-context reuse, visual manipulation, or both. Existing pair-based detectors often compress the two modalities into a global compatibility score or learn a highly flexible interaction module, which can obscure a decisive local mismatch. We introduce directional multiscale coverage, a compact representation that summarizes local image-claim affinity in both directions and at three spatial scales. At each scale, each direction is summarized by its mean, lower quartile, and two thresholded support ratios; the signed difference between directional means completes a nine-dimensional scale descriptor. Concatenating the three scales yields a compact local representation for a lightweight global-local classifier. Under leakage-aware three-fold, three-seed evaluation on the Snopes subset of the Fauxtography benchmark, UNMATCH achieves 69.82 Macro-F1 and 71.05 balanced accuracy, exceeding the MCOT adaptation by 2.60 and 2.16 points. A matched-reassigned intervention shows that breaking the observed pairing lowers coverage and increases both discrepancy and false-pair probability.

cs.CV↗