arXiv subjects

Beibei Dong

Publications and source records attributed to Beibei Dong.

5 recordsLinked to original sources

arXiv2026

Same Attention, Different Truths: Put Logit-Lens over Visual Attention to Detect and Mitigate LVLM Object Hallucination

Large Vision-Language Models (LVLMs) often suffer from object hallucination, generating objects that are absent from the image. Prior work largely attributes this to insufficient visual attention. However, we find that both real and hallucinated objects receive equally strong visual attention in the model's mid-to-late layers, suggesting that the key issue may not be how much the model attends, but what it attends to and why. To this end, we decode the visual features of high-attention regions using Logit Lens, and observe that regions corresponding to real objects can be correctly decoded to the target object tokens, whereas those for hallucinated objects cannot. Building on this, we identify two hallucination mechanisms: (i) visual uncertainty, triggered by semantically similar or confusable regions; masking these regions eliminates the hallucination. (ii) contextual prior, triggered by strong co-occurrence priors; even when the initially attended region is masked, the hallucination persists and attention drifts to other regions. Based on these findings, we propose a simple yet effective training-free Detect-Mitigate framework comprising a Logit-Lens Consistency Check to detect hallucination and targeted remedies: High-Attention Regions Masking (HARM) for visual uncertainty hallucination, and Visual Evidence Enhanced Decoding (VEED) for contextual prior hallucination. Our approach achieves state-of-the-art results on multiple hallucination benchmarks. Code will be available.

cs.CV↗

arXiv2026

Single-photon time-stretch computational ghost spectroscopy

Time-stretch spectroscopy is powerful for capturing transient spectral phenomena but remains fundamentally limited by detector bandwidth or timing jitter, especially under photon-starved conditions. Here, we devise and implement single-photon time-stretch computational ghost spectroscopy, which integrates dispersive wavelength-to-time mapping with programmable temporal encoding and correlation-based reconstruction to overcome these detection limitations. Specifically, temporally stretched ultrashort pulses are modulated by predefined encoding patterns and detected by a low-bandwidth detector, allowing reconstruction of near-infrared spectra with 450 resolvable channels across 1530-1590 nm without direct high-speed waveform acquisition. By further incorporating compressive sensing, accurate spectral recovery is achieved at sub-Nyquist sampling rates, substantially reducing acquisition requirements to facilitate high-speed operation at 210 kHz. In the single-photon regime, computational ghost reconstruction effectively suppresses the intrinsic detector timing jitter, yielding high-fidelity spectra at illumination fluxes down to 0.01 photons/pulse. By jointly enabling broadband coverage, high spectral resolution, high acquisition speed, and single-photon sensitivity, this approach establishes a computation-enhanced paradigm for time-stretch spectroscopy and provides a versatile platform for ultrafast and photon-efficient spectroscopic applications.

physics.optics↗

arXiv2026

Infrared Single-Pixel Hyperspectral Imaging via Spatial-Temporal Multiplexing

Near-infrared (NIR) hyperspectral imaging is widely used to reveal morphological and chemical information. However, conventional spectral imagers usually rely on costly focal plane arrays and suffer from data redundancy and inefficiencies in spatial-spectral data acquisition. Here, we devise and implement a single-pixel NIR hyperspectral imaging system based on high-fidelity spectrum-to-time mapping and high-precision spatial-encoding compressive measurements. The system employs a single-mode telecommunication fiber for temporal dispersion and a programmable spatial light modulator to impose structured spatial patterns, with all signals detected by a single InGaAs photodetector. By correlating temporally stretched waveforms with spatial encodings, we reconstruct 64$\times$64 spatially resolved hyperspectral datacubes spanning 50 spectral bands over the 1550-1600 nm range. Furthermore, real-time monitoring of dynamic liquid injection is demonstrated at a datacube refreshing rate of 12 Hz under sub-Nyquist sampling. The presented architecture features single-pixel simplicity, high optical throughput, and efficient data acquisition, which would pave a novel way for NIR spectral imaging in biomedical diagnostics and material characterization.

physics.optics↗

arXiv2026

Endogenous Reprompting: Self-Evolving Cognitive Alignment for Unified Multimodal Models

Unified Multimodal Models (UMMs) exhibit strong understanding, yet this capability often fails to effectively guide generation. We identify this as a Cognitive Gap: the model lacks the understanding of how to enhance its own generation process. To bridge this gap, we propose Endogenous Reprompting, a mechanism that transforms the model's understanding from a passive encoding process into an explicit generative reasoning step by generating self-aligned descriptors during generation. To achieve this, we introduce SEER (Self-Evolving Evaluator and Reprompter), a training framework that establishes a two-stage endogenous loop using only 300 samples from a compact proxy task, Visual Instruction Elaboration. First, Reinforcement Learning with Verifiable Rewards (RLVR) activates the model's latent evaluation ability via curriculum learning, producing a high-fidelity endogenous reward signal. Second, Reinforcement Learning with Model-rewarded Thinking (RLMT) leverages this signal to optimize the generative reasoning policy. Experiments show that SEER consistently outperforms state-of-the-art baselines in evaluation accuracy, reprompting efficiency, and generation quality, without sacrificing general multimodal capabilities.

cs.AI↗

arXiv2023

Visual Realism Assessment for Face-swap Videos

Deep-learning based face-swap videos, also known as deep fakes, are becoming more and more realistic and deceiving. The malicious usage of these face-swap videos has caused wide concerns. The research community has been focusing on the automatic detection of these fake videos, but the assessment of their visual realism, as perceived by human eyes, is still an unexplored dimension. Visual realism assessment, or VRA, is essential for assessing the potential impact that may be brought by a specific face-swap video, and it is also important as a quality assessment metric to compare different face-swap methods. In this paper, we make a small step towards this new VRA direction by building a benchmark for evaluating the effectiveness of different automatic VRA models, which range from using traditional hand-crafted features to different kinds of deep-learning features. The evaluations are based on a recent competition dataset named DFGC 2022, which contains 1400 diverse face-swap videos that are annotated with Mean Opinion Scores (MOS) on visual realism. Comprehensive experiment results using 11 models and 3 protocols are shown and discussed. We demonstrate the feasibility of devising effective VRA models for assessing face-swap videos and methods. The particular usefulness of existing deepfake detection features for VRA is also noted. The code can be found at https://github.com/XianyunSun/VRA.git.

cs.CV↗