arXiv subjects

Jinkun Zhao

Publications and source records attributed to Jinkun Zhao.

5 recordsLinked to original sources

arXiv2026

TPCD: Tone-Pressure Contrastive Decoding and the Label-Free Gating Bottleneck in Vision-Language Models

High-pressure prompts can push vision-language models (VLMs) into unsupported commitments, such as reading illegible text, reporting indeterminate times, or affirming absent objects. This paper asks whether the pressure-induced distribution itself can serve as a contrastive-decoding negative branch. Tone-pressure contrastive decoding (TPCD) subtracts logits produced under a high-pressure instruction from logits produced under a safe neutral instruction. On the 800-example tone-matters benchmark, LLaVA-1.5-7B under pressure reaches 66.75% attack success rate (ASR); safe neutralization reduces ASR to 9.88%; full TPCD reaches 0.50% but collapses positives to 15.56%. A benchmark-specific task-prior/disagreement gate preserves measured positive accuracy (54.44%) while lowering ASR to 1.63% on LLaVA. Treating this LLaVA analysis as the design split, full $n=800$ negative and $n=780$ matched-positive held-out runs on GLM-4.6V and Llama-3.2-Vision show that simple gates can improve over safe neutralization, with sensitivity analyses bounding the weak time-positive subtask. A category-prior-free answer-disagreement router reduces held-out aggregate ASR to 6.93%, improving over both safe neutralization (10.98%) and branch disagreement (9.67%) while matching branch disagreement's 79.94% positive accuracy, although it remains post-hoc and surface-form based. We conclude that pressure is a useful probe of commitment bias and a viable mitigation signal, but the current gates are not yet independently validated grounding-aware detectors.

cs.CV↗

arXiv2025

What Color Is the Text? A Benchmark for Hallucination Induced by Image-Embedded Prompt

We introduce Embedded Stroop, a controlled diagnostic paradigm for measuring image-embedded prompt interference in Multimodal Large Language Models (MLLMs), where the query is rendered directly inside the visual input. Using the What-Color-Is-the-Text (WCIT) benchmark, which covers 59 fine-grained colors under Standard, Flipped, and Masked variants, we evaluate 16 proprietary and open-source models. To distinguish semantic capture from general color-naming failure, we decompose model responses into Accuracy, Stroop Hallucination Rate (SHR; answering the embedded word rather than the true text color), and Other Error Rate, and validate the effect with permutation tests, with 56 of 64 conditions remaining significant after FDR correction. Although exact color accuracy is low (6.3%) under the 59-color vocabulary, mapping predictions to 11 basic color families shows that models retain coarse color perception (38.4%) while still exhibiting a substantial SHR (21.6%). A conditional analysis restricted to colors correctly named in the Standard setting further confirms the effect, with pooled conditional SHR exceeding 50\%. Masking or flipping the embedded text reduces Stroop hallucinations, suggesting that semantic legibility can dominate visual color perception in MLLMs.

cs.CV↗

arXiv2025

CoE-Ops: Collaboration of LLM-based Experts for AIOps Question-Answering

With the rapid evolution of artificial intelligence, AIOps has emerged as a prominent paradigm in DevOps. Lots of work has been proposed to improve the performance of different AIOps phases. However, constrained by domain-specific knowledge, a single model can only handle the operation requirement of a specific task,such as log parser,root cause analysis. Meanwhile, combining multiple models can achieve more efficient results, which have been proved in both previous ensemble learning and the recent LLM training domain. Inspired by these works,to address the similar challenges in AIOPS, this paper first proposes a collaboration-of-expert framework(CoE-Ops) incorporating a general-purpose large language model task classifier. A retrieval-augmented generation mechanism is introduced to improve the framework's capability in handling both Question-Answering tasks with high-level(Code,build,Test,etc.) and low-level(fault analysis,anomaly detection,etc.). Finally, the proposed method is implemented in the AIOps domain, and extensive experiments are conducted on the DevOps-EVAL dataset. Experimental results demonstrate that CoE-Ops achieves a 72% improvement in routing accuracy for high-level AIOps tasks compared to existing CoE methods, delivers up to 8% accuracy enhancement over single AIOps models in DevOps problem resolution, and outperforms larger-scale Mixture-of-Experts (MoE) models by up to 14% in accuracy.

cs.CL↗

arXiv2024

Bench-CoE: a Framework for Collaboration of Experts from Benchmark

Large Language Models (LLMs) are key technologies driving intelligent systems to handle multiple tasks. To meet the demands of various tasks, an increasing number of LLMs-driven experts with diverse capabilities have been developed, accompanied by corresponding benchmarks to evaluate their performance. This paper proposes the Bench-CoE framework, which enables Collaboration of Experts (CoE) by effectively leveraging benchmark evaluations to achieve optimal performance across various tasks. Bench-CoE includes a set of expert models, a router for assigning tasks to corresponding experts, and a benchmark dataset for training the router. Moreover, we formulate Query-Level and Subject-Level approaches based on our framework, and analyze the merits and drawbacks of these two approaches. Finally, we conduct a series of experiments with vary data distributions on both language and multimodal tasks to validate that our proposed Bench-CoE outperforms any single model in terms of overall performance. We hope this method serves as a baseline for further research in this area. The code is available at \url{https://github.com/ZhangXJ199/Bench-CoE}.

cs.AI↗

arXiv2021

Extended Tidal Tails of IC 4756 detected by {\it Gaia} EDR3

We report the discovery of emerged tidal tails around open cluster IC 4756 ($\sim$ 1 Gyr) based on 644 members identified from {\it Gaia} EDR3. Three-dimensional spatial positions, two-dimensional tangential velocities $\left( x, y, z, κ\cdot μ_α^{*}/\varpi, κ\cdot μ_δ/\varpi \right)$ are utilized to determine the co-moving member candidates of IC 4756. Using a Bayesian method, we correct the distance for each cluster member. Two tidal tails extend up to 180 pc and display a S-shape in $X^{\prime}Y^{\prime}$ space (Cartesian coordinates focused on cluster center). A clean sequence of our members in Color-Absolute-Magnitude Diagram (CAMD) indicates the coeval population and matches perfectly with the PARSEC isochrone with age from Bossini et al. (2019). Mass segregation is detected in this cluster as well. Finally, we derive the tidal radius and core radius of IC 4756 about $12.13$ pc and $4.33 \pm 0.75$ pc, respectively.

astro-ph.GA↗