arXiv subjects

Shao-Jun Xia

Publications and source records attributed to Shao-Jun Xia.

4 recordsLinked to original sources

arXiv2026

Collaborative Memory for Multi-Agent VLM Systems

Vision-language model (VLM) agents combine specialized perception, tools, and reasoning to address complex visual tasks. In multi-agent settings, different agents inspect different image regions, video frames, or visual representations, so collaboration extends beyond distributed reasoning to distributed perception. This makes shared visual context a central problem in VLM agent collaboration. In this paper, we frame memory hierarchy, cross-agent sharing, and consistency mechanisms around the need to reconcile interpretations and update dependent reasoning. Effective collaboration requires agents to build on contributions from other agents, recover missing visual context, and reconcile differing interpretations as new evidence emerges. Shared visual memory preserves not only images or textual summaries but also the dependencies among observations, agent interpretations, and subsequent reasoning. Together, these design considerations shape how information flows and evolves across VLM agents. The proposed framework provides a foundation for building reliable and resource-efficient agent teams.

cs.AI↗

arXiv2026

T2T-VICL: Cross-Task Visual In-Context Learning via Implicit Text-Driven VLMs

Visual in-context learning (VICL) solves visual tasks by conditioning on a few input-output demonstrations without any model training. Recent advances in large vision-language models (VLMs) have shown promising VICL capability when the demonstration pair and the query belong to the same vision task, but real use cases often provide mismatched examples, making it unclear whether a VLM should imitate the demonstrated transformation or infer a new one from the query. This raises a fundamental question: Can VLMs perform cross-task VICL where demonstration and query differ? In the paper, we study this cross-task VICL setting and propose T2T-VICL, a collaborative prompt-transfer framework, which converts mismatched visual demonstrations into implicit textual guidance without explicitly naming the tasks. To do so, a large teacher VLM first generates structured descriptions of visual changes and task differences between task pairs, from which we construct a dataset of diverse implicit cross-task relations. We then distill this capability into a lightweight student VLM that produces content-dependent prompts from a task-A demonstration pair and a task-B query. The generated prompt is used to guide a frozen image-editing VLM, and a score-based inference strategy is introduced to rank multiple candidates. Experiments on 12 low-level vision tasks and over 20 evaluated cross-task pairs show that T2T-VICL consistently improves task-aware alignment over fixed prompting and often also improves image fidelity, revealing both the potential and limits of cross-task VICL. Our code is available on GitHub.

cs.CV↗

arXiv2026

Hidden-Shot: Towards One-Shot Task Generalization for Low-Level Vision Generalist Models

Despite the intense engagement surrounding low-level vision generalist models, their effectiveness in zero/few-shot scenarios beyond learned tasks remains unverified. The primary challenge of developing an ideal generalist lies in achieving the ability to generalize from new unseen tasks, which also can be assessed by matched quantitative criteria. Existing methods have made some progress in prompt engineering but have not systematically explored this gap across a wide range of low-level visual tasks. Stimulated by the problem, we propose Hidden-Shot, an implicit prompt mechanism aimed at exploring low-level task adaptation in a vision generalist model. Specifically, the method extracts implicit visual task-based information, utilizes a global task-aware textural prompt, and selectively merges implicit information with in-task processing information to enhance one-shot capabilities in new tasks. The overall design performs direct injection in a cost-effective manner, while minimally altering the architecture of the original generalist model. Additionally, we introduce a data-driven evaluation framework termed C/U assessment to cover two basic scenarios, 3C4U (3 conventional and 4 unconventional tasks) for retraining existing models and 3C7U (3 conventional and 7 unconventional tasks) for training from scratch, as a comprehensive assessment to systematically test the generalization ability of low-level generalist models. Experiments on seven and ten datasets outperform the state-of-the-art vision generalist model, respectively verified by 3C4U and 3C7U framework. Our presented Hidden-Shot approach demonstrates superior performance on one-shot new tasks while maintaining consistent performance on existing tasks.

cs.CV↗

arXiv2026

SpindleFlexNet: Flexible sleep spindles detection for EEG signals based on an adaptive one-dimensional RetinaNet-based framework

Sleep spindle is a physiologically significant biomedical signal in electroencephalographic (EEG) waveforms, which is typically a low-amplitude event in sleep. Due to the small signal ratio in the overall EEG, previous detection methods have limited capability to capture its start and end points and lack flexibility in handling multi-spindle scenarios. To address the gap, we address the problem from a new perspective and introduce SpindleFlexNet, the first framework in this field to apply deep learning-based one-dimensional object detection, leveraging an adapted one-dimensional RetinaNet architecture. The framework employs one-dimensional anchor generation, matching, and regression, along with a customized one-dimensional loss function. Analyses were conducted on two public datasets: the Montreal Archive of Sleep Studies and DREAMS, from which a total of 11,061 and 335 segments were obtained, respectively. When trained on these datasets, SpindleFlexNet achieved an average recall, precision, and F1-score of 0.61, 0.76, 0.67, and 0.58, 0.80, 0.67 in five-fold cross-validation. The model demonstrates stable detection performance and good generalization, making it a practical tool for sleep research. Potential applications include automated spindle labeling in clinical settings and as a reference for studies combining EEG with simultaneous functional magnetic resonance imaging.

eess.SP↗