arXiv · 2611.10819
Selective Cooperative Perception via Blind Spot Reasoning and Agentic Dialogue with Vision-Language Models
Abstract
Real-time cooperative perception (CP) in multi-agent traffic environments is highly resource-intensive, which posing scalability challenges for large-scale deployment. Efficiency can be significantly improved by selectively performing CP only in safety-critical scenarios and for key occluding objects. Vision-Language Models (VLMs) are well-suited for complex reasoning in dynamic and uncertain environments, making them a promising tool for this selective CP task. This study proposes a VLM-driven agentic framework for blind spot reasoning and dialogue-based CP. A mixed-model architecture is designed that integrates conventional object detection for stable perception, vision-language reasoning for identifying impactful occlusions, and a physics-based geometric module to align reasoning with real-world visibility constraints. The framework also incorporates a Chain-of-Thought (CoT) prompting mechanism to enhance interpretability and intent-aware decision-making. We collect real-world data from connected vehicles operating in urban traffic and compare the driving-critical blind spot identification and dialogue performance of four state-of-the-art VLMs. Experimental results demonstrate that our method achieves over 80% accuracy in driving-critical blind spot detection and over 90% success in dialogue-driven perception sharing. This work provides a scalable, interpretable, and bandwidth-efficient alternative to conventional CP pipelines, and offers new insights into agentic communication design for future connected traffic systems.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Chengyuan Ma, Shixiao Liang, Hangyu Li, Zheng Li, Hang Zhou, Keke Long, Bofeng Cao, Zhaohui Liang, Xiaopeng Li. 2026-11-07. Selective Cooperative Perception via Blind Spot Reasoning and Agentic Dialogue with Vision-Language Models. https://searcharxiv.com/abs/2611.10819
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.