arXiv · 2511.14233
Visionary Co-Driver: Enhancing Driver Perception of Potential Risks with LLM and HUD
Abstract
Drivers' perception of risky situations has always been a challenge in driving. Existing risk-detection methods excel at identifying collisions but face challenges in assessing the behavior of road users in non-collision situations. This paper introduces Visionary Co-Driver, a system that leverages large language models to identify non-collision roadside risks and alert drivers based on their eye movements. Specifically, the system combines video processing algorithms and LLMs to identify potentially risky road users. These risks are dynamically indicated on an adaptive heads-up display interface to enhance drivers' attention. A user study with 41 drivers confirms that Visionary Co-Driver improves drivers' risk perception and supports their recognition of roadside risks.
Explore related subjects
Keep this discovery
Wei Xiang, Ziyue Lei, Jie Wang, Yingying Huang, Qi Zheng, Tianyi Zhang, An Zhao, Lingyun Sun. 2025-11-18. Visionary Co-Driver: Enhancing Driver Perception of Potential Risks with LLM and HUD. https://arxiv.org/abs/2511.14233
Cite the original work for its findings. Save a collection to share your selection of sources.