SearcharxivSearch

arXiv subjects

Jianlin Xiang

Publications and source records attributed to Jianlin Xiang.

2 recordsLinked to original sources

PIEDet: Prototype-Driven Intrinsically Explainable Object Detection

Existing object detectors typically make predictions in a black-box manner and struggle to simultaneously provide discriminative evidence for their predictions, which limits their deployment in safety-critical scenarios. To explain model predictions, existing post-hoc explanation methods mostly rely on gradient-based or perturbation-based operators. These methods not only introduce additional memory and computational overhead but also make it difficult to ensure that the generated explanations faithfully reflect the model's internal decision-making process. To address these limitations, we propose PIEDet, a prototype-driven intrinsically explainable object detection framework. PIEDet innovatively embeds class prototypes as explicit discriminative units into the classification branch of a one-stage detector, thereby improving detection performance while providing intrinsic interpretability. First, PIEDet constructs hierarchical class prototypes at different detection levels, enabling the model to learn scale-aware class-semantic representations. Second, we propose a prototype-driven feature learning method consisting of prototype regularization and a region-to-prototype matching loss. The former enhances the inter-class discriminability of the prototypes, while the latter encourages prototype responses to focus on object regions. Finally, we introduce a scale-aligned hierarchical prototype supervision mechanism that assigns scale-matched supervision signals to different detection levels, thereby enhancing the scale specificity of the hierarchical prototypes. On the ExDark, RTTS, and VOC2012-FOG datasets, PIEDet improves mAP@0.5 over the baseline by 4.7%, 1.6%, and 4.8%, respectively, while demonstrating superior computational efficiency. Compared with mainstream post-hoc explanation methods, PIEDet achieves a better balance between explanation quality and explanation cost.

cs.CV

EIVE: End-to-End Instance-Specific Visual Explanations for Detection Transformers

Visual explainability for object detection remains challenging due to the multi-instance nature of detection. Existing approaches predominantly adopt post-hoc paradigms, such as gradient-based or perturbation-based explanation methods, to interpret pretrained detectors. However, these methods require additional gradient computation or repeated model inference, resulting in limited efficiency. To address this issue, we propose an End-to-end Instance-specific Visual Explanation framework (EIVE) that directly generates instance-level saliency maps following the forward pass of Detection Transformer (DETR)-like models. Specifically, we reformulate the cross-attention mechanism in the decoder as an instance-level feature attribution pathway, so that the cross-attention of each object query corresponds to the visual attribution of its predicted instance. Based on this formulation, we design a cross-layer hybrid consensus fusion (CLHCF) module to aggregate cross-attention signals across decoder layers, producing stable and compact explanations. The explanation process of EIVE requires neither gradient computation nor input perturbation, yielding high computational efficiency, and applies to single- and multi-scale DETR-like object detectors. Finally, we present an attention-aware joint training strategy (AAJTS) as a training-oriented application, which imposes spatial constraints on cross-attention patterns to encourage stable and concentrated attribution representations, thereby improving both interpretability and detection performance. Experiments on MS COCO 2017, ExDark, and Cityscapes demonstrate that EIVE produces high-quality instance-level saliency maps and achieves performance comparable to, or better than, state-of-the-art post-hoc methods across standard metrics, while substantially improving explanation efficiency. Code is available at https://github.com/xjlDestiny/EIVE.git.

cs.CV