arXiv subjects

Tapas Kumar Dutta

Publications and source records attributed to Tapas Kumar Dutta.

3 recordsLinked to original sources

arXiv2026

DentiAsk: A VQA Benchmark for Multimodal Reasoning in Panoramic Dental Radiographs

Accurate interpretation of panoramic dental radiographs requires the integration of multiple reasoning capabilities: detection, spatial localization, and quantitative assessment. Despite recent advances in multimodal learning, existing medical visual question answering (VQA) benchmarks do not fully capture this complexity, often reducing the task to simplified classification or templated queries. As a result, they provide limited coverage of the diverse reasoning processes required for clinically meaningful interpretation. We introduce DentiAsk, a large-scale dental VQA benchmark that pairs high-resolution panoramic dental radiographs with clinician-validated question-answer pairs spanning three reasoning tiers: descriptive recognition, spatial localization, and numerical quantification across three high-prevalence pathologies: periapical radiolucency (PARL), impacted teeth, and dental caries. DentiAsk comprises 1,000 high-resolution radiographs annotated with 10,000 expert-curated QA pairs. To our knowledge, it is the first dental VQA benchmark to unify categorical, spatial, and quantitative reasoning as separately scored tasks within a single evaluation framework. We benchmark 10 state-of-the-art vision-language models, including LLaVA-v1.5, LLaVA-v1.6, Qwen-VL, InternVL2, and LLaVA-Med, and find that models achieve stronger performance on descriptive queries, whereas they degrade sharply on spatial localization and counting, exposing limitations in compositional, multi-step reasoning. These findings reveal a gap between visual recognition and clinically meaningful reasoning, establishing DentiAsk as a challenging benchmark for advancing multimodal reasoning in medical imaging.

q-bio.QM↗

arXiv2025

SketchFusion: Learning Universal Sketch Features through Fusing Foundation Models

While foundation models have revolutionised computer vision, their effectiveness for sketch understanding remains limited by the unique challenges of abstract, sparse visual inputs. Through systematic analysis, we uncover two fundamental limitations: Stable Diffusion (SD) struggles to extract meaningful features from abstract sketches (unlike its success with photos), and exhibits a pronounced frequency-domain bias that suppresses essential low-frequency components needed for sketch understanding. Rather than costly retraining, we address these limitations by strategically combining SD with CLIP, whose strong semantic understanding naturally compensates for SD's spatial-frequency biases. By dynamically injecting CLIP features into SD's denoising process and adaptively aggregating features across semantic levels, our method achieves state-of-the-art performance in sketch retrieval (+3.35%), recognition (+1.06%), segmentation (+29.42%), and correspondence learning (+21.22%), demonstrating the first truly universal sketch feature representation in the era of foundation models.

cs.CV↗

arXiv2024

SAM-Mamba: Mamba Guided SAM Architecture for Generalized Zero-Shot Polyp Segmentation

Polyp segmentation in colonoscopy is crucial for detecting colorectal cancer. However, it is challenging due to variations in the structure, color, and size of polyps, as well as the lack of clear boundaries with surrounding tissues. Traditional segmentation models based on Convolutional Neural Networks (CNNs) struggle to capture detailed patterns and global context, limiting their performance. Vision Transformer (ViT)-based models address some of these issues but have difficulties in capturing local context and lack strong zero-shot generalization. To this end, we propose the Mamba-guided Segment Anything Model (SAM-Mamba) for efficient polyp segmentation. Our approach introduces a Mamba-Prior module in the encoder to bridge the gap between the general pre-trained representation of SAM and polyp-relevant trivial clues. It injects salient cues of polyp images into the SAM image encoder as a domain prior while capturing global dependencies at various scales, leading to more accurate segmentation results. Extensive experiments on five benchmark datasets show that SAM-Mamba outperforms traditional CNN, ViT, and Adapter-based models in both quantitative and qualitative measures. Additionally, SAM-Mamba demonstrates excellent adaptability to unseen datasets, making it highly suitable for real-time clinical use.

cs.CV↗