SearcharxivSearch

arXiv subjects

Satyam Gaba

Publications and source records attributed to Satyam Gaba.

3 recordsLinked to original sources

SCD4VPR: Multi-modal Scene Change Detection for Long-term Visual Place Recognition Database Update

Long-term autonomy in mobile robotics requires maps that remain accurate as environments change over time. Visual Place Recognition (VPR), a core localization capability, degrades sharply as the temporal gap between query and database images grows, particularly across seasonal transitions. Scene Change Detection (SCD) offers a principled mechanism for database maintenance, but existing methods rely on binary, uni-modal visual features that cannot distinguish structural changes from viewpoint-induced differences - a distinction essential for correct update decisions. We propose SCD4VPR, a scene change detection that jointly reasons about what has changed and distinguishes genuine change from viewpoint-induced difference in a unified vision-language framework. SCD4VPR fuses VLM-generated semantic descriptions with visual features via cross-modal attention and refines predictions with geometric-semantic matching, producing multi-class change masks that separately identify object changes, appearance changes, and viewpoint-induced changes. We introduce NYC-CD, the first real-world street-view SCD benchmark with pixel-level multi-class annotations across 8,122 image pairs. Experiments across four SCD benchmarks show that SCD4VPR consistently improves three architecturally distinct backbones. In a controlled VPR database maintenance experiment on NYU-VPR spanning summer through late winter, we confirm that retrieval performance deteriorates substantially when the database is left unchanged, and show that SCD4VPR-guided updates recover most of this loss (+30.1 R@1 at the largest time gap) while keeping the database far more compact than naive append.

cs.CV

Generative AI for Enhanced Wildfire Detection: Bridging the Synthetic-Real Domain Gap

The early detection of wildfires is a critical environmental challenge, with timely identification of smoke plumes being key to mitigating large-scale damage. While deep neural networks have proven highly effective for localization tasks, the scarcity of large, annotated datasets for smoke detection limits their potential. In response, we leverage generative AI techniques to address this data limitation by synthesizing a comprehensive, annotated smoke dataset. We then explore unsupervised domain adaptation methods for smoke plume segmentation, analyzing their effectiveness in closing the gap between synthetic and real-world data. To further refine performance, we integrate advanced generative approaches such as style transfer, Generative Adversarial Networks (GANs), and image matting. These methods aim to enhance the realism of synthetic data and bridge the domain disparity, paving the way for more accurate and scalable wildfire detection models.

cs.CV

Improving Long-Tailed Object Detection with Balanced Group Softmax and Metric Learning

Object detection has been widely explored for class-balanced datasets such as COCO. However, real-world scenarios introduce the challenge of long-tailed distributions, where numerous categories contain only a few instances. This inherent class imbalance biases detection models towards the more frequent classes, degrading performance on rare categories. In this paper, we tackle the problem of long-tailed 2D object detection using the LVISv1 dataset, which consists of 1,203 categories and 164,000 images. We employ a two-stage Faster R-CNN architecture and propose enhancements to the Balanced Group Softmax (BAGS) framework to mitigate class imbalance. Our approach achieves a new state-of-the-art performance with a mean Average Precision (mAP) of 24.5%, surpassing the previous benchmark of 24.0%. Additionally, we hypothesize that tail class features may form smaller, denser clusters within the feature space of head classes, making classification challenging for regression-based classifiers. To address this issue, we explore metric learning to produce feature embeddings that are both well-separated across classes and tightly clustered within each class. For inference, we utilize a k-Nearest Neighbors (k-NN) approach to improve classification performance, particularly for rare classes. Our results demonstrate the effectiveness of these methods in advancing long-tailed object detection.

cs.CV