arXiv subjects

Nikita Drozdov

Publications and source records attributed to Nikita Drozdov.

4 recordsLinked to original sources

arXiv2026

Deformable Medical Image Registration with KAN-based Implicit Neural Representations

Deformable image registration (DIR) is central to medical image analysis, supporting spatial alignment for longitudinal studies and multi-modal fusion. Learning-based methods such as CNNs and transformers provide rapid inference but often require large training datasets and can underperform classical iterative methods for specific anatomies or modalities. Implicit neural representations (INRs) offer a data-efficient alternative by modeling deformation fields as continuous coordinate-to-displacement mappings, yet their per-pair optimization makes runtime efficiency and robustness to initialization essential. We introduce KAN-IDIR and RandKAN-IDIR, the first Kolmogorov--Arnold network (KAN)-based INR framework for pairwise-optimized, resolution-independent DIR, designed to improve seed stability and resource efficiency without dataset-level training. KANs use learnable activation functions that are well suited to continuous, physically structured deformation fields. RandKAN-IDIR further reduces cost through randomized basis sampling, preserving registration quality with fewer basis functions. We evaluate the methods on lung CT, brain MRI, and cardiac MRI datasets against pairwise INR approaches, dataset-trained deep models, and classical baselines. KAN-IDIR and RandKAN-IDIR achieve the highest accuracy among INR-based methods, with low computational overhead and superior stability across random initializations. RandKAN-IDIR slightly outperforms adaptive basis selection variants while avoiding their additional training-time complexity. This makes the approach practical for reproducible clinical research use. Source code is available at https://github.com/anac0der/KAN-IDIR.

cs.CV↗

arXiv2026

Z3D: Zero-Shot 3D Visual Grounding from Images

3D visual grounding (3DVG) aims to localize objects in a 3D scene based on natural language queries. In this work, we explore zero-shot 3DVG from multi-view images alone, without requiring any geometric supervision or object priors. We introduce Z3D, a universal grounding pipeline that flexibly operates on multi-view images while optionally incorporating camera poses and depth maps. We identify key bottlenecks in prior zero-shot methods causing significant performance degradation and address them with (i) a state-of-the-art zero-shot 3D instance segmentation method to generate high-quality 3D bounding box proposals and (ii) advanced reasoning via prompt-based segmentation, which utilizes full capabilities of modern VLMs. Extensive experiments on the ScanRefer and Nr3D benchmarks demonstrate that our approach achieves state-of-the-art performance among zero-shot methods. Code is available at https://github.com/col14m/z3d .

cs.CV↗

arXiv2025

Zoo3D: Zero-Shot 3D Object Detection at Scene Level

3D object detection is fundamental for spatial understanding. Real-world environments demand models capable of recognizing diverse, previously unseen objects, which remains a major limitation of closed-set methods. Existing open-vocabulary 3D detectors relax annotation requirements but still depend on training scenes, either as point clouds or images. We take this a step further by introducing Zoo3D, the first training-free 3D object detection framework. Our method constructs 3D bounding boxes via graph clustering of 2D instance masks, then assigns semantic labels using a novel open-vocabulary module with best-view selection and view-consensus mask generation. Zoo3D operates in two modes: the zero-shot Zoo3D$_0$, which requires no training at all, and the self-supervised Zoo3D$_1$, which refines 3D box prediction by training a class-agnostic detector on Zoo3D$_0$-generated pseudo labels. Furthermore, we extend Zoo3D beyond point clouds to work directly with posed and even unposed images. Across ScanNet200 and ARKitScenes benchmarks, both Zoo3D$_0$ and Zoo3D$_1$ achieve state-of-the-art results in open-vocabulary 3D object detection. Remarkably, our zero-shot Zoo3D$_0$ outperforms all existing self-supervised methods, hence demonstrating the power and adaptability of training-free, off-the-shelf approaches for real-world 3D understanding. Code is available at https://github.com/col14m/zoo3d .

cs.CV↗

arXiv2025

TUN3D: Towards Real-World Scene Understanding from Unposed Images

Layout estimation and 3D object detection are two fundamental tasks in indoor scene understanding. When combined, they enable the creation of a compact yet semantically rich spatial representation of a scene. Existing approaches typically rely on point cloud input, which poses a major limitation since most consumer cameras lack depth sensors and visual-only data remains far more common. We address this issue with TUN3D, the first method that tackles joint layout estimation and 3D object detection in real scans, given multi-view images as input, and does not require ground-truth camera poses or depth supervision. Our approach builds on a lightweight sparse-convolutional backbone and employs two dedicated heads: one for 3D object detection and one for layout estimation, leveraging a novel and effective parametric wall representation. Extensive experiments show that TUN3D achieves state-of-the-art performance across three challenging scene understanding benchmarks: (i) using ground-truth point clouds, (ii) using posed images, and (iii) using unposed images. While performing on par with specialized 3D object detection methods, TUN3D significantly advances layout estimation, setting a new benchmark in holistic indoor scene understanding. Code is available at https://github.com/col14m/tun3d .

cs.CV↗