SearcharxivSearch

arXiv subjects

Smit Kadvani

Publications and source records attributed to Smit Kadvani.

3 recordsLinked to original sources

How Far Can You Get Without a GPU? A Systematic Benchmark of Lightweight Hallucination Detection Across Question Answering, Dialogue, and Summarisation

Hallucination detection has become a pressing requirement for trustworthy AI deployment at scale. The most accurate detection methods depend on GPU-intensive inference, proprietary API calls, or white-box access to the generating model. This puts them out of reach for resource-constrained researchers and practitioners. In this paper, we explore a practical alternative: how well can hallucination detection perform using only lightweight, CPU-feasible methods built on publicly available models? We systematically benchmark five such methods: ROUGE-L, semantic similarity, BERTScore, a Natural Language Inference (NLI) detector based on a FEVER-trained DeBERTa model, and a score-level ensemble of similarity and NLI. We evaluate them across all three tasks of the HaluEval benchmark: question answering (QA), dialogue, and summarisation. We calibrate each method on a held-out validation split and evaluate it on 2,000 test instances per task. We find that no single method dominates and performance is highly task-dependent. The ensemble performs best on QA (F1 = 0.792, AUC-ROC = 0.873), the NLI detector leads on dialogue (AUC-ROC = 0.713), and all five methods degrade to near-random performance on summarisation (AUC-ROC between 0.469 and 0.574). This task-dependence and the systematic failure on summarisation map the practical frontier of GPU-free hallucination detection. They give practical guidance for method selection under computational constraints. All experiments run on a standard laptop CPU using public models.

cs.CL

PillarDETR: YOLO-Backbone and RT-DETR Head for Real-Time 3D Object Detection

Real-time 3D object detection is a critical component for the safe operation of autonomous driving systems and robotics. While LiDAR point clouds provide accurate spatial information, processing them efficiently remains a significant challenge. Traditional methods rely on complex 3D convolutions or anchor-based paradigms that struggle to balance detection accuracy with inference speed. In this paper, we propose PillarDETR, a novel end-to-end 3D object detection architecture that combines the efficiency of pillar-based LiDAR encoding with the representational power of modern 2D vision models. Specifically, PillarDETR replaces standard convolutional backbones with a Cross Stage Partial (CSP) network derived from YOLOv8, enabling richer feature extraction from pseudoimages. Furthermore, we discard conventional anchor-based or center-based detection heads in favor of a Real-Time Detection Transformer (RT-DETR) decoder. This hybrid design allows the network to capture global context and directly predict 3D bounding boxes without relying on non-maximum suppression (NMS). Extensive experiments on the KITTI and nuScenes benchmarks demonstrate that PillarDETR achieves a compelling trade-off between mean Average Precision (mAP) and inference latency. Our ablation studies confirm that integrating the YOLOv8 backbone and RT-DETR head yields substantial improvements over the PointPillars baseline, establishing PillarDETR as a highly effective solution for real-time 3D perception.

cs.CV

Going beyond density functional theory accuracy: Leveraging experimental data to refine pre-trained machine learning interatomic potentials

Machine learning interatomic potentials (MLIPs) are inherently limited by the accuracy of the training data, usually consisting of energies and forces obtained from quantum mechanical calculations, such as density functional theory (DFT). Since DFT itself is based on several approximations, MLIPs may inherit systematic errors that lead to discrepancies with experimental data. In this paper, we use a trajectory re-weighting technique to refine DFT pre-trained MLIPs to match the target experimental Extended X-ray Absorption Fine Structure (EXAFS) spectra. EXAFS spectra are sensitive to the local structural environment around an absorbing atom. Thus, refining an MLIP to improve agreement with experimental EXAFS spectra also improves the MLIP prediction of other structural properties that are not directly involved in the refinement process. We combine this re-weighting technique with transfer learning and a minimal number of training epochs to avoid overfitting to the limited experimental data. The refinement approach demonstrates significant improvement for two MLIPs reported in previous work, one for an established nuclear fuel: uranium dioxide (UO2) and second one for a nuclear fuel candidate: uranium mononitride (UN). We validate the effectiveness of our approach by comparing the results obtained from the original (unrefined) DFT-based MLIP and the EXAFS-refined MLIP across various properties, such as lattice parameters, bulk modulus, heat capacity, point defect energies, elastic constants, phonon dispersion spectra, and diffusion coefficients. An accurate MLIP for nuclear fuels is extremely beneficial as it enables reliable atomistic simulation, which greatly reduces the need for large number of expensive and inherently dangerous experimental nuclear integral tests, traditionally required for the qualification of efficient and resilient fuel candidates.

cond-mat.mtrl-sci