SearcharxivSearch

arXiv subjects

Sambit Mohapatra

Publications and source records attributed to Sambit Mohapatra.

13 recordsLinked to original sources

Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks

Autonomous driving perception demands accurate and efficient processing of three-dimensional sensor data under strict power constraints. Traditional convolutional neural networks achieve strong detection accuracy but are computationally intensive, limiting their suitability for deployment on resource-constrained neuromorphic platforms. Spiking neural networks offer a compelling alternative through event-driven sparse computation, yet their application to complex real-world perception tasks such as three-dimensional object detection remains limited. In this work, we propose an end-to-end spiking encoder-decoder network for object detection in bird's eye view representations of LiDAR point clouds, trained using surrogate gradient backpropagation. We train two variants: a membrane potential variant that reads continuous neuron state at the output stage for maximum accuracy, achieving $92.05$/$87.04$/$86.51$ AP at $\mathrm{IoU}\!=\!0.5$ (Easy/Moderate/Hard), and, a fully binary spiking variant that operates exclusively on spike trains at every layer for direct neuromorphic deployment. We evaluate four input spike encoding strategies and demonstrate that allowing the network to learn spike representations directly from data outperforms hand-crafted Poisson, latency, and z-axis encoding schemes on the KITTI benchmark, where sequential frames are unavailable and the BEV input is presented repeatedly across timesteps as a proxy for temporal streaming. A block-wise energy analysis demonstrates a $3.33\times$ reduction in synaptic operation energy over an equivalent CNN under conservative loop-based operation. Together, these results demonstrate the viability of spiking neural networks for accurate and energy-efficient neuromorphic perception in autonomous driving.

cs.CV

Thermal transport mapping in twisted double bilayer graphene

Two-dimensional (2D) materials have attracted significant interest due to their tunable physical properties when stacked into homo- and hetero-structures. Twisting adjacent layers introduces moir\'{e} patterns that strongly influence the material electronic and thermal behavior. In twisted graphene systems, the twist angle critically alters phonon transport, leading to reduced thermal conductivity compared to Bernal-stacked configurations. However, experimental investigations into thermal transport in twisted structures remain limited. Here, we study the local thermal properties of twisted double bilayer graphene (TDBG) using Scanning Thermal Microscopy (SThM). We find an increase in thermal resistance of $0.3 \pm 0.1 \times 10^6 KW^{-1}$ compared to untwisted bilayers, attributed to changes in both intrinsic thermal conductivity and the tip-sample interface. These results, supported by analytical modeling, provide new insight into thermal transport mechanisms in twisted 2D systems and offer a pathway toward thermal engineering in twistronic devices.

cond-mat.mes-hall

Quantifying the local mechanical properties of twisted double bilayer graphene

Nanomechanical measurements of minimally twisted van der Waals materials remained elusive despite their fundamental importance for device realisation. Here, we use Ultrasonic Force Microscopy (UFM) to locally quantify the variation of out-of-plane Young's modulus in minimally twisted double bilayer graphene (TDBG). We reveal a softening of the Young's modulus by 7\% and 17\% along single and double domain walls, respectively. Our experimental results are confirmed by force-field relaxation models. This study highlights the strong tunability of nanomechanical properties in engineered twisted materials, and paves the way for future applications of designer 2D nanomechanical systems.

cond-mat.mes-hall

LiDAR-BEVMTN: Real-Time LiDAR Bird's-Eye View Multi-Task Perception Network for Autonomous Driving

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion estimation using LiDAR remains relatively unexplored, especially on automotive-grade embedded platforms. We present a real-time multi-task convolutional neural network for LiDAR-based object detection, semantics, and motion segmentation. The unified architecture comprises a shared encoder and task-specific decoders, enabling joint representation learning. We propose a novel Semantic Weighting and Guidance (SWAG) module to transfer semantic features for improved object detection selectively. Our heterogeneous training scheme combines diverse datasets and exploits complementary cues between tasks. The work provides the first embedded implementation unifying these key perception tasks from LiDAR point clouds achieving 3ms latency on the embedded NVIDIA Xavier platform. We achieve state-of-the-art results for two tasks, semantic and motion segmentation, and close to state-of-the-art performance for 3D object detection. By maximizing hardware efficiency and leveraging multi-task synergies, our method delivers an accurate and efficient solution tailored for real-world automated driving deployment. Qualitative results can be seen at https://youtu.be/H-hWRzv2lIY.

cs.CV

SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Driving

Spiking Neural Networks are a recent and new neural network design approach that promises tremendous improvements in power efficiency, computation efficiency, and processing latency. They do so by using asynchronous spike-based data flow, event-based signal generation, processing, and modifying the neuron model to resemble biological neurons closely. While some initial works have shown significant initial evidence of applicability to common deep learning tasks, their applications in complex real-world tasks has been relatively low. In this work, we first illustrate the applicability of spiking neural networks to a complex deep learning task namely Lidar based 3D object detection for automated driving. Secondly, we make a step-by-step demonstration of simulating spiking behavior using a pre-trained convolutional neural network. We closely model essential aspects of spiking neural networks in simulation and achieve equivalent run-time and accuracy on a GPU. When the model is realized on a neuromorphic hardware, we expect to have significantly improved power efficiency.

cs.CV

Toward accurate polarization estimation in nanoscopic systems

The nanoscopic characterization of ferroelectric thin films is crucial from their device application point of view. Standard characterization techniques are based on detecting the nanoscopic charge compensation current (switching current) caused by the polarization reversal in the ferroelectric. Owing to various surface and bulk limited mechanisms, leakage currents commonly appear during such measurements, which are frequently subtracted using the device I-V characteristic by employing positive-up-negative-down (PUND) measurement scheme. By performing nanoscopic switching current measurements on a commonly used ferroelectric, BiFeO3, we show that such characterization methods may be prone to large errors in the polarization estimation on ferro-resistive samples, due to current background subtraction issues. Especially, when ferro-resistive behavior is associated with the polarization reversal of the ferroelectric thin film, background current subtraction is not accurate due to the mismatch of the I-V characteristics for the two polarization states. We show instead that removing the background current by an asymmetric least squares subtraction method, though not perfect, gives a much better estimation of the ferroelectric properties of the sample under study.

cond-mat.mtrl-sci

LiMoSeg: Real-time Bird's Eye View based LiDAR Motion Segmentation

Moving object detection and segmentation is an essential task in the Autonomous Driving pipeline. Detecting and isolating static and moving components of a vehicle's surroundings are particularly crucial in path planning and localization tasks. This paper proposes a novel real-time architecture for motion segmentation of Light Detection and Ranging (LiDAR) data. We use three successive scans of LiDAR data in 2D Bird's Eye View (BEV) representation to perform pixel-wise classification as static or moving. Furthermore, we propose a novel data augmentation technique to reduce the significant class imbalance between static and moving objects. We achieve this by artificially synthesizing moving objects by cutting and pasting static vehicles. We demonstrate a low latency of 8 ms on a commonly used automotive embedded platform, namely Nvidia Jetson Xavier. To the best of our knowledge, this is the first work directly performing motion segmentation in LiDAR BEV space. We provide quantitative results on the challenging SemanticKITTI dataset, and qualitative results are provided in https://youtu.be/2aJ-cL8b0LI.

cs.CV

Organic ferroelectric Croconic Acid: A concise survey from bulk single crystals to thin films

Owing to prospective energy-efficient and environmentally benign applications, organic ferroelectric materials are useful and necessary alternative to inorganic ferroelectrics. Although the first discovered ferroelectric, Rochelle salt, was a salt of an organic compound, organic ferroelectrics have not been as abundant as the inorganic ones. Further, the small polarization values in the organic systems discovered so far have been a demotivating factor for their applications. However, scientific interest and activities surrounding such materials, for the purpose of fundamental understanding and practical applications, have significantly risen lately, especially after the discovery of above-room-temperature ferroelectricity in croconic acid (4,5-dihydroxy-4-cyclopentene-1,2,3-trione, H2C5O5) crystals with polarization values rivalling those found in inorganic ferroelectrics. Its large polarization, organic nature, and vacuum sublimability make croconic acid an ideal candidate for non-toxic and lead-free device applications. In this review article, we survey the scientific activities carried out so far involving ferroelectricity in this novel material, paying equal attention to its bulk single crystal and thin film forms. While we discuss about the origin of ferroelectric order and the reversal of polarization in the bulk form, we also summarize the directions toward applications of the thin films.

cond-mat.mtrl-sci

BEVDetNet: Bird's Eye View LiDAR Point Cloud based Real-time 3D Object Detection for Autonomous Driving

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on embedded systems from the perspective of latency and power efficiency. For high speed driving scenarios, latency is a crucial parameter as it provides more time to react to dangerous situations. Typically a voxel or point-cloud based 3D convolution approach is utilized for this module. Firstly, they are inefficient on embedded platforms as they are not suitable for efficient parallelization. Secondly, they have a variable runtime due to level of sparsity of the scene which is against the determinism needed in a safety system. In this work, we aim to develop a very low latency algorithm with fixed runtime. We propose a novel semantic segmentation architecture as a single unified model for object center detection using key points, box predictions and orientation prediction using binned classification in a simpler Bird's Eye View (BEV) 2D representation. The proposed architecture can be trivially extended to include semantic segmentation classes like road without any additional computation. The proposed model has a latency of 4 ms on the embedded Nvidia Xavier platform. The model is 5X faster than other top accuracy models with a minimal accuracy degradation of 2% in Average Precision at IoU=0.5 on KITTI dataset.

cs.CV

Nanoscale reversal of stable room temperature ferroelectric polarization in organic croconic acid thin films

It was discovered in 2010 that Croconic Acid, in its crystal form, has the highest polarization among organic ferroelectrics. In the context of eliminating toxic substances from electronic devices, Croconic Acid has a great potential as a sublimable lead-free ferroelectric. However, studies on ferroelectric properties of its thin films are only in their early stages and its capability to be incorporated in nanoscale devices is unknown. In this work, we demonstrate, upon ferroelectric switching at the nanoscale, stable and enduring room temperature polarization with no leakage current in Croconic Acid thin films. We thus show that it is a promising lead-free organic ferroelectric toward integration in nanoscale devices. The challenging switching current and polarization reversal characterization at the nanoscale was done using a unique combination of piezoresponse force microscopy, polarization switching current spectroscopy and the concurrent electromechanical strain response. Indeed, this combination can help to rationalize otherwise asymmetric polarization-voltage data and distorted hysteresis due to current jumps below the background noise, which are statistically washed away in macrojunctions but become prevalent at the nanoscale. These results are valid irrespective of the ferroelectrics' nature, organic or inorganic. Beyond the potential of Croconic Acid as an ecological ferroelectric material in devices, our detection of a clear nanoscopic polarization switching current thus paves the way for a fundamental understanding and technological applications of the polarization reversal mechanism at the nanoscale.

physics.app-ph

Quantum advantage in a molecular spintronic engine that harvests thermal fluctuation energy

Recent theory and experiments have showcased how to harness quantum mechanics to assemble heat/information engines with efficiencies that surpass the classical Carnot limit. So far, this has required atomic engines that are driven by cumbersome external electromagnetic sources. Here, using molecular spintronics, we propose an implementation that is both electronic and autonomous. Our spintronic quantum engine heuristically deploys several known quantum assets by having a chain of spin qubits formed by the paramagnetic Co centers of phthalocyanine (Pc) molecules electronically interact with electron-spin selecting Fe/C60 interfaces. Density functional calculations reveal that transport fluctuations across the interface can stabilize spin coherence on the Co paramagnetic centers, which host spin flip processes. Across vertical molecular nanodevices, we measure enduring dc current generation, output power above room temperature, two quantum thermodynamical signatures of the engine's processes, and a record 89% spin polarization of current across the Fe/C60 interface. It is crucially this electron spin selection that forces, through demonic feedback and control, charge current to flow against the built-in potential barrier. Further research into spintronic quantum engines, insight into the quantum information processes within spintronic technologies, and retooling the spintronic-based information technology chain, could help accelerate the transition to clean energy.

cond-mat.mes-hall

Robust ferroelectric properties of organic Croconic Acid films grown on spintronically relevant substrates

The discovery of stable room temperature ferroelectricity in Croconic Acid, an organic ferroelectric material, with polarization values on par with those found in inorganic ferroelectric materials and highest among organic ferroelectric materials, has opened up possibilities to realize myriads of nano-electronic and spintronic devices based on organic ferroelectrics. Such possibilities require an adequate understanding of the ferroelectric properties of Croconic Acid grown on surfaces that are commonly employed in device fabrication. While several macroscopic studies on relatively larger crystals of Croconic Acid have been performed, studies on thin films are only in their early stages. We have grown thin films of Croconic Acid on gold and cobalt surfaces, which are commonly used in spintronic devices as metallic electrodes, and studied the ferroelectric response of the films using ex-situ Piezoresponse Force Microscopy at room temperature. We show that the polarization reversal in Croconic Acid domains is sensitive to the substrate surface. Using the same experimental protocol, we observe the robust polarization reversal of a single, mostly in-plane electrical domain for a cobalt substrate, whereas polarization reversal is hardly observed for a gold substrate. We attribute this difference to the influence of substrates on the Croconic Acid molecular networks. Our study suggests that to realize devices one has to take care about the substrate on which Croconic Acid will be deposited. The fact that polarization switching is robust on cobalt surface can be used to fabricate multifunctional devices that utilize the cobalt-Croconic Acid interface.

cond-mat.mtrl-sci

Exploring Deep Spiking Neural Networks for Automated Driving Applications

Neural networks have become the standard model for various computer vision tasks in automated driving including semantic segmentation, moving object detection, depth estimation, visual odometry, etc. The main flavors of neural networks which are used commonly are convolutional (CNN) and recurrent (RNN). In spite of rapid progress in embedded processors, power consumption and cost is still a bottleneck. Spiking Neural Networks (SNNs) are gradually progressing to achieve low-power event-driven hardware architecture which has a potential for high efficiency. In this paper, we explore the role of deep spiking neural networks (SNN) for automated driving applications. We provide an overview of progress on SNN and argue how it can be a good fit for automated driving applications.

cs.NE