Searcharxiv⌕ Search

arXiv subjects

Leyla A. Kabuli

Publications and source records attributed to Leyla A. Kabuli.

7 recordsLinked to original sources

RTLViT: real-time lensless reconstruction with a lightweight vision transformer

Mask-based lensless imagers capture measurements using simple, compact hardware and recover images using a reconstruction algorithm. The reconstruction algorithm affects the image quality, inference speed, and computational requirements of the imaging system, often trading off image quality against computational efficiency. Advancing toward integrated lensless imagers, where encoding and reconstruction occur within a single device (e.g., a mobile phone), requires a fast, high-quality, and practical reconstruction method. We introduce the Real-Time Lensless Vision Transformer (RTLViT), a lightweight, purely data-driven reconstruction architecture for high-quality and real-time lensless reconstruction. With only 1.09 million learnable parameters, RTLViT provides higher-quality reconstructions than both real-time baselines and substantially larger attention-based architectures, including improvements of up to 3.46 dB in peak signal-to-noise ratio over architectures with $15 \times$ more learnable parameters. We demonstrate that RTLViT maintains high-quality reconstructions across a wide range of training dataset sizes and two different mask designs (lenslets and a diffuser). Finally, we implement real-time reconstruction with RTLViT on laptops and smartphones, supporting future integrated lensless imagers for real-time applications.

physics.optics↗

ConvRML: high-quality lensless imaging with random multi-focal lenslets

Mask-based lensless imagers use simple optics and computational reconstruction to design compact form factor cameras with compressive imaging ability. However, these imagers generally suffer from poor reconstruction quality. Here, we describe several advances in both hardware and software that result in improved lensless imaging quality. First, we use a precision-manufactured random multi-focal lenslet (RML) phase mask to produce improved measurements with reduced multiplexing. Next, we implement a ConvNeXt-based reconstruction architecture, which provides up to 4.6 dB improvement in peak signal-to-noise ratio over state-of-the-art attention-based architectures. Finally, we establish a parallel imaging setup that simultaneously images a scene with RML, diffuser, and lens systems, with which we collect datasets with 100,000 measurements for each system, to be used for reconstruction model training and evaluation. Using this standardized system, we quantify the improved measurement quality of the RML compared to a diffuser using the modulation transfer function and mutual information. Our ConvRML system benefits from both the optical and the computational developments presented in this work, and our contributions establish resources to support the continued development of high-quality, compact, and compressive lensless imagers.

physics.optics↗

Correcting Fabrication-Induced Curvature in Micromirror-Based Spatial Light Modulators with a Microlens Array

Computer generated holography requires high-speed spatial light modulators (SLMs) for dynamically patterning light in 3D. Piston-motion micromirror-based SLMs support high-speed ($\geq$ 10 kHz) phase modulation; however, fabricating micromirror arrays with sufficient fill factor necessary for high diffraction efficiency is challenging. In particular, the larger mirrors of high fill factor designs are susceptible to stress-induced curvature that significantly degrades optical performance. In this work, we introduce an optical compensation method using a pitch-matched microlens array (MLA) to focus light onto just the center of each mirror. Our approach thus avoids curvature-induced artifacts and improves optical fill factor to nearly 100$\%$, independent of the original mechanical fill factor. Through simulations and experiments on a fabricated micromirror array with bowed mirrors, we show that the Pearson correlation coefficient of the imparted phase profile is improved from 0.11 to 0.85 and the brightness of a holographically-generated single spot is enhanced by 8$\times$ with our microlens array in place. Our hybrid optical-electromechanical strategy thus provides a scalable path toward high-speed, high-fidelity wavefront control for applications such as adaptive optics, holographic displays, and optogenetics.

physics.optics↗

Designing lensless imaging systems to maximize information capture

Mask-based lensless imaging uses an optical encoder (e.g. a phase or amplitude mask) to capture measurements, then a computational decoding algorithm to reconstruct images. In this work, we evaluate and design lensless encoders based on the information content of their measurements using mutual information estimation. Our approach formalizes the object-dependent nature of lensless imaging and quantifies the interdependence between object sparsity, encoder multiplexing, and noise. Our analysis reveals that optimal encoder designs should tailor encoder multiplexing to object sparsity for maximum information capture, and that all optimally-encoded measurements share the same level of sparsity. Using mutual information-based optimization, we design information-optimal encoders for compressive imaging of fixed object distributions. Our designs demonstrate improved downstream reconstruction performance for objects in the distribution, without requiring joint optimization with a specific reconstruction algorithm. We validate our approach experimentally by evaluating lensless imaging systems directly from captured measurements, without the need for image formation models, reconstruction algorithms, or ground truth data. Our comprehensive analysis establishes design and engineering principles for lensless imaging systems, and offers a model for the study of general multiplexing systems, especially those with object-dependent performance.

physics.optics↗

Scalable dataset acquisition for data-driven lensless imaging

Data-driven developments in lensless imaging, such as machine learning-based reconstruction algorithms, require large datasets. In this work, we introduce a data acquisition pipeline that can capture from multiple lensless imaging systems in parallel, under the same imaging conditions, and paired with computational ground truth registration. We provide an open-access 25,000 image dataset with two lensless imagers, a reproducible hardware setup, and open-source camera synchronization code. Experimental datasets from our system can enable data-driven developments in lensless imaging, such as machine learning-based reconstruction algorithms and end-to-end system design.

eess.IV↗

Estimation-theoretic analysis of lensless imaging

We analyze lensless imaging systems with estimation-theoretic techniques based on Fisher information. Our analysis evaluates multiple optical encoder designs on objects with varying sparsity, in the context of both Gaussian and Poisson noise models. Our simulations verify that lensless imaging system performance is object-dependent and highlight tradeoffs between encoder multiplexing and object sparsity, showing quantitatively that sparse objects tolerate higher levels of multiplexing than dense objects. Insights from our analysis promise to inform and improve optical encoder designs for lensless imaging.

eess.IV↗

Automotive Elevation Mapping with Interferometric Synthetic Aperture Radar

Radar is a low-cost and ubiquitous automotive sensor, but is limited by array resolution and sensitivity when performing direction of arrival analysis. Synthetic Aperture Radar (SAR) is a class of techniques to improve azimuth resolution and sensitivity for radar. Interferometric SAR (InSAR) can be used to extract elevation from the variations in phase measurements in SAR images. Utilizing InSAR we show that a typical, low-resolution radar array mounted on a vehicle can be used to accurately localize detections in 3D space for both urban and agricultural environments. We generate point clouds in each environment by combining InSAR with a signal processing scheme tailored to automotive driving. This low-compute approach allows radar to be used as a primary sensor to map fine details in complex driving environments, and be used to make autonomous perception decisions.

eess.SP↗