SearcharxivSearch

arXiv subjects

Bahram Jalali

Publications and source records attributed to Bahram Jalali.

At least 19 recordsLinked to original sources

Standardizing Medical Images at Scale for AI

Deep learning has achieved remarkable success in medical image analysis, yet its performance remains highly sensitive to the heterogeneity of clinical data. Differences in imaging hardware, staining protocols, and acquisition conditions produce substantial domain shifts that degrade model generalization across institutions. Here we present a physics-based data preprocessing framework based on the PhyCV (Physics-Inspired Computer Vision) family of algorithms, which standardizes medical images through deterministic transformations derived from optical physics. The framework models images as spatially varying optical fields that undergo a virtual diffractive propagation followed by coherent phase detection. This process suppresses non-semantic variability such as color and illumination differences while preserving diagnostically relevant texture and structural features. When applied to histopathological images from the Camelyon17-WILDS benchmark, PhyCV preprocessing improves out-of-distribution breast-cancer classification accuracy from 70.8% (Empirical Risk Minimization baseline) to 90.9%, matching or exceeding data-augmentation and domain-generalization approaches at negligible computational cost. Because the transform is physically interpretable, parameterizable, and differentiable, it can be deployed as a fixed preprocessing stage or integrated into end-to-end learning. These results establish PhyCV as a generalizable data refinery for medical imaging-one that harmonizes heterogeneous datasets through first-principles physics, improving robustness, interpretability, and reproducibility in clinical AI systems.

eess.IV

Physical Data Embedding for Memory Efficient AI

Deep neural networks (DNNs) have achieved exceptional performance across various fields by learning complex, nonlinear mappings from large-scale datasets. However, they face challenges such as high memory requirements and computational costs with limited interpretability. This paper introduces an approach where master equations of physics are converted into multilayered networks that are trained via backpropagation. The resulting general-purpose model effectively encodes data in the properties of the underlying physical system. In contrast to existing methods wherein a trained neural network is used as a computationally efficient alternative for solving physical equations, our approach directly treats physics equations as trainable models. We demonstrate this physical embedding concept with the Nonlinear Schrödinger Equation (NLSE), which acts as trainable architecture for learning complex patterns including nonlinear mappings and memory effects from data. The network embeds data representation in orders of magnitude fewer parameters than conventional neural networks when tested on time series data. Notably, the trained "Nonlinear Schrödinger Network" is interpretable, with all parameters having physical meanings. This interpretability offers insight into the underlying dynamics of the system that produced the data. The proposed method of replacing traditional DNN feature learning architectures with physical equations is also extended to the Gross-Pitaevskii Equation, demonstrating the broad applicability of the framework to other master equations of physics. Among our results, an ablation study quantifies the relative importance of physical terms such as dispersion, nonlinearity, and potential energy for classification accuracy. We also outline the limitations of this approach as it relates to generalizability.

cs.LG

Time Stretch with Continuous-Wave Lasers

A single-shot measurement technique for ultrafast phenomena with high throughput enables the capture of rare events within a short time scale, facilitating the exploration of rare ultrafast processes. Photonic time stretch stands out as a highly effective method for both detecting rapid events and achieving remarkable speed in imaging and ranging applications. The current time stretch method relies on costly passive mode-locked lasers with continuous and fixed spectra to capture fast transients and dilate their time scale using dispersion. This hinders the broad application of time stretch technology and presents synchronization challenges with ultrafast events for measurement. Here we report the first implementation of time stretch using continuous wave (CW) diode lasers with discrete and tunable spectra that are common in WDM optical communication. This approach offers the potential for more cost-effective and compact time stretch systems and simplifies laser synchronization with the input signal. Two different embodiments in the United States and Japan demonstrate the technique's operation and limitations, and potential applications to time stretch imaging and angular light scattering.

physics.optics

PhyCV: The First Physics-inspired Computer Vision Library

PhyCV is the first computer vision library which utilizes algorithms directly derived from the equations of physics governing physical phenomena. The algorithms appearing in the current release emulate, in a metaphoric sense, the propagation of light through a physical medium with natural and engineered diffractive properties followed by coherent detection. Unlike traditional algorithms that are a sequence of hand-crafted empirical rules or deep learning algorithms that are usually data-driven and computationally heavy, physics-inspired algorithms leverage physical laws of nature as blueprints for inventing algorithms. PhyCV features low-dimensionality and high- efficiency, making it ideal for edge computing applications. We demonstrate real-time video processing on NVIDIA Jetson Nano using PhyCV. In addition, these algorithms have the potential to be implemented in real physical devices for fast and efficient computation in the form of analog computing. The open-sourced code is available at https://github.com/JalaliLabUCLA/phycv

eess.IV

Low Latency Computing for Time Stretch Instruments

Time stretch instruments have been exceptionally successful in discovering single-shot ultrafast phenomena such as optical rogue waves and have led to record-speed microscopy, spectroscopy, lidar, etc. These instruments encode the ultrafast events into the spectrum of a femtosecond pulse and then dilate the time scale of the data using group velocity dispersion. Generating as much as Tbit per second of data, they are ideal partners for deep learning networks which by their inherent complexity, require large datasets for training. However, the inference time scale of neural networks in the millisecond regime is orders of magnitude longer than the data acquisition rate of time stretch instruments. This underscores the need to explore means where some of the lower-level computational tasks can be done while the data is still in the optical domain. The Nonlinear Schrödinger Kernel computing addresses this predicament. It utilizes optical nonlinearities to map the data onto a new domain in which classification accuracy is enhanced, without increasing the data dimensions. One limitation of this technique is the fixed optical transfer function, which prevents training and generalizability. Here we show that the optical kernel can be effectively tuned and trained by utilizing digital phase encoding of the femtosecond laser pulse leading to a reduction of the error rate in data classification.

physics.optics

VEViD: Vision Enhancement via Virtual diffraction and coherent Detection

The history of computing started with analog computers consisting of physical devices performing specialized functions such as predicting the trajectory of cannon balls. In modern times, this idea has been extended, for example, to ultrafast nonlinear optics serving as a surrogate analog computer to probe the behavior of complex phenomena such as rogue waves. Here we discuss a new paradigm where physical phenomena coded as an algorithm perform computational imaging tasks. Specifically, diffraction followed by coherent detection, not in its analog realization but when coded as an algorithm, becomes an image enhancement tool. Vision Enhancement via Virtual diffraction and coherent Detection (VEViD) introduced here reimagines a digital image as a spatially varying metaphoric light field and then subjects the field to the physical processes akin to diffraction and coherent detection. The term "Virtual" captures the deviation from the physical world. The light field is pixelated and the propagation imparts a phase with an arbitrary dependence on frequency which can be different from the quadratic behavior of physical diffraction. Temporal frequencies exist in three bands corresponding to the RGB color channels of a digital image. The phase of the output, not the intensity, represents the output image. VEViD is a high-performance low-light-level and color enhancement tool that emerges from this paradigm. The algorithm is interpretable and computationally efficient. We demonstrate image enhancement of 4k video at 200frames per second and show the utility of this physical algorithm in improving the accuracy of object detection by neural networks without having to retrain model for low-light conditions. The application of VEViD to color enhancement is also demonstrated.

eess.IV

Phase Diversity Electro-optic Sampling: A new approach to single-shot terahertz waveform recording

THz spectroscopy is an emerging tool for detection of microorganisms and harmful compounds in the food industry, the study of proteins in biomedicine and the development of electron-beam X-ray sources for molecular imaging and lithography. Recording of THz electric field evolution in single-shot is crucially needed in terahertz spectroscopy of irreversible processes in such applications as well as for data communication in the THz portion of the spectrum where there is an abundance of untapped bandwidth. However, achieving sub-picosecond resolution over a long time window has been an open problem for electro-optic sampling -- the standard technique for recording terahertz waveforms. We introduce a new conceptual framework for this open problem that is inspired by time-stretch theory. The novel framework unveils a solution to this 20 year-old problem leading to a dramatic enhancement of the achievable temporal resolution. We validate this new technology in two applications. First, we present single shot recordings of long free-propagating terahertz transients with record time resolution. Second, we present recordings of ultra-short relativistic electron bunches at the European X-ray Free Electron Laser. These results show that electric signals may be now recorded with terahertz bandwidth over arbitrarily long windows, thus enabling the realization of "single-shot terahertz oscilloscopes" and single-shot time-domain spectroscopy systems with an arbitrary time-bandwidth product.

physics.optics

Phase-Stretch Adaptive Gradient-Field Extractor (PAGE)

Phase-Stretch Adaptive Gradient-Field Extractor (PAGE) is an edge detection algorithm that is inspired by physics of electromagnetic diffraction and dispersion. A computational imaging algorithm, it identifies edges, their orientations and sharpness in a digital image where the image brightness changes abruptly. Edge detection is a basic operation performed by the eye and is crucial to visual perception. PAGE embeds an original image into a set of feature maps that can be used for object representation and classification. The algorithm performs exceptionally well as an edge and texture extractor in low light level and low contrast images. This manuscript is prepared to support the open-source code which is being simultaneously made available within the GitHub repository https://github.com/JalaliLabUCLA/Phase-Stretch-Adaptive-Gradient-field-Extractor/.

eess.IV

Physics-AI Symbiosis

The phenomenal success of physics in explaining nature and designing hardware is predicated on efficient computational models. A universal codebook of physical laws defines the computational rules and a physical system is an interacting ensemble governed by these rules. Led by deep neural networks, artificial intelligence (AI) has introduced an alternate end-to-end data-driven computational framework, with astonishing performance gains in image classification and speech recognition and fueling hopes for a novel approach to discovering physics itself. These gains, however, come at the expense of interpretability and also computational efficiency; a trend that is on a collision course with the expected end of semiconductor scaling known as the Moore's Law. With focus on photonic applications, this paper argues how an emerging symbiosis of physics and artificial intelligence can overcome such formidable challenges, thereby not only extending the latter's spectacular rise but also transforming the direction of physical science.

cs.ET

Nonlinear Schrödinger Kernel for hardware acceleration in machine learning inference

Alternative machine learning approaches that are computationally light with low latency and can work with only a small training dataset are needed for applications where the insatiable demand of deep learning methods for computing power and large training data cannot be met. We show that spectral mapping of data onto femtosecond optical pulses and a projection into an implicit, higher dimensional space using nonlinear optical dynamics increases the accuracy and reduces the latency in data classification by several orders of magnitude. The approach is validated by the classification of various datasets, including brain intracranial pressure, cancer cell imaging, spoken digit recognition, and the classic exclusive OR benchmark for nonlinear classification. The concept is demonstrated by seeding the nonlinear dynamics that are responsible for many fascinating natural phenomena, such as optical rogue waves, with the data before processing the output with a light classifier. A quantitative comparison with a well-known numerical technique is used to provide insight into this physical technique. Single-shot operation is demonstrated using time stretch data acquisition.

physics.optics

Deep Learning Interference Cancellation in Wireless Networks

With the crowding of the electromagnetic spectrum and the shrinking cell size in wireless networks, crosstalk between base stations and users is a major problem. Although hand-crafted functional blocks and coding schemes are proven effective to guarantee reliable data transfer, currently deep learning-based approaches have drawn increasing attention in the communication system modeling. In this paper, we propose a Neural Network (NN) based signal processing technique that works with traditional DSP algorithms to overcome the interference problem in realtime. This technique doesn't require any feedback protocol between the receiver and transmitter which makes it very suitable for low-latency and high data-rate applications such as autonomy and augmented reality. While there has been recent work on the use of Reinforcement Learning (RL) in the control layer to manage and control the interference, our approach is novel in the sense that it introduces a neural network for signal processing at baseband data rate and in the physical layer. We demonstrate this "Deep Interference Cancellation" technique using a convolutional LSTM autoencoder. When applied to QAM-OFDM modulated data, the network produces significant improvement in the symbol error rate (SER). We further discuss the hardware implementation including latency, power consumption, memory requirements, and chip area.

eess.SP

Deep Analog-to-Digital Converter for Wireless Communication

With the advent of the 5G wireless networks, achieving tens of gigabits per second throughputs and low, milliseconds, latency has become a reality. This level of performance will fuel numerous real-time applications, such as autonomy and augmented reality, where the computationally heavy tasks can be performed in the cloud. The increase in the bandwidth along with the use of dense constellations places a significant burden on the speed and accuracy of analog-to-digital converters (ADC). A popular approach to create wideband ADCs is utilizing multiple channels each operating at a lower speed in the time-interleaved fashion. However, an interleaved ADC comes with its own set of challenges. The parallel architecture is very sensitive to the inter-channel mismatch, timing jitter, clock skew between different ADC channels as well as the nonlinearity within individual channels. Consequently, complex post-calibration is required using digital signal processing (DSP) after the ADC. The traditional DSP calibration consumes a significant amount of power and its design requires knowledge of the source and type of errors which are becoming increasingly difficult to predict in nanometer CMOS processes. In this paper, instead of individually targeting each source of error, we utilize a deep learning algorithm to learn the complete and complex ADC behavior and to compensate for it in realtime. We demonstrate this "Deep ADC" technique on an 8G Sample/s 8-channel time-interleaved ADC with the QAM-OFDM modulated data. Simulation results for different QAM symbol constellations and OFDM subcarriers show dramatic improvements of approximately 5 bits in the dynamic range with a concomitant drastic reduction in symbol error rate. We further discuss the hardware implementation including latency, power consumption, memory requirements, and chip area.

eess.SP

Spectro-temporal encoded Multiphoton Microscopy

Two-Photon Microscopy has become an invaluable tool for biological and medical research, providing high sensitivity, molecular specificity, inherent three-dimensional sub-cellular resolution and deep tissue penetration. In terms of imaging speeds, however, mechanical scanners still limit the acquisition rates to typically 10-100 frames per second. Here we present a high-speed non-linear microscope achieving kilohertz frame rates by employing pulse-modulated, rapidly wavelength-swept lasers and inertia-free beam steering through angular dispersion. In combination with a high bandwidth, single-photon sensitive detector, we achieve recording of fluorescent lifetimes at unprecedented speeds of 88 million pixels per second. We show diffraction-limited, multi-modal, Two-Photon fluorescence and fluorescence lifetime (FLIM), microscopy and imaging flow cytometry with a digitally reconfigurable laser, imaging system and data acquisition system. These unprecedented speeds should enable high-speed and high-throughput image-assisted cell sorting.

physics.ins-det

Deep Cytometry: Deep learning with Real-time Inference in Cell Sorting and Flow Cytometry

Deep learning has achieved spectacular performance in image and speech recognition and synthesis. It outperforms other machine learning algorithms in problems where large amounts of data are available. In the area of measurement technology, instruments based on the photonic time stretch have established record real-time measurement throughput in spectroscopy, optical coherence tomography, and imaging flow cytometry. These extreme-throughput instruments generate approximately 1 Tbit/s of continuous measurement data and have led to the discovery of rare phenomena in nonlinear and complex systems as well as new types of biomedical instruments. Owing to the abundance of data they generate, time-stretch instruments are a natural fit to deep learning classification. Previously we had shown that high-throughput label-free cell classification with high accuracy can be achieved through a combination of time-stretch microscopy, image processing and feature extraction, followed by deep learning for finding cancer cells in the blood. Such a technology holds promise for early detection of primary cancer or metastasis. Here we describe a new deep learning pipeline, which entirely avoids the slow and computationally costly signal processing and feature extraction steps by a convolutional neural network that directly operates on the measured signals. The improvement in computational efficiency enables low-latency inference and makes this pipeline suitable for cell sorting via deep learning. Our neural network takes less than a few milliseconds to classify the cells, fast enough to provide a decision to a cell sorter for real-time separation of individual target cells. We demonstrate the applicability of our new method in the classification of OT-II white blood cells and SW-480 epithelial cancer cells with more than 95% accuracy in a label-free fashion.

q-bio.QM

Foveated Time Stretch

Given prior knowledge of the spectral statistics, the SNR of optical waveforms can be manipulated in a reversible manner. We introduce this concept and discuss its potential application to encryption and context-aware detection of weak signals in noisy environments. The same technology performs single shot sparse sampling for optical data compression.

physics.optics

Optical Companding

We introduce a new nonlinear analog optical computing concept that compresses the signal's dynamic range and realizes non-uniform quantization that reshapes and improves the signal-to-noise ratio in the digital domain.

physics.optics

The Temporal Gearbox

We are inspired by mechanical gearboxes and demonstrate its analog counterpart in optics. We use nonlinear dispersion modes as "gears" to overcome the mismatch between the ultrahigh speed of optical data and the much slower sampling rate of electronic digitizers and processors. We delineate the mathematical foundations and show its utility in ultrafast optical measurements and digital image compression.

physics.optics