Searcharxiv⌕ Search

arXiv subjects

Zhenming Yu

Publications and source records attributed to Zhenming Yu.

15 recordsLinked to original sources
arXiv2025

Integrated diffractive full-Stokes spectro-polarimetric imaging

Spectro-polarimetric imaging provides multidimensional optical information acquisition capabilities, offering significant potential for diverse applications. Current spectro-polarimetric imaging systems typically suffer from large physical footprints, high design complexity, elevated costs, or the drawback of requiring replacement of standard components with polarization optics. To address these issues, we propose an integrated diffractive full-Stokes spectro-polarimetric imaging framework that synergistically combines end-to-end designed diffractive polarization spectral element (DPSE) with SPMSA-Net to demonstrate high-performance spectro-polarimetric imaging. The DPSE modulates scene and generates modulated images carrying phase-encoding and polarization information. The modulated images are the input of the SPMSA-NET for the reconstruction of the spectro-polarimetric data cube. The framework achieves an average improvement of 0.78 dB in PSNR and 0.012 in SSIM over existing state-of-the-art algorithms. Based on this framework, our prototype system can simultaneously capture spectral information (400-700 nm) with 10 nm spectral resolution and full-Stokes parameters (S0,S1,S2,S3). Meanwhile, the system provides high spatial resolution of 2252*2252 pixels. Experimental results demonstrate that our system achieves high-fidelity spectral imaging (over 98.9% fidelity) and precise polarization characterization, with a compact architecture (modulation component of merely 2-mm thickness).

eess.IV↗
arXiv2025

Robust End-to-End FSO Transmission with Joint Coding Modulation and BiLSTM-Based Channel Modeling under Atmospheric Turbulence

Free space optical (FSO) communication is considered a promising solution in next_generation communication networks. However, its performance is significantly influenced by atmospheric turbulence. To enhance system robustness to turbulence, we propose a turbulence_robust end_to_end FSO communication system (TRFSO) that integrates a data-driven channel model with joint source_channel coding modulation (JSCCM). Specifically, a bidirectional long short-term memory (BiLSTM)_based channel model is developed and trained on data collected over a physical FSO link under varying turbulence conditions. This model accurately captures real_world channel distortions, achieving a minimum Kullback_Leibler (KL) divergence of 0.0019 in amplitude distribution matching. Experimental results show that the TRFSO system trained with the BiLSTM_based channel model outperforms the same architecture trained under the additive white Gaussian noise (AWGN) channel, achieving an average 3.5 dB improvement in multi-scale structural similarity (MS_SSIM) under strong atmospheric turbulence. These results demonstrate the effectiveness of the proposed TRFSO in achieving robust and reliable transmission under dynamic atmospheric turbulence.

physics.optics↗
arXiv2025

Broadband Near-Infrared Compressive Spectral Imaging System with Reflective Structure

Near-infrared (NIR) hyperspectral imaging has become a critical tool in modern analytical science. However, conventional NIR hyperspectral imaging systems face challenges including high cost, bulky instrumentation, and inefficient data collection. In this work, we demonstrate a broadband NIR compressive spectral imaging system that is capable of capturing hyperspectral data covering a broad spectral bandwidth ranging from 700 to 1600 nm. By segmenting wavelengths and designing specialized optical components, our design overcomes hardware spectral limitations to capture broadband data, while the reflective optical structure makes the system compact. This approach provides a novel technical solution for NIR hyperspectral imaging.

eess.IV↗
arXiv2025

Spatial-enhanced Reflective Coded Aperture Snapshot Spectral Imaging

Coded aperture snapshot hyperspectral imaging (CASSI) system which captures 2-D spatial information and 1-D spectral information in just one or two shots has become a promising technology to capture hyperspectral image (HSI). However, previous CASSI have shortcomings such as poor spatial resolution and low light efficiency that hinder their further applications. In this paper, we propose a spatial-enhanced reflective coded aperture snapshot spectral imaging system (SE-RCASSI). The system achieves superior spatial results and high light efficiency because of its specially designed structure. Then, we propose Spatial-enhanced Network (SEnet) which takes full use of the prior information of grayscale image to boost the reconstruction quality and can serve as an image fusion framework to deploy different algorithms. Furthermore, we propose hybrid prior strategy (HPS) to effectively exploit the broad-scope prior of training set and narrow-scope prior of measurements, resulting in improved generalization and performance of the network. Finally, we fabricate the prototype of SE-RCASSI and conduct experiments in different environments. Both experimental results and numerical simulations show the outstanding performance of our method.

physics.optics↗
arXiv2024

Integration of Communication and Computational Imaging

Communication enables the expansion of human visual perception beyond the limitations of time and distance, while computational imaging overcomes the constraints of depth and breadth. Although impressive achievements have been witnessed with the two types of technologies, the occlusive information flow between the two domains is a bottleneck hindering their ulterior progression. Herein, we propose a novel framework that integrates communication and computational imaging (ICCI) to break through the inherent isolation between communication and computational imaging for remote perception. By jointly considering the sensing and transmitting of remote visual information, the ICCI framework performs a full-link information transfer optimization, aiming to minimize information loss from the generation of the information source to the execution of the final vision tasks. We conduct numerical analysis and experiments to demonstrate the ICCI framework by integrating communication systems and snapshot compressive imaging systems. Compared with straightforward combination schemes, which sequentially execute sensing and transmitting, the ICCI scheme shows greater robustness against channel noise and impairments while achieving higher data compression. Moreover, an 80 km 27-band hyperspectral video perception with a rate of 30 fps is experimentally achieved. This new ICCI remote perception paradigm offers a highefficiency solution for various real-time computer vision tasks.

eess.IV↗
arXiv2024

Atmospheric Turbulence-Immune Free Space Optical Communication System based on Discrete-Time Analog Transmission

To effectively mitigate the influence of atmospheric turbulence, a novel discrete-time analog transmission free-space optical (DTAT-FSO) communication scheme is proposed. It directly maps information sources to discrete-time analog symbols via joint source-channel coding and modulation. Differently from traditional digital free space optical (TD-FSO) schemes, the proposed DTAT-FSO approach can automatically adapt to the variation of the channel state, with no need to adjust the specific modulation and coding scheme. The performance of the DTAT-FSO system was evaluated in both intensity modulation/direct detection (IM/DD) and coherent FSO systems for high-resolution image transmission. The results show that the DTAT-FSO reliably transmits images at low received optical powers (ROPs) and automatically enhances quality at high ROPs, while the TD-FSO experiences cliff and leveling effects when the channel state varies. With respect to the TD-FSO scheme, the DTAT-FSO scheme improved receiver sensitivity by 2.5 dB in the IM/DD FSO system and 0.8 dB in the coherent FSO system, and it achieved superior image fidelity under the same ROP. The automatic adaptation feature and improved performance of the DTAT-FSO suggest its potential for terrestrial, airborne, and satellite optical networks, addressing challenges posed by atmospheric turbulence.

eess.SP↗
arXiv2024

The Ouroboros of Memristors: Neural Networks Facilitating Memristor Programming

Memristive devices hold promise to improve the scale and efficiency of machine learning and neuromorphic hardware, thanks to their compact size, low power consumption, and the ability to perform matrix multiplications in constant time. However, on-chip training with memristor arrays still faces challenges, including device-to-device and cycle-to-cycle variations, switching non-linearity, and especially SET and RESET asymmetry. To combat device non-linearity and asymmetry, we propose to program memristors by harnessing neural networks that map desired conductance updates to the required pulse times. With our method, approximately 95% of devices can be programmed within a relative percentage difference of +-50% from the target conductance after just one attempt. Our approach substantially reduces memristor programming delays compared to traditional write-and-verify methods, presenting an advantageous solution for on-chip training scenarios. Furthermore, our proposed neural network can be accelerated by memristor arrays upon deployment, providing assistance while reducing hardware overhead compared with previous works. This work contributes significantly to the practical application of memristors, particularly in reducing delays in memristor programming. It also envisions the future development of memristor-based machine learning accelerators.

cs.ET↗
arXiv2024

Integration of Physics-Derived Memristor Models with Machine Learning Frameworks

Simulation frameworks such MemTorch, DNN+NeuroSim, and aihwkit are commonly used to facilitate the end-to-end co-design of memristive machine learning (ML) accelerators. These simulators can take device nonidealities into account and are integrated with modern ML frameworks. However, memristors in these simulators are modeled with either lookup tables or simple analytic models with basic nonlinearities. These simple models are unable to capture certain performance-critical aspects of device nonidealities. For example, they ignore the physical cause of switching, which induces errors in switching timings and thus incorrect estimations of conductance states. This work aims at bringing physical dynamics into consideration to model nonidealities while being compatible with GPU accelerators. We focus on Valence Change Memory (VCM) cells, where the switching nonlinearity and SET/RESET asymmetry relate tightly with the thermal resistance, ion mobility, Schottky barrier height, parasitic resistance, and other effects. The resulting dynamics require solving an ODE that captures changes in oxygen vacancies. We modified a physics-derived SPICE-level VCM model, integrated it with the aihwkit simulator and tested the performance with the MNIST dataset. Results show that noise that disrupts the SET/RESET matching affects network performance the most. This work serves as a tool for evaluating how physical dynamics in memristive devices affect neural network accuracy and can be used to guide the development of future integrated devices.

cs.ET↗
arXiv2023

High-Conductance, Ohmic-like HfZrO$_4$ Ferroelectric Memristor

The persistent and switchable polarization of ferroelectric materials based on HfO$_2$-based ferroelectric compounds, compatible with large-scale integration, are attractive synaptic elements for neuromorphic computing. To achieve a record current density of 0.01 A/cm$^2$ (at a read voltage of 80 mV) as well as ideal memristive behavior (linear current-voltage relation and analog resistive switching), devices based on an ultra-thin (2.7 nm thick), polycrystalline HfZrO$_4$ ferroelectric layer are fabricated by Atomic Layer Deposition. The use of a semiconducting oxide interlayer (WO$_{x<3}$) at one of the interfaces, induces an asymmetric energy profile upon ferroelectric polarization reversal and thus the long-term potentiation / depression (conductance increase / decrease) of interest. Moreover, it favors the stable retention of both the low and the high resistive states. Thanks to the low operating voltage (<3.5 V), programming requires less than 10${^-12}$ J for 20 ns long pulses. Remarkably, the memristors show no wake-up or fatigue effect.

cs.AR↗
arXiv2022

Semantic optical fiber communication system

The current optical communication systems minimize bit or symbol errors without considering the semantic meaning behind digital bits, thus transmitting a lot of unnecessary information. We propose and experimentally demonstrate a semantic optical fiber communication (SOFC) system. Instead of encoding information into bits for transmission, semantic information is extracted from the source using deep learning. The generated semantic symbols are then directly transmitted through an optical fiber. Compared with the bit-based structure, the SOFC system achieved higher information compression and a more stable performance, especially in the low received optical power regime, and enhanced the robustness against optical link impairments. This work introduces an intelligent optical communication system at the human analytical thinking level, which is a significant step toward a breakthrough in the current optical communication architecture.

eess.SP↗
arXiv2021

Self-supervised Neural Networks for Spectral Snapshot Compressive Imaging

We consider using {\bf\em untrained neural networks} to solve the reconstruction problem of snapshot compressive imaging (SCI), which uses a two-dimensional (2D) detector to capture a high-dimensional (usually 3D) data-cube in a compressed manner. Various SCI systems have been built in recent years to capture data such as high-speed videos, hyperspectral images, and the state-of-the-art reconstruction is obtained by the deep neural networks. However, most of these networks are trained in an end-to-end manner by a large amount of corpus with sometimes simulated ground truth, measurement pairs. In this paper, inspired by the untrained neural networks such as deep image priors (DIP) and deep decoders, we develop a framework by integrating DIP into the plug-and-play regime, leading to a self-supervised network for spectral SCI reconstruction. Extensive synthetic and real data results show that the proposed algorithm without training is capable of achieving competitive results to the training based networks. Furthermore, by integrating the proposed method with a pre-trained deep denoising prior, we have achieved state-of-the-art results. {Our code is available at \url{https://github.com/mengziyi64/CASSI-Self-Supervised}.}

eess.IV↗
arXiv2021

Principle-driven Fiber Transmission Model based on PINN Neural Network

In this paper, a novel principle-driven fiber transmission model based on physical induced neural network (PINN) is proposed. Unlike data-driven models which regard fiber transmission problem as data regression tasks, this model views it as an equation solving problem. Instead of adopting input signals and output signals which are calculated by SSFM algorithm in advance before training, this principle-driven PINN based fiber model adopts frames of time and distance as its inputs and the corresponding real and imaginary parts of NLSE solutions as its outputs. By taking into account of pulses and signals before transmission as initial conditions and fiber physical principles as NLSE in the design of loss functions, this model will progressively learn the transmission rules. Therefore, it can be effectively trained without the data labels, referred as the pre-calculated signals after transmission in data-driven models. Due to this advantage, SSFM algorithm is no longer needed before the training of principle-driven fiber model which can save considerable time consumption. Through numerical demonstration, the results show that this principle-driven PINN based fiber model can handle the prediction tasks of pulse evolution, signal transmission and fiber birefringence for different transmission parameters of fiber telecommunications.

eess.SP↗
arXiv2018

Intelligent optical performance monitor using multi-task learning based artificial neural network

An intelligent optical performance monitor using multi-task learning based artificial neural network (MTL-ANN) is designed for simultaneous OSNR monitoring and modulation format identification (MFI). Signals' amplitude histograms (AHs) after constant module algorithm are selected as the input features for MTL-ANN. The experimental results of 20-Gbaud NRZ-OOK, PAM4 and PAM8 signals demonstrate that MTL-ANN could achieve OSNR monitoring and MFI simultaneously with higher accuracy and stability compared with single-task learning based ANNs (STL-ANNs). The results show an MFI accuracy of 100% and OSNR monitoring root-mean-square error of 0.63 dB for the three modulation formats under consideration. Furthermore, the number of neuron needed for the single MTL-ANN is almost the half of STL-ANN, which enables reduced-complexity optical performance monitoring devices for real-time performance monitoring.

eess.SP↗
arXiv2016

High-speed real-time single-pixel microscopy based on Fourier sampling

Single-pixel cameras based on the concepts of compressed sensing (CS) leverage the inherent structure of images to retrieve them with far fewer measurements and operate efficiently over a significantly broader spectral range than conventional silicon-based cameras. Recently, photonic time-stretch (PTS) technique facilitates the emergence of high-speed single-pixel cameras. A significant breakthrough in imaging speed of single-pixel cameras enables observation of fast dynamic phenomena. However, according to CS theory, image reconstruction is an iterative process that consumes enormous amounts of computational time and cannot be performed in real time. To address this challenge, we propose a novel single-pixel imaging technique that can produce high-quality images through rapid acquisition of their effective spatial Fourier spectrum. We employ phase-shifting sinusoidal structured illumination instead of random illumination for spectrum acquisition and apply inverse Fourier transform to the obtained spectrum for image restoration. We evaluate the performance of our prototype system by recognizing quick response (QR) codes and flow cytometric screening of cells. A frame rate of 625 kHz and a compression ratio of 10% are experimentally demonstrated in accordance with the recognition rate of the QR code. An imaging flow cytometer enabling high-content screening with an unprecedented throughput of 100,000 cells/s is also demonstrated. For real-time imaging applications, the proposed single-pixel microscope can significantly reduce the time required for image reconstruction by two orders of magnitude, which can be widely applied in industrial quality control and label-free biomedical imaging.

cs.CV↗