arXiv subjects

Baolei Liu

Publications and source records attributed to Baolei Liu.

At least 19 recordsLinked to original sources

arXiv2026

Hessian sparsity-constrained self-supervised network for near-infrared single-photon single-pixel imaging

Near-infrared (NIR) imaging has emerged as an important technology for night vision, remote sensing, and biological imaging, yet conventional array-detector-based systems are often limited by insufficient sensitivity, high cost, and substantial dark noise. Single-pixel imaging (SPI) offers an attractive alternative, enabling single-photon-level NIR imaging by using a cost-effective single-element detector. Nevertheless, SPI remains restricted by photon noise, leading to degraded imaging quality and limited frame rate under extremely low photon flux conditions. Here, we present a Hessian sparsity-constrained self-supervised network (HS3N) for single-photon NIR SPI, which can suppress noise and enable high-fidelity and real-time imaging under ultra-low illumination conditions. The HS3N integrates the physical forward model of SPI with an untrained neural network regularized by both sparsity priors and Hessian-based structural constraints, enabling effective noise suppression while preserving structural fidelity and continuity. Both simulated and experimental results demonstrate that HS3N enables high-fidelity reconstructions under ultra-low NIR photon levels down to ~0.01 photons per pixel. Furthermore, we demonstrate its dynamic capability by monitoring the dynamic evolution and detachment of infrared-absorbing droplets, at a frame rate of ~20 Hz under ~0.19 photons per pixel, highlighting its potential for high-sensitivity infrared inspection. The proposed reconstruction framework paves the way for practical NIR imaging in extreme low light conditions, which can be extended to visible, mid-infrared or terahertz imaging, offering broad potential for photon-efficient sensing across a wide spectral range.

physics.optics↗

arXiv2026

Ultrasensitive infrared-to-visible artificial vision via self-evolving projection guided by single-pixel detection

Infrared detection and visualization are essential for augmenting human perception across diverse fields, ranging from night vision to industrial inspection and bio-imaging. Conventional infrared cameras are often hindered by high cost, bulky architecture, and complex fabrication requirements. Upconversion sensing systems offer a pixel-free and cost-effective alternative solution by upconverting infrared photons into visible-light signals. However, existing upconversion systems suffer from limitations such as high operating voltages, low quantum efficiency, which prevent their applications in photon-starved environments. Here, we report self-evolving infrared-to-visible upconversion with single-pixel detection (SIVIS) that enables real-time upconverted visualization under photon-starved conditions by integrating self-evolving projection with single-pixel sensing. SIVIS iteratively optimizes illumination patterns with a digital micromirror device based on real-time feedback from a single-pixel infrared detector. This self-evolving process enables the autonomous reconstruction of the target's geometric profile. Simultaneously, it projects a co-modulated visible beam onto the object itself or an adjacent screen, rendering the infrared target directly perceptible to the naked eye in real-time. SIVIS achieves sensing and projection without latency under an ultra-low infrared detection limit of 0.11 photons per pixel per frame (sub-pW -cm2 level) benefited from the high sensitivity. Furthermore, we also validate SIVIS to decrypt infrared-encoded anti-counterfeiting features and visualize vascular-like structures embedded within biological tissues. This photon-feedback-driven artificial vision framework offers a scalable and adaptive solution for ultrasensitive infrared vision, opening promising avenues for night vision, biomedical imaging, and sensing under extreme low-light conditions.

physics.optics↗

arXiv2026

Compressive hyperspectral phasor imaging with single-pixel detection for spectral tasks

Spectral vision task plays a pivotal role in extracting discriminative spectral-spatial features from high-dimensional data, enabling fine-grained identification beyond human vision. Traditional methods usually involve first collecting rich spectral-spatial information and then using complex algorithms to digitally process it into scene classification and recognition. However, the complexity of processing massive three-dimensional (3D) hyperspectral datasets poses challenges for algorithms. Here, we demonstrate a compressive Hyperspectral Phasor Imaging with Single-pixel detection (HyPIS) that leverages highly compressed spatial-spectral data to achieve spectral task. Two optical encoders are used for wavelength-dependent sine- and cosine-encoding that transforms spectral signals into a two-dimensional (2D) phasor plot. By applying spatial-temporal illumination patterns, a single-pixel detector is enough to reconstruct the phasor image of the object. This allows to directly generate pixel-wise spectral task, bypassing 3D hyperspectral data. Our experiments show that HyPIS can perform real-time classification and recognition tasks of different scenes, reducing the required amount of data by two orders of magnitude, and it can still accurately classify under low light and uneven lighting conditions. This work develops a completely new spectral technology that enables spectral tasks to be performed without obtaining high-resolution hyperspectral datasets, holding promise for spectral applications in mobile devices, robotics, and satellite technologies.

physics.optics↗

arXiv2026

Harnessing Non-Boltzmann Steady States in Lanthanide Nanocrystals for Mid-Infrared Optoelectronics

Converting mid-infrared (MIR) radiation to visible or near-infrared wavelengths is essential for imaging and sensing, yet achieving sensitive, low-power, and scalable detection remains challenging. Lanthanide nanocrystals provide an alternative through ratiometric luminescence but are typically constrained by Boltzmann statistics, which tie population distributions to lattice temperature and limit signal contrast. Here we show that MIR irradiation rebalances dissipative relaxation pathways, driving lanthanide emitters into a non-Boltzmann steady state that enables non-thermal control of population distributions. This allows emission behaviors inaccessible under thermal equilibrium. We exploit this regime to achieve linear MIR detection with respect to MIR power across 6.8 to 8.6 micrometers. The ratiometric response is intrinsically independent of the pump power, enabling operation at an ultralow excitation power of 10 uW, several orders of magnitude lower than conventional approaches. Using standard silicon photodetectors, we then demonstrate room-temperature MIR imaging with detection limits approaching 4 nW um-2. Our results establish lanthanide nanoparticles as an efficient platform for MIR conversion and sensing in nanophotonic systems.

physics.optics↗

arXiv2025

Physics-informed neural network enhanced multispectral single-pixel imaging with a chip spectral sensor

Multispectral imaging (MSI) captures data across multiple spectral bands, offering enhanced informational depth compared to standard RGB imaging and benefiting diverse fields such as agriculture, medical diagnostics, and industrial inspection. Conventional MSI systems, however, suffer from high cost, complexity, and limited performance in low-light conditions. Moreover, data-driven MSI methods depend heavily on large, labeled training datasets and struggle with generalization. In this work, we present a portable multispectral single-pixel imaging (MS-SPI) method that integrates a chip-sized multispectral sensor for system miniaturization and leverages an untrained physics-informed neural network (PINN) to reconstruct high-quality spectral images without the need for labeled training data. The physics-informed structure of the network enables the self-corrected reconstruction of multispectral images directly with the input of raw measurements from the multispectral sensor. Our proof-of-concept prototype achieves the reconstruction of 12-channel high-quality spectral images at the sampling rate of 10%. We also experimentally validate its performance under varying sampling rate conditions, by comparing it with conventional compressive sensing algorithms. Furthermore, we demonstrate the application of this technique to an MSI-based image segmentation task, in which spatial regions are discriminated according to their characteristic spectral signatures. This compact, high-fidelity, and portable approach offers promising pathways to lightweight and cost-effective spectral imaging on mobile platforms.

physics.ins-det↗

arXiv2025

Reconfigurable miniaturized computational spectrometer enabled by photoelastic effect

Miniatured computational spectrometers, distinguished by their compact size and lightweight, have shown great promise for on-chip and portable applications in the fields of healthcare, environmental monitoring, food safety, and industrial process monitoring. However, the common miniaturization strategies predominantly rely on advanced micro-nano fabrication and complex material engineering, limiting their scalability and affordability. Here, we present a broadband miniaturized computational spectrometer (ElastoSpec) by leveraging the photoelastic effect for easy-to-prepare and reconfigurable implementations. A single computational photoelastic spectral filter, with only two polarizers and a plastic sheet, is designed to be integrated onto the top of a CMOS sensor for snapshot spectral acquisition. The different spectral modulation units are directly generated from different spatial locations of the filter, due to the photoelastic-induced chromatic polarization effect of the plastic sheet. We experimentally demonstrate that ElastoSpec offers excellent reconstruction accuracy for the measurement of both simple narrowband and complex spectra. It achieves a full width at half maximum (FWHM) error of approximately 0.2 nm for monochromatic inputs, and maintains a mean squared error (MSE) value on the order of 10^-3 with only 10 spectral modulation units. Furthermore, we develop a reconfigurable strategy for enhanced spectra sensing performance through the flexibility in optimizing the modulation effectiveness and the number of spectral modulation units. This work avoids the need for complex micro-nano fabrication and specialized materials for the design of computational spectrometers, thus paving the way for the development of simple, cost-effective, and scalable solutions for on-chip and portable spectral sensing devices.

physics.optics↗

arXiv2025

Exploiting scattering-based point spread functions for snapshot 5D and modality-switchable lensless imaging

Snapshot multi-dimensional imaging offers a promising alternative to traditional low-dimensional imaging techniques by enabling the simultaneous capture of spatial, spectral, polarization, and other information in a single shot for improved imaging speed and acquisition efficiency. However, existing snapshot multi-dimensional imaging systems are often hindered by their large size, complexity, and high cost, which constrain their practical applicability. In this work, we propose a compact lensless diffuser camera for snapshot multi-dimensional imaging (Diffuser-mCam), which can reconstruct five-dimensional (5-D) images from a single-shot 2D recording of speckle-like measurement under incoherent illumination. By employing both the scattering medium and the space-division multiplexing strategy to extract high-dimensional optical features, we show that the multi-dimensional data (2D intensity distribution, spectral, polarization, time) of the desired light field can be encoded into a snapshot speckle-like pattern via a diffuser, and subsequently decoded using a compressed sensing algorithm at the sampling rate of 2.5%, eliminating the need for multi-scanning processes. We further demonstrate that our method can be flexibly switched between 5D and selectively reduced-dimensional imaging, providing an efficient way of reducing computational resource demands. Our work presents a compact, cost-effective, and versatile framework for snapshot multi-dimensional imaging and opens up new opportunities for the design of novel imaging systems for applications in areas such as medical imaging, remote sensing, and autonomous systems.

physics.optics↗

arXiv2024

Multi-photon super-linear image scanning microscopy using upconversion nanoparticles

Super-resolution fluorescence microscopy is of great interest in life science studies for visualizing subcellular structures at the nanometer scale. Among various kinds of super-resolution approaches, image scanning microscopy (ISM) offers a doubled resolution enhancement in a simple and straightforward manner, based on the commonly used confocal microscopes. ISM is also suitable to be integrated with multi-photon microscopy techniques, such as two-photon excitation and second-harmonic generation imaging, for deep tissue imaging, but it remains the twofold limited resolution enhancement and requires expensive femtosecond lasers. Here, we present and experimentally demonstrate the super-linear ISM (SL-ISM) to push the resolution enhancement beyond the factor of two, with a single low-power, continuous-wave, and near-infrared laser, by harnessing the emission nonlinearity within the multiphoton excitation process of lanthanide-doped upconversion nanoparticles (UCNPs). Based on a modified confocal microscope, we achieve a resolution of about 120 nm, 1/8th of the excitation wavelength. Furthermore, we demonstrate a parallel detection strategy of SL-ISM with the multifocal structured excitation pattern, to speed up the acquisition frame rate. This method suggests a new perspective for super-resolution imaging or sensing, multi-photon imaging, and deep-tissue imaging with simple, low-cost, and straightforward implementations.

physics.optics↗

arXiv2024

Miniaturized on-chip spectrometer enabled by electrochromic modulation

Miniaturized on-chip spectrometers with small footprints, lightweight, and low cost are in great demand for portable optical sensing, lab-on-chip systems, and so on. Such miniaturized spectrometers are usually based on engineered spectral response units and then reconstruct unknown spectra with algorithms. However, due to the limited footprints of computational on-chip spectrometers, the recovered spectral resolution is limited by the number of integrated spectral response units/filters. Thus, it is challenging to improve the spectral resolution without increasing the number of used filters. Here we present a computational on-chip spectrometer using electrochromic filters that can be electrochemically modulated to increase the efficient sampling number for higher spectral resolution. These filters are directly integrated on top of the photodetector pixels, and the spectral modulation of the filters results from redox reactions during the dual injection of ions and electrons into the electrochromic material. We experimentally demonstrate that the spectral resolution of the proposed spectrometer can be effectively improved as the number of applied voltages increases. The average difference of the peak wavelengths between the reconstructed and the reference spectra decreases from 14.48 nm to 2.57 nm. We also demonstrate the proposed spectrometer can be worked with only four or two filter units, assisted by electrochromic modulation. This strategy suggests a new way to enhance the performance of miniaturized spectrometers with tunable spectral filters for high resolution, low-cost, and portable spectral sensing, and would also inspire the exploration of other stimulus responses such as photochromic and force-chromic, etc, on computational spectrometers.

physics.optics↗

arXiv2023

Temporal compressive edge imaging enabled by a lensless diffuser camera

Lensless imagers based on diffusers or encoding masks enable high-dimensional imaging from a single shot measurement and have been applied in various applications. However, to further extract image information such as edge detection, conventional post-processing filtering operations are needed after the reconstruction of the original object images in the diffuser imaging systems. Here, we present the concept of a temporal compressive edge detection method based on a lensless diffuser camera, which can directly recover a time sequence of edge images of a moving object from a single-shot measurement, without further post-processing steps. Our approach provides higher image quality during edge detection, compared with the conventional post-processing method. We demonstrate the effectiveness of this approach by both numerical simulation and experiments. The proof-of-concept approach can be further developed with other image post-process operations or versatile computer vision assignments toward task-oriented intelligent lensless imaging systems.

eess.IV↗

arXiv2023

Quantitative and dark field ghost imaging with ultraviolet light

Ultraviolet (UV) imaging enables a diverse array of applications, such as material composition analysis, biological fluorescence imaging, and detecting defects in semiconductor manufacturing. However, scientific-grade UV cameras with high quantum efficiency are expensive and include a complex thermoelectric cooling system. Here, we demonstrate a UV computational ghost imaging (UV-CGI) method to provide a cost-effective UV imaging and detection strategy. By applying spatial-temporal illumination patterns and using a 325 nm laser source, a single-pixel detector is enough to reconstruct the images of objects. To demonstrate its capability for quantitative detection, we use UV-CGI to distinguish four UV-sensitive sunscreen areas with different densities on a sample. Furthermore, we demonstrate dark field UV-CGI in both transmission and reflection schemes. By only collecting the scattered light from objects, we can detect the edges of pure phase objects and small scratches on a compact disc. Our results showcase a feasible low-cost solution for non-destructive UV imaging and detection. By combining it with other imaging techniques, such as hyperspectral imaging or time-resolved imaging, a compact and versatile UV computational imaging platform may be realized for future applications.

physics.optics↗

arXiv2023

Dual-mode adaptive-SVD ghost imaging

In this paper, we present a dual-mode adaptive singular value decomposition ghost imaging (A-SVD GI), which can be easily switched between the modes of imaging and edge detection. It can adaptively localize the foreground pixels via a threshold selection method. Then only the foreground region is illuminated by the singular value decomposition (SVD) - based patterns, consequently retrieving high-quality images with fewer sampling ratios. By changing the selecting range of foreground pixels, the A-SVD GI can be switched to the mode of edge detection to directly reveal the edge of objects, without needing the original image. We investigate the performance of these two modes through both numerical simulations and experiments. We also develop a single-round scheme to halve measurement numbers in experiments, instead of separately illuminating positive and negative patterns in traditional methods. The binarized SVD patterns, generated by the spatial dithering method, are modulated by a digital micromirror device (DMD) to speed up the data acquisition. This dual-mode A-SVD GI can be applied in various applications, such as remote sensing or target recognition, and could be further extended for multi-modality functional imaging/detection.

eess.IV↗

arXiv2022

Exploiting dynamic nonlinearity in upconversion nanoparticles for super-resolution imaging

Single-beam super-resolution microscopy, also known as superlinear microscopy, exploits the nonlinear response of fluorescent probes in confocal microscopy. The technique requires no complex purpose-built system, light field modulation, or beam shaping. Here, we present a strategy to enhance spatial resolution of superlinear microscopy by modulating excitation intensity during image acquisition. This modulation induces dynamic optical nonlinearity in upconversion nanoparticles (UCNPs), resulting in variations of higher spatial-frequency information in the obtained images. The high-order information can be extracted with a proposed weighted finite difference imaging algorithm from raw fluorescence images, to generate an image with a higher resolution than superlinear microscopy images. We apply this approach to resolve two adjacent nanoparticles within a diffraction-limited area, improving the resolution to 130 nm. This work suggests a new scope for developing dynamic nonlinear fluorescent probes in super-resolution nanoscopy.

physics.optics↗

arXiv2021

Single-pixel diffuser camera

We present a compact, diffuser-assisted, single-pixel computational camera. A rotating ground glass diffuser is adopted, in preference to a commonly used digital micro-mirror device (DMD), to encode a two-dimensional (2D) image into single-pixel signals. We retrieve images with an 8.8% sampling ratio after the calibration of the pseudo-random pattern of the diffuser under incoherent illumination. Furthermore, we demonstrate hyperspectral imaging with line array detection by adding a diffraction grating. The implementation results in a cost-effective single-pixel camera for high-dimensional imaging, with potential for imaging in non-visible wavebands.

physics.optics↗

arXiv2021

Multiplexed structured illumination super-resolution imaging with time-domain upconversion nanoparticles

The emerging optical multiplexing within nanoscale shows super-capacity in encoding information by using the time-domain fingerprints from uniform nanoparticles. However, the optical diffraction limit compromises the decoding throughput and accuracy of the nanoparticles during wide-field imaging. This, in turn, challenges the quality of nanoparticles to afford the modulated excitation condition, and further to retain the multiplexed optical fingerprints for super-resolution multiplexing. Here we report a tailor-made time-domain super-resolution method with the lifetime-engineered upconversion nanoparticles for multiplexing. We demonstrate that the nanoparticles are bright, uniform, and stable under structured illumination, which supports a lateral resolution of 186 nm, less than 1/4th of the excitation wavelength. We further develop a deep learning algorithm to coordinate with super-resolution images for more accurate decoding compared to a numeric algorithm. We demonstrate a three-channel sub-diffraction-limit imaging-based optical multiplexing with decoding accuracies above 93% for each channel, and larger than 60% accuracies for potential seven-channel multiplexing. The improved resolution provides high throughput by resolving the particles within the optical limit, which enables higher multiplexing capacity in space. This time-domain super-resolution multiplexing opens a new horizon for handling the growing amount of information content, diseases source, and security risk in modern society

physics.optics↗

arXiv2020

Heterochromatic nonlinear optical responses in upconversion nanoparticles for point spread function engineering

Point spread function (PSF) engineering of the emitter can code higher spatial frequency information of an image to break diffraction limit but suffer from the complexed optical systems. Here we present a robust strategy to simultaneously achieve diverse PSFs from upconversion nanoparticles under a single doughnut-shape scanning beam. By saturating the four-photon state, the high-frequency information can be extracted through the doughnut emission PSF. In contrast, the complementary lower frequency information can be carried out by the Gaussian-like emission PSF, as a result of over-saturated at the two-photon state. With the Fourier domain heterochromatic fusion, we verify the capability of the synthesised PSF to cover both low and high-frequency information, yielding the overall enhanced image quality. We show a spatial resolution of 40 nm, 1/24th of the excitation wavelength. This work suggests a new scope for developing nonlinear multi-colour emitting probes to improve image quality and noise control in nanoscopy.

physics.optics↗

arXiv2020

Wide-field Decodable Orthogonal Fingerprints of Single Nanoparticles Unlock Multiplexed Digital Assays

The control in optical uniformity of single nanoparticles and tuning their diversity in orthogonal dimensions, dot to dot, holds the key to unlock nanoscience and applications. Here we report that the time-domain emissive profile from single upconversion nanoparticle, including the rising, decay and peak moment of the excited state population (T2 profile), can be arbitrarily tuned by upconversion schemes, including interfacial energy migration, concentration dependency, energy transfer, and isolation of surface quenchers. This allows us to significantly increase the coding capacity at the nanoscale. We further implement both time-resolved wide-field imaging and deep-learning techniques to decode these fingerprints, showing high accuracies at high throughput. These high-dimensional optical fingerprints provide a new horizon for applications spanning from sub-diffraction-limit data storage, security inks, to high-throughput single-molecule digital assays and super-resolution imaging.

physics.app-ph↗

arXiv2020

Self-evolving ghost imaging

Ghost imaging can capture 2D images with a point detector instead of an array sensor. It therefore offers a solution to the challenge of building area format sensors in wavebands where such sensors are difficult and expensive to produce and opens up new imaging modalities due to high-performance single-pixel detectors. Traditionally, ghost imaging retrieves the image of an object offline, by correlating measured light intensities and applied illuminating patterns. Here we present a feedback-based approach for online updating of the imaging result that can bypass post-processing, termed self-evolving ghost imaging (SEGI). We introduce a genetic algorithm to optimize the illumination patterns in real-time to match the objects shape according to the measured total light intensity. We theoretically and experimentally demonstrate this concept for static and dynamic imaging. This method opens new perspectives for real-time ghost imaging in applications such as remote sensing (e.g. machine vision, LiDAR systems in autonomous vehicles) and biological imaging.

eess.IV↗