arXiv subjects

Zichao Bian

Publications and source records attributed to Zichao Bian.

16 recordsLinked to original sources

arXiv2021

Ptychographic sensor for large-scale lensless microbial monitoring with high spatiotemporal resolution

Traditional microbial detection methods often rely on the overall property of microbial cultures and cannot resolve individual growth event at high spatiotemporal resolution. As a result, they require bacteria to grow to confluence and then interpret the results. Here, we demonstrate the application of an integrated ptychographic sensor for lensless cytometric analysis of microbial cultures over a large scale and with high spatiotemporal resolution. The reported device can be placed within a regular incubator or used as a standalone incubating unit for long-term microbial monitoring. For longitudinal study where massive data are acquired at sequential time points, we report a new temporal-similarity constraint to increase the temporal resolution of ptychographic reconstruction by 7-fold. With this strategy, the reported device achieves a centimeter-scale field of view, a half-pitch spatial resolution of 488 nm, and a temporal resolution of 15-second intervals. For the first time, we report the direct observation of bacterial growth in a 15-second interval by tracking the phase wraps of the recovered images, with high phase sensitivity like that in interferometric measurements. We also characterize cell growth via longitudinal dry mass measurement and perform rapid bacterial detection at low concentrations. For drug-screening application, we demonstrate proof-of-concept antibiotic susceptibility testing and perform single-cell analysis of antibiotic-induced filamentation. The combination of high phase sensitivity, high spatiotemporal resolution, and large field of view is unique among existing microscopy techniques. As a quantitative and miniaturized platform, it can improve studies with microorganisms and other biospecimens at resource-limited settings.

physics.ins-det↗

arXiv2021

Resolution-enhanced parallel coded ptychography for high-throughput optical imaging

Ptychography is an enabling coherent diffraction imaging technique for both fundamental and applied sciences. Its applications in optical microscopy, however, fall short for its low imaging throughput and limited resolution. Here, we report a resolution-enhanced parallel coded ptychography technique achieving the highest numerical aperture and an imaging throughput orders of magnitude greater than previous demonstrations. In this platform, we translate the samples across the disorder-engineered surfaces for lensless diffraction data acquisition. The engineered surface consists of chemically etched micron-level phase scatters and printed sub-wavelength intensity absorbers. It is designed to unlock an optical space with spatial extent (x, y) and frequency content (kx, ky) that is inaccessible using conventional lens-based optics. To achieve the best resolution performance, we also report a new coherent diffraction imaging model by considering both the spatial and angular responses of the pixel readouts. Our low-cost prototype can directly resolve 308-nm linewidth on the resolution target without aperture synthesizing. Gigapixel high-resolution microscopic images with a 240-mm^2 effective field of view can be acquired in 15 seconds. For demonstrations, we recover slow-varying 3D phase objects with many 2π wraps, including optical prism and convex lens. The low-frequency phase contents of these objects are challenging to obtain using other existing lensless techniques. For digital pathology applications, we perform accurate virtual staining by using the recovered phase as attention guidance in a deep neural network. Parallel optical processing using the reported technique enables novel optical instruments with inherent quantitative nature and metrological versatility.

physics.optics↗

arXiv2021

High-throughput lensless whole slide imaging via continuous height-varying modulation of tilted sensor

We report a new lensless microscopy configuration by integrating the concepts of transverse translational ptychography and defocus multi-height phase retrieval. In this approach, we place a tilted image sensor under the specimen for linearly-increasing phase modulation along one lateral direction. Similar to the operation of ptychography, we laterally translate the specimen and acquire the diffraction images for reconstruction. Since the axial distance between the specimen and the sensor varies at different lateral positions, laterally translating the specimen effectively introduces defocus multi-height measurements while eliminating axial scanning. Lateral translation further introduces sub-pixel shift for pixel super-resolution imaging and naturally expands the field of view for rapid whole slide imaging. We show that the equivalent height variation can be precisely estimated from the lateral shift of the specimen, thereby addressing the challenge of precise axial positioning in conventional multi-height phase retrieval. Using a sensor with a 1.67-micron pixel size, our low-cost and field-portable prototype can resolve 690-nm linewidth on the resolution target. We show that a whole slide image of a blood smear with a 120-mm^2 field of view can be acquired in 18 seconds. We also demonstrate accurate automatic white blood cell counting from the recovered image. The reported approach may provide a turnkey solution for addressing point-of-care- and telemedicine-related challenges.

eess.IV↗

arXiv2021

Bypassing the resolution limit of diffractive zone plate optics via rotational Fourier ptychography

Diffractive zone plate optics uses a thin micro-structure pattern to alter the propagation direction of the incoming light wave. It has found important applications in extreme-wavelength imaging where conventional refractive lenses do not exist. The resolution limit of zone plate optics is determined by the smallest width of the outermost zone. In order to improve the achievable resolution, significant efforts have been devoted to the fabrication of very small zone width with ultrahigh placement accuracy. Here, we report the use of a diffractometer setup for bypassing the resolution limit of zone plate optics. In our prototype, we mounted the sample on two rotation stages and used a low-resolution binary zone plate to relay the sample plane to the detector. We then performed both in-plane and out-of-plane sample rotations and captured the corresponding raw images. The captured images were processed using a Fourier ptychographic procedure for resolution improvement. The final achievable resolution of the reported setup is not determined by the smallest width structures of the employed binary zone plate; instead, it is determined by the maximum angle of the out-of-plane rotation. In our experiment, we demonstrated 8-fold resolution improvement using both a resolution target and a titanium dioxide sample. The reported approach may be able to bypass the fabrication challenge of diffractive elements and open up new avenues for microscopy with extreme wavelengths.

physics.optics↗

arXiv2020

Autofocusing technologies for whole slide imaging and automated microscopy

Whole slide imaging (WSI) has moved digital pathology closer to diagnostic practice in recent years. Due to the inherent tissue topography variability, accurate autofocusing remains a critical challenge for WSI and automated microscopy systems. The traditional focus map surveying method is limited in its ability to acquire a high degree of focus points while still maintaining high throughput. Real-time approaches decouple image acquisition from focusing, thus allowing for rapid scanning while maintaining continuous accurate focus. This work reviews the traditional focus map approach and discusses the choice of focus measure for focal plane determination. It also discusses various real-time autofocusing approaches including reflective-based triangulation, confocal pinhole detection, low-coherence interferometry, tilted sensor approach, independent dual sensor scanning, beam splitter array, phase detection, dual-LED illumination, and deep-learning approaches. The technical concepts, merits, and limitations of these methods are explained and compared to those of a traditional WSI system. This review may provide new insights for the development of high-throughput automated microscopy imaging systems that can be made broadly available and utilizable without loss of capacity.

physics.med-ph↗

arXiv2020

Virtual brightfield and fluorescence staining for Fourier ptychography via unsupervised deep learning

Fourier ptychographic microscopy (FPM) is a computational approach geared towards creating high-resolution and large field-of-view images without mechanical scanning. To acquire color images of histology slides, it often requires sequential acquisitions with red, green, and blue illuminations. The color reconstructions often suffer from coherent artifacts that are not presented in regular incoherent microscopy images. As a result, it remains a challenge to employ FPM for digital pathology applications, where resolution and color accuracy are of critical importance. Here we report a deep learning approach for performing unsupervised image-to-image translation of FPM reconstructions. A cycle-consistent adversarial network with multiscale structure similarity loss is trained to perform virtual brightfield and fluorescence staining of the recovered FPM images. In the training stage, we feed the network with two sets of unpaired images: 1) monochromatic FPM recovery, and 2) color or fluorescence images captured using a regular microscope. In the inference stage, the network takes the FPM input and outputs a virtually stained image with reduced coherent artifacts and improved image quality. We test the approach on various samples with different staining protocols. High-quality color and fluorescence reconstructions validate its effectiveness.

eess.IV↗

arXiv2020

Super-resolved multispectral lensless microscopy via angle-tilted, wavelength-multiplexed ptychographic modulation

We report an angle-tilted, wavelength-multiplexed ptychographic modulation approach for multispectral lensless on-chip microscopy. In this approach, we illuminate the specimen with lights at 5 wavelengths simultaneously. A prism is added at the illumination path for spectral dispersion. Lightwaves at different wavelengths, thus, hit the specimen at slightly different incident angles, breaking the ambiguities in mixed state ptychographic reconstruction. At the detection path, we place a thin diffuser in-between the specimen and the monochromatic image sensor for encoding the spectral information into 2D intensity measurements. By scanning the sample to different x-y positions, we acquire a sequence of monochromatic images for reconstructing the 5 complex object profiles at the 5 wavelengths. An up-sampling procedure is integrated into the recovery process to bypass the resolution limit imposed by the imager pixel size. We demonstrate a half-pitch resolution of 0.55 microns using an image sensor with 1.85-micron pixel size. We also demonstrate quantitative and high-quality multispectral reconstructions of stained tissue sections for digital pathology applications.

physics.optics↗

arXiv2020

Wide-field, high-resolution lensless on-chip microscopy via near-field blind ptychographic modulation

We report a novel lensless on-chip microscopy platform based on near-field blind ptychographic modulation. In this platform, we place a thin diffuser in between the object and the image sensor for light wave modulation. By blindly scanning the unknown diffuser to different x-y positions, we acquire a sequence of modulated intensity images for quantitative object recovery. Different from previous ptychographic implementations, we employ a unit magnification configuration with a Fresnel number of ~50,000, which is orders of magnitude higher than previous ptychographic setups. The unit magnification configuration allows us to have the entire sensor area, 6.4 mm by 4.6 mm, as the imaging field of view. The ultra-high Fresnel number enables us to directly recover the positional shift of the diffuser in the phase retrieval process, addressing the positioning accuracy issue plagued in regular ptychographic experiments. In our implementation, we use a low-cost, DIY scanning stage to perform blind diffuser modulation. Precise mechanical scanning that is critical in conventional ptychography experiments is no longer needed in our setup. We further employ an up-sampling phase retrieval scheme to bypass the resolution limit set by the imager pixel size and demonstrate a half-pitch resolution of 0.78 micron. We validate the imaging performance via in vitro cell cultures, transparent and stained tissue sections, and a thick biological sample. We show that the recovered quantitative phase map can be used to perform effective cell segmentation of the dense yeast culture. We also demonstrate 3D digital refocusing of the thick biological sample based on the recovered wavefront. The reported platform provides a cost-effective and turnkey solution for large field-of-view, high-resolution, and quantitative on-chip microscopy.

eess.IV↗

arXiv2019

OpenWSI: a low-cost, high-throughput whole slide imaging system via single-frame autofocusing and open-source hardware

Recent advancements in whole slide imaging (WSI) have moved pathology closer to digital practice. Existing systems require precise mechanical control and the cost is prohibitive for most individual pathologists. Here we report a low-cost and high-throughput WSI system termed OpenWSI. The reported system is built using off-the-shelf components including a programmable LED array, a photographic lens, and a low-cost computer numerical control (CNC) router. Different from conventional WSI platforms, our system performs real-time single-frame autofocusing using color-multiplexed illumination. For axial positioning control, we perform coarse adjustment using the CNC router and precise adjustment using the ultrasonic motor ring in the photographic lens. By using a 20X objective lens, we show that the OpenWSI system has a resolution of ~0.7 microns. It can acquire whole slide images of a 225-mm^2 region in ~2 mins, with throughput comparable to existing high-end platforms. The reported system offers a turnkey solution to transform the high-end WSI platforms into one that can be made broadly available and utilizable without loss of capacity.

eess.IV↗

arXiv2019

Ptychographic modulation engine (PME): a low-cost DIY microscope add-on for coherent super-resolution imaging

Imaging of biological cells and tissues often relies on fluorescent labels, which offer high contrast with molecular specificity. The use of exogenous labeling agents, however, may alter the normal physiology of the bio-specimens. Complementary to the established fluorescence microscopy, label-free quantitative phase imaging provides an objective morphological measurement tool for bio-specimens and is free of variability introduced by contrast agents. Here we report a simple and low-cost microscope add-on, termed Ptychographic Modulation Engine (PME), for super-resolution quantitative phase imaging. In this microscope add-on module, we attach a diffuser to a 3D-printed holder that can be mechanically moved to different x-y positions. We then use two vibrational motors to introduce random positional shifts to the diffuser. The add-on module can be placed between the objective lens and the specimen in most existing microscope platforms. Thanks to the diffuser modulation process, the otherwise inaccessible high-resolution object information can now be encoded into the captured images. In the ptychographic phase retrieval process, we jointly recover the complex object wavefront, the complex diffuser profile, and the unknown positional shifts of the diffuser. We demonstrate a 4-fold resolution gain over the diffraction limit of the employed 2X objective lens. We also test our approach for in-vivo cell imaging, where we are able to adjust the focus after the data has been captured. The reported microscope add-on provides a turnkey solution for super-resolution quantitative phase imaging. It may find applications in label-free bio-imaging where both large field-of-view and high resolution are needed.

physics.ins-det↗

arXiv2019

Super-resolution microscopy via ptychographic structured modulation of a diffuser

We report a new coherent imaging technique, termed ptychographic structured modulation (PSM), for quantitative super-resolution microscopy. In this technique, we place a thin diffuser (i.e., a scattering lens) in between the sample and the objective lens to modulate the complex light waves from the object. The otherwise inaccessible high-resolution object information can thus be encoded into the captured images. We then employ a ptychographic phase retrieval process to jointly recover the exit wavefront of the complex object and the unknown diffuser profile. Unlike the illumination-based super-resolution approach, the recovered image of our approach depends upon how the complex wavefront exits the sample - not enters it. Therefore, the sample thickness becomes irrelevant during reconstruction. After recovery, we can propagate the super-resolution complex wavefront to any position along the optical axis. We validate our approach using a resolution target, a quantitative phase target, a two-layer sample, and a thick PDMS sample. We demonstrate a 4.5-fold resolution gain over the diffraction limit. We also show that a 4-fold resolution gain can be achieved with as few as ~30 images. The reported approach may provide a quantitative super-resolution strategy for coherent light, X-ray, and electron imaging.

eess.IV↗

arXiv2019

Rapid and robust whole slide imaging based on LED-array illumination and color-multiplexed single-shot autofocusing

Background: The use of whole slide imaging (WSI) for digital pathology has recently been cleared for primary diagnosis in the US. A conventional WSI system scans the tissue slide to different positions and acquires the digital images. In a typical implementation, a focus map is created prior to the scanning process, leading to significant overhead time and a necessity for high positional accuracy of the mechanical system. The resulting cost of WSI system is often prohibitive for frozen section procedure during surgery. Methods: We report a novel WSI scheme based on a programmable LED array for sample illumination. In between two regular brightfield image acquisitions, we acquire one additional image by turning on a red and a green LED for color multiplexed illumination. We then identify the translational shift of the red- and green-channel images by maximizing the image mutual information or cross-correlation. The resulting translational shift is used for dynamic focus correction in the scanning process. Since we track the differential focus during adjacent acquisitions, there is no positional repeatability requirement in our scheme. Results: We demonstrate a prototype WSI platform with a mean focusing error of ~0.3 microns. Different from previous implementations, this prototype platform requires no focus map surveying, no secondary camera or additional optics, and allows for continuous sample motion in the focus tracking process. Conclusions: A programmable LED array can be used for color-multiplexed single-shot autofocusing in WSI. The reported scheme may enable the development of cost-effective WSI platforms without positional repeatability requirement. It may also provide a turnkey solution for other high-content microscopy applications.

eess.IV↗

arXiv2019

Field-portable quantitative lensless microscopy based on translated speckle illumination and sub-sampled ptychographic phase retrieval

We report a compact, cost-effective and field-portable lensless imaging platform for quantitative microscopy. In this platform, the object is placed on top of an image sensor chip without using any lens. We use a low-cost galvo scanner to rapidly scan an unknown laser speckle pattern on the object. To address the positioning repeatability and accuracy issues, we directly recover the positional shifts of the speckle pattern based on the phase correlation of the captured images. To bypass the resolution limit set by the imager pixel size, we employ a sub-sampled ptychographic phase retrieval process to recover the complex object. We validate our approach using a resolution target, a phase target, and a biological sample. Our results show that accurate, high-quality complex images can be obtained from a lensless dataset with as few as ~10 images. We also demonstrate the reported approach to achieve a 6.4 mm by 4.6 mm field of view and a half pitch resolution of 1 miron. The reported approach may provide a quantitative lensless imaging strategy for addressing point-of-care, global-health, and telemedicine related challenges.

eess.IV↗

arXiv2018

Axially-shifted pattern illumination for macroscale turbidity suppression and virtual volumetric confocal imaging without axial scanning

Structured illumination has been widely used for optical sectioning and 3D surface recovery. In a typical implementation, multiple images under non-uniform pattern illumination are used to recover a single object section. Axial scanning of the sample or the objective lens is needed for acquiring the 3D volumetric data. Here we demonstrate the use of axially-shifted pattern illumination (asPI) for virtual volumetric confocal imaging without axial scanning. In the reported approach, we project illumination patterns at a tilted angle with respect to the detection optics. As such, the illumination patterns shift laterally at different z sections and the sample information at different z-sections can be recovered based on the captured 2D images. We demonstrate the reported approach for virtual confocal imaging through a diffusing layer and underwater 3D imaging through diluted milk. We show that we can acquire the entire confocal volume in ~1s with a throughput of 420 megapixels per second. Our approach may provide new insights for developing confocal light ranging and detection systems in degraded visual environments.

cs.CV↗

arXiv2017

Rapid focus map surveying for whole slide imaging with continues sample motion

Whole slide imaging (WSI) has recently been cleared for primary diagnosis in the US. A critical challenge of WSI is to perform accurate focusing in high speed. Traditional systems create a focus map prior to scanning. For each focus point on the map, sample needs to be static in the x-y plane and axial scanning is needed to maximize the contrast. Here we report a novel focus map surveying method for WSI. The reported method requires no axial scanning, no additional camera and lens, works for stained and transparent samples, and allows continuous sample motion in the surveying process. It can be used for both brightfield and fluorescence WSI. By using a 20X, 0.75 NA objective lens, we demonstrate a mean focusing error of ~0.08 microns in the static mode and ~0.17 microns in the continuous motion mode. The reported method may provide a turnkey solution for most existing WSI systems for its simplicity, robustness, accuracy, and high-speed. It may also standardize the imaging performance of WSI systems for digital pathology and find other applications in high-content microscopy such as DNA sequencing and time-lapse live-cell imaging.

cs.CV↗

arXiv2017

Dual-LED-based multichannel microscopy for whole-slide multiplane, multispectral, and phase imaging

We report the development of a multichannel microscopy for whole-slide multiplane, multispectral, and phase imaging. We use trinocular heads to split the beam path into 6 independent channels and employ a camera array for parallel data acquisition, achieving a maximum data throughput of ~1 gigapixel per second. To perform single-frame rapid autofocusing, we place two near-infrared LEDs at the back focal plane of the condenser lens to illuminate the sample from two different incident angles. A hot mirror is used to direct the near-infrared light to an autofocusing camera. For multiplane whole slide imaging (WSI), we acquire 6 different focal planes of a thick specimen simultaneously. For multispectral WSI, we relay the 6 independent image planes to the same focal position and simultaneously acquire information at 6 spectral bands. For whole-slide phase imaging, we acquire images at 3 focal positions simultaneously and use the transport-of-intensity equation to recover the phase information. We also provide an open-source design to further increase the number of channels from 6 to 15. The reported platform provides a simple solution for multiplexed fluorescence imaging and multimodal WSI. Acquiring an instant focal stack without z-scanning may also enable fast 3D dynamic tracking of various biological samples.

physics.ins-det↗