arXiv subjects

Hua Li

Publications and source records attributed to Hua Li.

At least 73 records · Page 4Linked to original sources

arXiv2023

Semi-Supervised Semantic Segmentation of Cell Nuclei via Diffusion-based Large-Scale Pre-Training and Collaborative Learning

Automated semantic segmentation of cell nuclei in microscopic images is crucial for disease diagnosis and tissue microenvironment analysis. Nonetheless, this task presents challenges due to the complexity and heterogeneity of cells. While supervised deep learning methods are promising, they necessitate large annotated datasets that are time-consuming and error-prone to acquire. Semi-supervised approaches could provide feasible alternatives to this issue. However, the limited annotated data may lead to subpar performance of semi-supervised methods, regardless of the abundance of unlabeled data. In this paper, we introduce a novel unsupervised pre-training-based semi-supervised framework for cell-nuclei segmentation. Our framework is comprised of three main components. Firstly, we pretrain a diffusion model on a large-scale unlabeled dataset. The diffusion model's explicit modeling capability facilitates the learning of semantic feature representation from the unlabeled data. Secondly, we achieve semantic feature aggregation using a transformer-based decoder, where the pretrained diffusion model acts as the feature extractor, enabling us to fully utilize the small amount of labeled data. Finally, we implement a collaborative learning framework between the diffusion-based segmentation model and a supervised segmentation model to further enhance segmentation performance. Experiments were conducted on four publicly available datasets to demonstrate significant improvements compared to competitive semi-supervised segmentation methods and supervised baselines. A series of out-of-distribution tests further confirmed the generality of our framework. Furthermore, thorough ablation experiments and visual analysis confirmed the superiority of our proposed method.

eess.IV↗

arXiv2023

Compact Twice Fusion Network for Edge Detection

The significance of multi-scale features has been gradually recognized by the edge detection community. However, the fusion of multi-scale features increases the complexity of the model, which is not friendly to practical application. In this work, we propose a Compact Twice Fusion Network (CTFN) to fully integrate multi-scale features while maintaining the compactness of the model. CTFN includes two lightweight multi-scale feature fusion modules: a Semantic Enhancement Module (SEM) that can utilize the semantic information contained in coarse-scale features to guide the learning of fine-scale features, and a Pseudo Pixel-level Weighting (PPW) module that aggregate the complementary merits of multi-scale features by assigning weights to all features. Notwithstanding all this, the interference of texture noise makes the correct classification of some pixels still a challenge. For these hard samples, we propose a novel loss function, coined Dynamic Focal Loss, which reshapes the standard cross-entropy loss and dynamically adjusts the weights to correct the distribution of hard samples. We evaluate our method on three datasets, i.e., BSDS500, NYUDv2, and BIPEDv2. Compared with state-of-the-art methods, CTFN achieves competitive accuracy with less parameters and computational cost. Apart from the backbone, CTFN requires only 0.1M additional parameters, which reduces its computation cost to just 60% of other state-of-the-art methods. The codes are available at https://github.com/Li-yachuan/CTFN-pytorch-master.

cs.CV↗

arXiv2023

A quality assurance framework for real-time monitoring of deep learning segmentation models in radiotherapy

To safely deploy deep learning models in the clinic, a quality assurance framework is needed for routine or continuous monitoring of input-domain shift and the models' performance without ground truth contours. In this work, cardiac substructure segmentation was used as an example task to establish a QA framework. A benchmark dataset consisting of Computed Tomography (CT) images along with manual cardiac delineations of 241 patients were collected, including one 'common' image domain and five 'uncommon' domains. Segmentation models were tested on the benchmark dataset for an initial evaluation of model capacity and limitations. An image domain shift detector was developed by utilizing a trained Denoising autoencoder (DAE) and two hand-engineered features. Another Variational Autoencoder (VAE) was also trained to estimate the shape quality of the auto-segmentation results. Using the extracted features from the image/segmentation pair as inputs, a regression model was trained to predict the per-patient segmentation accuracy, measured by Dice coefficient similarity (DSC). The framework was tested across 19 segmentation models to evaluate the generalizability of the entire framework. As results, the predicted DSC of regression models achieved a mean absolute error (MAE) ranging from 0.036 to 0.046 with an averaged MAE of 0.041. When tested on the benchmark dataset, the performances of all segmentation models were not significantly affected by scanning parameters: FOV, slice thickness and reconstructions kernels. For input images with Poisson noise, CNN-based segmentation models demonstrated a decreased DSC ranging from 0.07 to 0.41, while the transformer-based model was not significantly affected.

eess.IV↗

arXiv2023

Gaussian-Hermite Moment Invariants of General Multi-Channel Functions

With the development of data acquisition technology, large amounts of multi-channel data are collected and widely used in many fields. Most of them, such as RGB images and vector fields, can be expressed as different types of multi-channel functions. Feature extraction of multi-channel data for identifying interest patterns is a critical but challenging task. This paper focuses on constructing moment-based features of general multi-channel functions. Specifically, we define two transform models, rotation-affine transform and total rotation transform, to describe real deformations of multi-channel data. Then, we design a structural framework to generate Gaussian-Hermite moment invariants for these two transform models systematically. It is the first time that a unified framework has been proposed in the literature to construct orthogonal moment invariants of general multi-channel functions. Given a specific type of multi-channel data, we demonstrate how to utilize the new method to derive all possible invariants and eliminate dependences among them. We obtain independent sets of invariants with low orders and low degrees for RGB images, 2D vector fields and color volume data. Based on synthetic and real multi-channel data, we conduct extensive experiments to evaluate the stability and discriminability of these invariants and their robustness to noise. The results show that new moment invariants significantly outperform previous moment invariants of multi-channel data in RGB image classification and vortex detection in 2D vector fields.

cs.CV↗

arXiv2022

On the impact of incorporating task-information in learning-based image denoising

A variety of deep neural network (DNN)-based image denoising methods have been proposed for use with medical images. These methods are typically trained by minimizing loss functions that quantify a distance between the denoised image, or a transformed version of it, and the defined target image (e.g., a noise-free or low-noise image). They have demonstrated high performance in terms of traditional image quality metrics such as root mean square error (RMSE), structural similarity index measure (SSIM), or peak signal-to-noise ratio (PSNR). However, it has been reported recently that such denoising methods may not always improve objective measures of image quality. In this work, a task-informed DNN-based image denoising method was established and systematically evaluated. A transfer learning approach was employed, in which the DNN is first pre-trained by use of a conventional (non-task-informed) loss function and subsequently fine-tuned by use of the hybrid loss that includes a task-component. The task-component was designed to measure the performance of a numerical observer (NO) on a signal detection task. The impact of network depth and constraining the fine-tuning to specific layers of the DNN was explored. The task-informed training method was investigated in a stylized low-dose X-ray computed tomography (CT) denoising study for which binary signal detection tasks under signal-known-statistically (SKS) with background-known-statistically (BKS) conditions were considered. The impact of changing the specified task at inference time to be different from that employed for model training, a phenomenon we refer to as "task-shift", was also investigated. The presented results indicate that the task-informed training method can improve observer performance while providing control over the trade off between traditional and task-based measures of image quality.

eess.IV↗

arXiv2022

Joint localization and classification of breast tumors on ultrasound images using a novel auxiliary attention-based framework

Automatic breast lesion detection and classification is an important task in computer-aided diagnosis, in which breast ultrasound (BUS) imaging is a common and frequently used screening tool. Recently, a number of deep learning-based methods have been proposed for joint localization and classification of breast lesions using BUS images. In these methods, features extracted by a shared network trunk are appended by two independent network branches to achieve classification and localization. Improper information sharing might cause conflicts in feature optimization in the two branches and leads to performance degradation. Also, these methods generally require large amounts of pixel-level annotated data for model training. To overcome these limitations, we proposed a novel joint localization and classification model based on the attention mechanism and disentangled semi-supervised learning strategy. The model used in this study is composed of a classification network and an auxiliary lesion-aware network. By use of the attention mechanism, the auxiliary lesion-aware network can optimize multi-scale intermediate feature maps and extract rich semantic information to improve classification and localization performance. The disentangled semi-supervised learning strategy only requires incomplete training datasets for model training. The proposed modularized framework allows flexible network replacement to be generalized for various applications. Experimental results on two different breast ultrasound image datasets demonstrate the effectiveness of the proposed method. The impacts of various network factors on model performance are also investigated to gain deep insights into the designed framework.

eess.IV↗

arXiv2022

Efficient Extraction of Hot Carriers in Perovskite Quantum Dot through Building State Coupled Complex

Utilizing hot carriers is the crucial approach for solar cell to exceed the thermodynamic detailed balance limit, yet effective extraction of hot carriers in absorber materials via most commonly used semiconductor acceptors has been a challenge in both materials and photophysics research for many years. Herein, we build series of CsPbI3 quantum dot and fullerene derivative systems to explore the decisive factors of this process and have for the first time realized efficient hot carrier extraction in these systems (maximum extraction efficiency ~ 84%). We find building the systems as state-coupled complexes creates new carrier transport channels at about 0.22 eV above CsPbI3 quantum dot bandgap, which facilitates highly efficient HC extraction. Our research directly visualizes the inner connection of molecule interaction and ultrafast hot carrier extraction. The knowledge and strategy gained here are of universal meaning, taking an important step forward true hot carrier photovoltaics.

physics.app-ph↗

arXiv2022

Stereo Superpixel Segmentation Via Decoupled Dynamic Spatial-Embedding Fusion Network

Stereo superpixel segmentation aims at grouping the discretizing pixels into perceptual regions through left and right views more collaboratively and efficiently. Existing superpixel segmentation algorithms mostly utilize color and spatial features as input, which may impose strong constraints on spatial information while utilizing the disparity information in terms of stereo image pairs. To alleviate this issue, we propose a stereo superpixel segmentation method with a decoupling mechanism of spatial information in this work. To decouple stereo disparity information and spatial information, the spatial information is temporarily removed before fusing the features of stereo image pairs, and a decoupled stereo fusion module (DSFM) is proposed to handle the stereo features alignment as well as occlusion problems. Moreover, since the spatial information is vital to superpixel segmentation, we further design a dynamic spatiality embedding module (DSEM) to re-add spatial information, and the weights of spatial information will be adaptively adjusted through the dynamic fusion (DF) mechanism in DSEM for achieving a finer segmentation. Comprehensive experimental results demonstrate that our method can achieve the state-of-the-art performance on the KITTI2015 and Cityscapes datasets, and also verify the efficiency when applied in salient object detection on NJU2K dataset. The source code will be available publicly after paper is accepted.

cs.CV↗

arXiv2022

The Counterfactual-Shapley Value: Attributing Change in System Metrics

Given an unexpected change in the output metric of a large-scale system, it is important to answer why the change occurred: which inputs caused the change in metric? A key component of such an attribution question is estimating the counterfactual: the (hypothetical) change in the system metric due to a specified change in a single input. However, due to inherent stochasticity and complex interactions between parts of the system, it is difficult to model an output metric directly. We utilize the computational structure of a system to break up the modelling task into sub-parts, such that each sub-part corresponds to a more stable mechanism that can be modelled accurately over time. Using the system's structure also helps to view the metric as a computation over a structural causal model (SCM), thus providing a principled way to estimate counterfactuals. Specifically, we propose a method to estimate counterfactuals using time-series predictive models and construct an attribution score, CF-Shapley, that is consistent with desirable axioms for attributing an observed change in the output metric. Unlike past work on causal shapley values, our proposed method can attribute a single observed change in output (rather than a population-level effect) and thus provides more accurate attribution scores when evaluated on simulated datasets. As a real-world application, we analyze a query-ad matching system with the goal of attributing observed change in a metric for ad matching density. Attribution scores explain how query volume and ad demand from different query categories affect the ad matching density, leading to actionable insights and uncovering the role of external events (e.g., "Cheetah Day") in driving the matching density.

cs.LG↗

arXiv2022

A novel adversarial learning strategy for medical image classification

Deep learning (DL) techniques have been extensively utilized for medical image classification. Most DL-based classification networks are generally structured hierarchically and optimized through the minimization of a single loss function measured at the end of the networks. However, such a single loss design could potentially lead to optimization of one specific value of interest but fail to leverage informative features from intermediate layers that might benefit classification performance and reduce the risk of overfitting. Recently, auxiliary convolutional neural networks (AuxCNNs) have been employed on top of traditional classification networks to facilitate the training of intermediate layers to improve classification performance and robustness. In this study, we proposed an adversarial learning-based AuxCNN to support the training of deep neural networks for medical image classification. Two main innovations were adopted in our AuxCNN classification framework. First, the proposed AuxCNN architecture includes an image generator and an image discriminator for extracting more informative image features for medical image classification, motivated by the concept of generative adversarial network (GAN) and its impressive ability in approximating target data distribution. Second, a hybrid loss function is designed to guide the model training by incorporating different objectives of the classification network and AuxCNN to reduce overfitting. Comprehensive experimental studies demonstrated the superior classification performance of the proposed model. The effect of the network-related factors on classification performance was investigated.

eess.IV↗

arXiv2022

Broadband Terahertz Quantum Cascade Laser Dual-Comb Sources with Off-Resonant Microwave Injection

Broadband dual-comb spectroscopy has attracted increasing interests due to its unique advantages in high spectral resolution, fast detection, and so on. Although the dual-comb technique is relatively mature in the infrared wavelengths, it is, currently, not commercially capable of practical applications in the terahertz regime due to the lack of high performance broadband terahertz dual-comb sources. In the terahertz frequency range, the electrically pumped quantum cascade laser (QCL) is a suitable candidate for the dual-comb operation. However, free running terahertz QCL dual-comb sources normally show limited optical bandwidths ($\sim$100-200 GHz). Although the resonant microwave injection locking has been widely used to broaden the emission spectra of terahertz QCLs by modulating the laser drive current at the cavity round-trip frequency, it is hard to be employed to broaden the dual-comb bandwidths due to the large phase noise induced by the resonant injection and non-ideal microwave circuits. Therefore, it is challenging to obtain broadband terahertz dual-comb sources that can fully exploits the laser gain bandwidth. Here, we employ an off-resonant microwave injection to significantly broaden the dual-comb bandwidth of a terahertz QCL dual-comb source emitting around 4.2 THz. The measured optical dual-comb bandwidth is broadened from 147 GHz in free running to $>$450 GHz under the off-resonant injection. The broadened dual-comb bandwidth is experimentally proved by the transmission measurements of a filter and a GaAs etalon. By performing a simple numerical analysis based on a rate equation model, we explain that the broadband dual-comb operation under the off-resonant microwave injection could be resulted from a wider lasing bandwidth and a higher degree of phase matching.

physics.optics↗

arXiv2022

Self-Referenced Terahertz Semiconductor Dual-Comb Sources

Employing two frequency combs with a slight difference in repetition frequencies, the dual-comb source shows unique advantages in high precision spectroscopy, imaging, ranging, communications, etc. In the terahertz (THz) frequency range, the electrically pumped quantum cascade laser (QCL) offers the possibility of realizing the compact dual-comb source due to its semiconductor-based chip-scale configuration. Although the active stabilization of a THz QCL dual-comb source was demonstrated by phase locking one of the dual-comb lines, the full stabilization of all dual-comb lines is still challenging. Here, we propose a self-reference method to obtain a fully stabilized dual-comb signal on a pure THz QCL platform. Without using any external locking components, we filter out one dual-comb line and beat it with the whole dual-comb signal, which eliminates the common carrier offset frequency noise and reduces the dual-comb repetition frequency noise. It is experimentally demonstrated that the self-reference technique can significantly improve the long-term stability of the dual-comb signal. A record of the ``maxhold" linewidth of 14.8 kHz (60 s time duration) is obtained by implementing the self-reference technique, while without the self-reference the dual-comb lines show a ``maxhold" linewidth of 2 MHz (15 s time duration). The method provides the simplest way to improve the long-term stability of THz QCL dual-comb sources, which can be further adopted for high precision measurements.

physics.optics↗

arXiv2022

Nonreciprocal thermal radiation in ultrathin magnetized epsilon-near-zero semiconductors

Spectral/angular emissivity $e$ and absorptivity $α$ of an object are widely believed to be identical by Kirchhoff's law of thermal radiation in reciprocal systems, but this introduces an intrinsic and inevitable energy loss for energy conversion and harvesting devices. So far, experimental evidences of breaking this well-known balance are still absent, and previous theoretical proposals are restricted to narrow single-band nonreciprocal radiation. Here we observe for the first time, to our knowledge, the violation of Kirchhoff's law using ultrathin ($<λ/40$, $λ$ is the working wavelength) magnetized InAs semiconductor films at epsilon-near-zero (ENZ) frequencies. Large difference of $|α-e|>0.6$ has been experimentally demonstrated under a moderate external magnetic field. Moreover, based on magnetized ENZ building blocks supporting asymmetrically radiative Berreman and surface ENZ modes, we show versatile shaping of nonreciprocal thermal radiation: single-band, dual-band, and broadband nonreciprocal emission spectra at different wavebands. Our findings of breaking Kirchhoff's law will advance the conventional understanding of emission and absorption processes of natural objects, and lay a solid foundation for more comprehensive studies in designing various nonreciprocal thermal emitters. The reported recipe of diversely shaping nonreciprocal emission will also breed new possibilities in renovating next-generation nonreciprocal energy devices in the areas of solar cells, thermophotovoltaic, radiative cooling, etc.

physics.optics↗

arXiv2022

Application of DatasetGAN in medical imaging: preliminary studies

Generative adversarial networks (GANs) have been widely investigated for many potential applications in medical imaging. DatasetGAN is a recently proposed framework based on modern GANs that can synthesize high-quality segmented images while requiring only a small set of annotated training images. The synthesized annotated images could be potentially employed for many medical imaging applications, where images with segmentation information are required. However, to the best of our knowledge, there are no published studies focusing on its applications to medical imaging. In this work, preliminary studies were conducted to investigate the utility of DatasetGAN in medical imaging. Three improvements were proposed to the original DatasetGAN framework, considering the unique characteristics of medical images. The synthesized segmented images by DatasetGAN were visually evaluated. The trained DatasetGAN was further analyzed by evaluating the performance of a pre-defined image segmentation technique, which was trained by the use of the synthesized datasets. The effectiveness, concerns, and potential usage of DatasetGAN were discussed.

cs.CV↗

arXiv2022

Learning stochastic object models from medical imaging measurements by use of advanced ambient generative adversarial networks

Purpose: To objectively assess new medical imaging technologies via computer-simulations, it is important to account for the variability in the ensemble of objects to be imaged. This source of variability can be described by stochastic object models (SOMs). It is generally desirable to establish SOMs from experimental imaging measurements acquired by use of a well-characterized imaging system, but this task has remained challenging. Approach: A generative adversarial network (GAN)-based method that employs AmbientGANs with modern progressive or multiresolution training approaches is proposed. AmbientGANs established using the proposed training procedure are systematically validated in a controlled way using computer-simulated magnetic resonance imaging (MRI) data corresponding to a stylized imaging system. Emulated single-coil experimental MRI data are also employed to demonstrate the methods under less stylized conditions. Results: The proposed AmbientGAN method can generate clean images when the imaging measurements are contaminated by measurement noise. When the imaging measurement data are incomplete, the proposed AmbientGAN can reliably learn the distribution of the measurement components of the objects. Conclusions: Both visual examinations and quantitative analyses, including task-specific validations using the Hotelling observer, demonstrated that the proposed AmbientGAN method holds promise to establish realistic SOMs from imaging measurements.

eess.IV↗

arXiv2021

A Hybrid Approach for Approximating the Ideal Observer for Joint Signal Detection and Estimation Tasks by Use of Supervised Learning and Markov-Chain Monte Carlo Methods

The ideal observer (IO) sets an upper performance limit among all observers and has been advocated for assessing and optimizing imaging systems. For general joint detection and estimation (detection-estimation) tasks, estimation ROC (EROC) analysis has been established for evaluating the performance of observers. However, in general, it is difficult to accurately approximate the IO that maximizes the area under the EROC curve. In this study, a hybrid method that employs machine learning is proposed to accomplish this. Specifically, a hybrid approach is developed that combines a multi-task convolutional neural network and a Markov-Chain Monte Carlo (MCMC) method in order to approximate the IO for detection-estimation tasks. Unlike traditional MCMC methods, the hybrid method is not limited to use of specific utility functions. In addition, a purely supervised learning-based sub-ideal observer is proposed. Computer-simulation studies are conducted to validate the proposed method, which include signal-known-statistically/background-known-exactly and signal-known-statistically/background-known-statistically tasks. The EROC curves produced by the proposed method are compared to those produced by the MCMC approach or analytical computation when feasible. The proposed method provides a new approach for approximating the IO and may advance the application of EROC analysis for optimizing imaging systems.

eess.SP↗

arXiv2021

Ultrabroadband THz/IR upconversion and photovoltaic response in semi-conductor ratchet based upconverter

An ultrabroadband upconversion device is demonstrated by direct tandem integration of a p-type GaAs/AlxGa1-xAs ratchet photodetector (RP) with a GaAs double heterojunction LED (DH-LED) using the molecular beam epitaxy (MBE). An ultrabroadband photoresponse from terahertz (THz) to near infrared (NIR) region (4-200 THz) was realized that covers a much wider frequency range com-pared with the existing upconversion devices. Broadband IR/THz radiation from 1000 K blackbody is successfully upconverted into NIR photons which can be detected by commercial Si-based device. The normal incidence absorption of the RP simplifies the structure of the RP-LED device and make it more compact compared with the inter-subband transition based upconverters. In addition to the up-conversion function, the proposed upconverter is also tested as photovoltaic detectors in the infrared region (15-200 THz) without an applied bias voltage due to the ratchet effect.

physics.app-ph↗

arXiv2021

Improved comb and dual-comb operation of terahertz quantum cascade lasers utilizing a symmetric thermal dissipation

In the terahertz frequency range, the quantum cascade laser (QCL) is a suitable platform for the frequency comb and dual-comb operation. Improved comb performances have been always much in demand. In this work, by employing a symmetric thermal dissipation scheme, we report an improved frequency comb and dual-comb operation of terahertz QCLs. Two configurations of cold fingers, i.e., type A and B with asymmetric and symmetric thermal dissipation schemes, respectively, are investigated here. A finite-element thermal analysis is carried out to study the parametric effects on the thermal management of the terahertz QCL. The modeling reveals that the symmetric thermal dissipation (type B) results in a more uniform thermal conduction and lower maximum temperature in the active region of the laser, compared to the traditional asymmetric thermal dissipation scheme (type A). To verify the simulation, experiments are further performed by measuring laser performance and comb characteristics of terahertz QCLs emitting around 4.2 THz mounted on type A and type B cold fingers. The experimental results show that the symmetric thermal dissipation approach (type B) is effective for improving the comb and dual-comb operation of terahertz QCLs, which can be further widely adopted for spectroscopy, imaging, and near-field applications.

physics.optics↗