arXiv subjects

Lei Xing

Publications and source records attributed to Lei Xing.

At least 73 records · Page 4Linked to original sources

arXiv2022

Image Classification using Graph Neural Network and Multiscale Wavelet Superpixels

Prior studies using graph neural networks (GNNs) for image classification have focused on graphs generated from a regular grid of pixels or similar-sized superpixels. In the latter, a single target number of superpixels is defined for an entire dataset irrespective of differences across images and their intrinsic multiscale structure. On the contrary, this study investigates image classification using graphs generated from an image-specific number of multiscale superpixels. We propose WaveMesh, a new wavelet-based superpixeling algorithm, where the number and sizes of superpixels in an image are systematically computed based on its content. WaveMesh superpixel graphs are structurally different from similar-sized superpixel graphs. We use SplineCNN, a state-of-the-art network for image graph classification, to compare WaveMesh and similar-sized superpixels. Using SplineCNN, we perform extensive experiments on three benchmark datasets under three local-pooling settings: 1) no pooling, 2) GraclusPool, and 3) WavePool, a novel spatially heterogeneous pooling scheme tailored to WaveMesh superpixels. Our experiments demonstrate that SplineCNN learns from multiscale WaveMesh superpixels on-par with similar-sized superpixels. In all WaveMesh experiments, GraclusPool performs poorer than no pooling / WavePool, indicating that poor choice of pooling can result in inferior performance while learning from multiscale superpixels.

cs.CV↗

arXiv2021

MDFM: Multi-Decision Fusing Model for Few-Shot Learning

In recent years, researchers pay growing attention to the few-shot learning (FSL) task to address the data-scarce problem. A standard FSL framework is composed of two components: i) Pre-train. Employ the base data to generate a CNN-based feature extraction model (FEM). ii) Meta-test. Apply the trained FEM to the novel data (category is different from base data) to acquire the feature embeddings and recognize them. Although researchers have made remarkable breakthroughs in FSL, there still exists a fundamental problem. Since the trained FEM with base data usually cannot adapt to the novel class flawlessly, the novel data's feature may lead to the distribution shift problem. To address this challenge, we hypothesize that even if most of the decisions based on different FEMs are viewed as weak decisions, which are not available for all classes, they still perform decently in some specific categories. Inspired by this assumption, we propose a novel method Multi-Decision Fusing Model (MDFM), which comprehensively considers the decisions based on multiple FEMs to enhance the efficacy and robustness of the model. MDFM is a simple, flexible, non-parametric method that can directly apply to the existing FEMs. Besides, we extend the proposed MDFM to two FSL settings (i.e., supervised and semi-supervised settings). We evaluate the proposed method on five benchmark datasets and achieve significant improvements of 3.4%-7.3% compared with state-of-the-arts.

cs.CV↗

arXiv2021

SSDL: Self-Supervised Dictionary Learning

The label-embedded dictionary learning (DL) algorithms generate influential dictionaries by introducing discriminative information. However, there exists a limitation: All the label-embedded DL methods rely on the labels due that this way merely achieves ideal performances in supervised learning. While in semi-supervised and unsupervised learning, it is no longer sufficient to be effective. Inspired by the concept of self-supervised learning (e.g., setting the pretext task to generate a universal model for the downstream task), we propose a Self-Supervised Dictionary Learning (SSDL) framework to address this challenge. Specifically, we first design a $p$-Laplacian Attention Hypergraph Learning (pAHL) block as the pretext task to generate pseudo soft labels for DL. Then, we adopt the pseudo labels to train a dictionary from a primary label-embedded DL method. We evaluate our SSDL on two human activity recognition datasets. The comparison results with other state-of-the-art methods have demonstrated the efficiency of SSDL.

cs.LG↗

arXiv2021

RadFusion: Benchmarking Performance and Fairness for Multimodal Pulmonary Embolism Detection from CT and EHR

Despite the routine use of electronic health record (EHR) data by radiologists to contextualize clinical history and inform image interpretation, the majority of deep learning architectures for medical imaging are unimodal, i.e., they only learn features from pixel-level information. Recent research revealing how race can be recovered from pixel data alone highlights the potential for serious biases in models which fail to account for demographics and other key patient attributes. Yet the lack of imaging datasets which capture clinical context, inclusive of demographics and longitudinal medical history, has left multimodal medical imaging underexplored. To better assess these challenges, we present RadFusion, a multimodal, benchmark dataset of 1794 patients with corresponding EHR data and high-resolution computed tomography (CT) scans labeled for pulmonary embolism. We evaluate several representative multimodal fusion models and benchmark their fairness properties across protected subgroups, e.g., gender, race/ethnicity, age. Our results suggest that integrating imaging and EHR data can improve classification performance and robustness without introducing large disparities in the true positive rate between population groups.

eess.IV↗

arXiv2021

MHFC: Multi-Head Feature Collaboration for Few-Shot Learning

Few-shot learning (FSL) aims to address the data-scarce problem. A standard FSL framework is composed of two components: (1) Pre-train. Employ the base data to generate a CNN-based feature extraction model (FEM). (2) Meta-test. Apply the trained FEM to acquire the novel data's features and recognize them. FSL relies heavily on the design of the FEM. However, various FEMs have distinct emphases. For example, several may focus more attention on the contour information, whereas others may lay particular emphasis on the texture information. The single-head feature is only a one-sided representation of the sample. Besides the negative influence of cross-domain (e.g., the trained FEM can not adapt to the novel class flawlessly), the distribution of novel data may have a certain degree of deviation compared with the ground truth distribution, which is dubbed as distribution-shift-problem (DSP). To address the DSP, we propose Multi-Head Feature Collaboration (MHFC) algorithm, which attempts to project the multi-head features (e.g., multiple features extracted from a variety of FEMs) to a unified space and fuse them to capture more discriminative information. Typically, first, we introduce a subspace learning method to transform the multi-head features to aligned low-dimensional representations. It corrects the DSP via learning the feature with more powerful discrimination and overcomes the problem of inconsistent measurement scales from different head features. Then, we design an attention block to update combination weights for each head feature automatically. It comprehensively considers the contribution of various perspectives and further improves the discrimination of features. We evaluate the proposed method on five benchmark datasets (including cross-domain experiments) and achieve significant improvements of 2.1%-7.8% compared with state-of-the-arts.

cs.CV↗

arXiv2021

When Liquid Meets Frequency-Selective Rasorber: Wideband and Switchable 3-D Frequency-Selective Rasorber

In this paper, a switchable 3-D frequency selective rasorber (FSR) with wide absorption bands without lumped components or commercial magnetic absorbers is presented and investigated. The absorption path is constructed by embedding a hybrid liquid microwave absorber (MA) inside a parallel plate waveguide (PPW) to create an extra-wide absorption band. A reflection layer based on water is placed behind the FSR to realize the reconstruction from FSR to a band-notched absorber (BNA) by controlling the presence or absence of water. The liquid-based absorber is firstly analyzed by a multimode dielectric resonant circuit and the fundamental operating principle of the FSR is demonstrated with the help of an equivalent circuit model (ECM). A design example is provided, fabricated, and measured and it exhibits a passband at 5.10 GHz with a transmission bandwidth of 18.5% for less than 3 dB insertion loss and fractional bandwidth of 146.8% with reflectivity less than -10 dB in FSR mode. In BNA mode, it has a minimum return loss of 0.72 dB and a good absorption band from 2.5 to 4.6 GHz and 5.7 to 16.5 GHz. Good agreements among circuit analysis, simulation results, and measurement results are finally obtained. The switchable rasorber can be applied in a shared-aperture antennas system to convert a broadband stealth radome into a BNA.

physics.app-ph↗

arXiv2021

A Slot Antenna Array with Reconfigurable RCS Using Liquid Absorber

This paper presents a slot antenna array with a reconfigurable radar cross section (RCS). The antenna system is formed by combining a liquid absorber with a 2*2 slot antenna array. The liquid absorber consists of a polymethyl methacrylate (PMMA) container, a 45% ethanol layer, and a metal ground,which is attached to the surface of the slot antenna array. The incident wave can be absorbed by the absorber rather than reflected in other directions when the PMMA container is filled with ethanol, which reduces the monostatic and bistatic RCS. Thus the RCS of the antenna can be changed by injecting and extracting ethanol while the antenna's radiation performance in terms of bandwidth, radiation patterns and gain is well sustained. In a complex communication system, this can be used to switch between detection and stealth mode. The mechanism of the absorber is investigated. The simulated results show that the antenna with this absorber has monostatic and bistatic RCS reduction bands from 2.0 GHz to 18.0 GHz, a maximum RCS reduction of 35 dB with an average RCS reduction of 13.28 dB. The antenna's operating band is 100 MHz. Without ethanol, the antenna has a realized gain of 12.1 dBi, and it drops by 2 dB when the lossy ethanol is injected. The measured results agree well with the simulated ones.

physics.app-ph↗

arXiv2021

Meta-optimization for Fully Automated Radiation Therapy Treatment Planning

Objective: Radiation therapy treatment planning is a time-consuming process involving iterative adjustments of hyperparameters. To automate the treatment planning process, we propose a meta-optimization framework, called MetaPlanner (MP). Methods: Our MP algorithm automates planning by performing optimization of treatment planning hyperparameters. The algorithm uses a derivative-free method (i.e. parallel Nelder-Mead simplex search) to search for weight configurations that minimize a meta-scoring function. Meta-scoring is performed by constructing a tier list of the relevant considerations (e.g. dose homogeneity, conformity, spillage, and OAR sparing) to mimic the clinical decision-making process. Additionally, we have made our source code publicly available via github. Results: The proposed MP method is evaluated on two datasets (21 prostate cases and 6 head and neck cases) collected as part of clinical workflow. MP is applied to both IMRT and VMAT planning and compared to a baseline of manual VMAT plans. MP in both IMRT and VMAT scenarios has comparable or better performance than manual VMAT planning for all evaluated metrics. Conclusion: Our proposed MP provides a general framework for fully automated treatment planning that produces high quality treatment plans. Significance: Our MP method promises to substantially reduce the workload of treatment planners while maintaining or improving plan quality.

physics.med-ph↗

arXiv2021

Metal Artifact Reduction in 2D CT Images with Self-supervised Cross-domain Learning

The presence of metallic implants often introduces severe metal artifacts in the X-ray CT images, which could adversely influence clinical diagnosis or dose calculation in radiation therapy. In this work, we present a novel deep-learning-based approach for metal artifact reduction (MAR). In order to alleviate the need for anatomically identical CT image pairs (i.e., metal artifact-corrupted CT image and metal artifact-free CT image) for network learning, we propose a self-supervised cross-domain learning framework. Specifically, we train a neural network to restore the metal trace region values in the given metal-free sinogram, where the metal trace is identified by the forward projection of metal masks. We then design a novel FBP reconstruction loss to encourage the network to generate more perfect completion results and a residual-learning-based image refinement module to reduce the secondary artifacts in the reconstructed CT images. To preserve the fine structure details and fidelity of the final MAR image, instead of directly adopting CNN-refined images as output, we incorporate the metal trace replacement into our framework and replace the metal-affected projections of the original sinogram with the prior sinogram generated by the forward projection of the CNN output. We then use the filtered backward projection (FBP) algorithms for final MAR image reconstruction. We conduct an extensive evaluation on simulated and real artifact data to show the effectiveness of our design. Our method produces superior MAR results and outperforms other compelling methods. We also demonstrate the potential of our framework for other organ sites.

eess.IV↗

arXiv2021

CIM: Class-Irrelevant Mapping for Few-Shot Classification

Few-shot classification (FSC) is one of the most concerned hot issues in recent years. The general setting consists of two phases: (1) Pre-train a feature extraction model (FEM) with base data (has large amounts of labeled samples). (2) Use the FEM to extract the features of novel data (with few labeled samples and totally different categories from base data), then classify them with the to-be-designed classifier. The adaptability of pre-trained FEM to novel data determines the accuracy of novel features, thereby affecting the final classification performances. To this end, how to appraise the pre-trained FEM is the most crucial focus in the FSC community. It sounds like traditional Class Activate Mapping (CAM) based methods can achieve this by overlaying weighted feature maps. However, due to the particularity of FSC (e.g., there is no backpropagation when using the pre-trained FEM to extract novel features), we cannot activate the feature map with the novel classes. To address this challenge, we propose a simple, flexible method, dubbed as Class-Irrelevant Mapping (CIM). Specifically, first, we introduce dictionary learning theory and view the channels of the feature map as the bases in a dictionary. Then we utilize the feature map to fit the feature vector of an image to achieve the corresponding channel weights. Finally, we overlap the weighted feature map for visualization to appraise the ability of pre-trained FEM on novel data. For fair use of CIM in evaluating different models, we propose a new measurement index, called Feature Localization Accuracy (FLA). In experiments, we first compare our CIM with CAM in regular tasks and achieve outstanding performances. Next, we use our CIM to appraise several classical FSC frameworks without considering the classification results and discuss them.

cs.CV↗

arXiv2021

Quantitative Parametric Mapping of Tissues Properties from Standard Magnetic Resonance Imaging Enabled by Deep Learning

Magnetic resonance imaging (MRI) offers superior soft tissue contrast and is widely used in biomedicine. However, conventional MRI is not quantitative, which presents a bottleneck in image analysis and digital healthcare. Typically, additional scans are required to disentangle the effect of multiple parameters of MR and extract quantitative tissue properties. Here we investigate a data-driven strategy Q^2 MRI (Qualitative and Quantitative MRI) to derive quantitative parametric maps from standard MR images without additional data acquisition. By taking advantage of the interdependency between various MRI parametric maps buried in training data, the proposed deep learning strategy enables accurate prediction of tissue relaxation properties as well as other biophysical and biochemical characteristics from a single or a few images with conventional T_1/T_2 weighting. Superior performance has been achieved in quantitative MR imaging of the knee and liver. Q^2 MRI promises to provide a powerful tool for a variety of biomedical applications and facilitate the next generation of digital medicine.

physics.med-ph↗

arXiv2021

TransCT: Dual-path Transformer for Low Dose Computed Tomography

Low dose computed tomography (LDCT) has attracted more and more attention in routine clinical diagnosis assessment, therapy planning, etc., which can reduce the dose of X-ray radiation to patients. However, the noise caused by low X-ray exposure degrades the CT image quality and then affects clinical diagnosis accuracy. In this paper, we train a transformer-based neural network to enhance the final CT image quality. To be specific, we first decompose the noisy LDCT image into two parts: high-frequency (HF) and low-frequency (LF) compositions. Then, we extract content features (X_{L_c}) and latent texture features (X_{L_t}) from the LF part, as well as HF embeddings (X_{H_f}) from the HF part. Further, we feed X_{L_t} and X_{H_f} into a modified transformer with three encoders and decoders to obtain well-refined HF texture features. After that, we combine these well-refined HF texture features with the pre-extracted X_{L_c} to encourage the restoration of high-quality LDCT images with the assistance of piecewise reconstruction. Extensive experiments on Mayo LDCT dataset show that our method produces superior results and outperforms other methods.

eess.IV↗

arXiv2021

A Geometry-Informed Deep Learning Framework for Ultra-Sparse 3D Tomographic Image Reconstruction

Deep learning affords enormous opportunities to augment the armamentarium of biomedical imaging, albeit its design and implementation have potential flaws. Fundamentally, most deep learning models are driven entirely by data without consideration of any prior knowledge, which dramatically increases the complexity of neural networks and limits the application scope and model generalizability. Here we establish a geometry-informed deep learning framework for ultra-sparse 3D tomographic image reconstruction. We introduce a novel mechanism for integrating geometric priors of the imaging system. We demonstrate that the seamless inclusion of known priors is essential to enhance the performance of 3D volumetric computed tomography imaging with ultra-sparse sampling. The study opens new avenues for data-driven biomedical imaging and promises to provide substantially improved imaging tools for various clinical imaging and image-guided interventions.

cs.CV↗

arXiv2021

A Distributionally Robust Optimization Method for Adversarial Multiple Kernel Learning

We propose a novel data-driven method to learn a mixture of multiple kernels with random features that is certifiabaly robust against adverserial inputs. Specifically, we consider a distributionally robust optimization of the kernel-target alignment with respect to the distribution of training samples over a distributional ball defined by the Kullback-Leibler (KL) divergence. The distributionally robust optimization problem can be recast as a min-max optimization whose objective function includes a log-sum term. We develop a mini-batch biased stochastic primal-dual proximal method to solve the min-max optimization. To debias the minibatch algorithm, we use the Gumbel perturbation technique to estimate the log-sum term. We establish theoretical guarantees for the performance of the proposed multiple kernel learning method. In particular, we prove the consistency, asymptotic normality, stochastic equicontinuity, and the minimax rate of the empirical estimators. In addition, based on the notion of Rademacher and Gaussian complexities, we establish distributionally robust generalization bounds that are tighter than previous known bounds. More specifically, we leverage matrix concentration inequalities to establish distributionally robust generalization bounds. We validate our kernel learning approach for classification with the kernel SVMs on synthetic dataset generated by sampling multvariate Gaussian distributions with differernt variance structures. We also apply our kernel learning approach to the MNIST data-set and evaluate its robustness to perturbation of input images under different adversarial models. More specifically, we examine the robustness of the proposed kernel model selection technique against FGSM, PGM, C\&W, and DDN adversarial perturbations, and compare its performance with alternative state-of-the-art multiple kernel learning paradigms.

cs.LG↗

arXiv2021

Fully Automated Noncoplanar Radiation Therapy Treatment Planning

Noncoplanar radiation therapy treatment planning has the potential to improve dosimetric quality as compared to traditional coplanar techniques. Likewise, automated treatment planning algorithms can reduce a planner's active treatment planning time and remove inter-planner variability. To address the limitations of traditional treatment planning, we have been developing a suite of algorithms called station parameter optimized radiation therapy (SPORT). Within the SPORT suite of algorithms, we propose a method called NC-POPS to produce noncoplanar (NC) plans using the fully automated Pareto Optimal Projection Search (POPS) algorithm. Our NC-POPS algorithm extends the original POPS algorithm to the noncoplanar setting with potential applications to both IMRT and VMAT. The proposed algorithm consists of two main parts: 1) noncoplanar beam angle optimization (BAO) and 2) fully automated inverse planning using the POPS algorithm. We evaluate the performance of NC-POPS by comparing between various noncoplanar and coplanar configurations. To evaluate plan quality, we compute the homogeneity index (HI), conformity index (CI), and dose-volume histogram (DVH) statistics for various organs-at-risk (OARs). As compared to the evaluated coplanar baseline methods, the proposed NC-POPS method achieves significantly better OAR sparing, comparable or better dose conformity, and similar dose homogeneity. Our proposed NC-POPS algorithm provides a modular approach for fully automated treatment planning of noncoplanar IMRT cases with the potential to substantially improve treatment planning workflow and plan quality.

physics.med-ph↗

arXiv2021

Liquid Reconfigurable Stealth Window Constructed by Metamaterial Absorber

In this paper, a liquid reconfigurable stealth window constructed by metamaterial absorber at microwave band is proposed. The stealth window consists of an anti-reflection glass with indium tin oxide (ITO) as resistive film and a liquid container made of polymethyl methacrylate (PMMA). Since the materials constituting the window are all transparent, the metamaterials that can be switched through the liquid control system can always maintain high light transmission. The proposal can obtain a transmission passband from 2.3 GHz to 5 GHz with low insertion loss, especially at 2.45 GHz and 5 GHz with the insertion loss of the passband reach 0.51 and 0.99 , by alcohol drainage. It can also reflect electromagnetic waves at 2.45 GHz and absorb them from 4.5 GHz to 10.5 GHz with a strong absorptivity over 90% by alcohol injection, exhibiting the reconfigurable electromagnetic characteristic of switching between transmission state and absorption state. Furthermore, the proposed absorber shows its good transmission/absorption performance under different polarizations and obtains absorptivity over 90% when alcohol injection in an oblique incidence of 50°. Finally, the prototype window has been fabricated to demonstrate the validity of the proposed structure, which indicates that the proposal presents significant implications for smart stealth systems and WLAN communication that require switching of working states in a complex electromagnetic environment.

physics.app-ph↗

arXiv2021

Pareto Optimal Projection Search (POPS): Automated Radiation Therapy Treatment Planning by Direct Search of the Pareto Surface

Objective: Radiation therapy treatment planning is a time-consuming, iterative process with potentially high inter-planner variability. Fully automated treatment planning processes could reduce a planner's active treatment planning time and remove inter-planner variability, with the potential to tremendously improve patient turnover and quality of care. In developing fully automated algorithms for treatment planning, we have two main objectives: to produce plans that are 1) Pareto optimal and 2) clinically acceptable. Here, we propose the Pareto optimal projection search (POPS) algorithm, which provides a general framework for directly searching the Pareto front. Methods: Our POPS algorithm is a novel automated planning method that combines two main search processes: 1) gradient-free search in the decision variable space and 2) projection of decision variables to the Pareto front using the bisection method. We demonstrate the performance of POPS by comparing with clinical treatment plans. As one possible quantitative measure of treatment plan quality, we construct a clinical acceptability scoring function (SF) modified from the previously developed general evaluation metric (GEM). Results: On a dataset of 21 prostate cases collected as part of clinical workflow, our proposed POPS algorithm produces Pareto optimal plans that are clinically acceptable in regards to dose conformity, dose homogeneity, and sparing of organs-at-risk. Conclusion: Our proposed POPS algorithm provides a general framework for fully automated treatment planning that achieves clinically acceptable dosimetric quality without requiring active planning from human planners. Significance: Our fully automated POPS algorithm addresses many key limitations of other automated planning approaches, and we anticipate that it will substantially improve treatment planning workflow.

physics.med-ph↗

arXiv2021

Atmosphere escape inferred from modelling the H$α$ transmission spectrum of WASP-121b

The escaping atmospheres of hydrogen driven by stellar X-ray and extreme Ultraviolet (XUV) have been detected around some exoplanets by the excess absorption of Ly$α$ in far ultraviolet band. In the optical band the excess absorption of H$α$ is also found by the ground-based instruments. However, it is not certain so far if the escape of the atmosphere driven by XUV can result in such absorption. Here we present the XUV driven hydrodynamic simulation coupled with the calculation of detailed level population and the process of radiative transfer for WASP-121b. Our fiducial model predicts a mass loss rate of $\sim$1.28$\times$10$^{12}$g/s for WASP-121b. Due to the high temperature and Ly$α$ intensity predicted by the fiducial model, many hydrogen atoms are populated into the first excited state. As a consequence, the transmission spectrum of H$α$ simulated by our model is broadly consistent with the observation. Comparing with the absorption of H$α$ at different observation times, the stellar XUV emission varies in the range of 0.5-1.5 times fiducial value, which may reflect the variation of the stellar activity. Finally, we find that the supersonic regions of the planetary wind contribute a prominent portion to the absorption of H$α$ by comparing the equivalent width of H$α$, which hints that a transonic outflow of the upper atmosphere driven by XUV irradiation of the host star can be detected by the ground-based telescope and the H$α$ can be a good indicator of escaping atmosphere.

astro-ph.EP↗