arXiv subjects

Rui Zhang

Publications and source records attributed to Rui Zhang.

At least 973 records · Page 54Linked to original sources

arXiv2021

Extracting Lifestyle Factors for Alzheimer's Disease from Clinical Notes Using Deep Learning with Weak Supervision

Since no effective therapies exist for Alzheimer's disease (AD), prevention has become more critical through lifestyle factor changes and interventions. Analyzing electronic health records (EHR) of patients with AD can help us better understand lifestyle's effect on AD. However, lifestyle information is typically stored in clinical narratives. Thus, the objective of the study was to demonstrate the feasibility of natural language processing (NLP) models to classify lifestyle factors (e.g., physical activity and excessive diet) from clinical texts. We automatically generated labels for the training data by using a rule-based NLP algorithm. We conducted weak supervision for pre-trained Bidirectional Encoder Representations from Transformers (BERT) models on the weakly labeled training corpus. These models include the BERT base model, PubMedBERT(abstracts + full text), PubMedBERT(only abstracts), Unified Medical Language System (UMLS) BERT, Bio BERT, and Bio-clinical BERT. We performed two case studies: physical activity and excessive diet, in order to validate the effectiveness of BERT models in classifying lifestyle factors for AD. These models were compared on the developed Gold Standard Corpus (GSC) on the two case studies. The PubmedBERT(Abs) model achieved the best performance for physical activity, with its precision, recall, and F-1 scores of 0.96, 0.96, and 0.96, respectively. Regarding classifying excessive diet, the Bio BERT model showed the highest performance with perfect precision, recall, and F-1 scores. The proposed approach leveraging weak supervision could significantly increase the sample size, which is required for training the deep learning models. The study also demonstrates the effectiveness of BERT models for extracting lifestyle factors for Alzheimer's disease from clinical notes.

cs.CL↗

arXiv2021

HexCNN: A Framework for Native Hexagonal Convolutional Neural Networks

Hexagonal CNN models have shown superior performance in applications such as IACT data analysis and aerial scene classification due to their better rotation symmetry and reduced anisotropy. In order to realize hexagonal processing, existing studies mainly use the ZeroOut method to imitate hexagonal processing, which causes substantial memory and computation overheads. We address this deficiency with a novel native hexagonal CNN framework named HexCNN. HexCNN takes hexagon-shaped input and performs forward and backward propagation on the original form of the input based on hexagon-shaped filters, hence avoiding computation and memory overheads caused by imitation. For applications with rectangle-shaped input but require hexagonal processing, HexCNN can be applied by padding the input into hexagon-shape as preprocessing. In this case, we show that the time and space efficiency of HexCNN still outperforms existing hexagonal CNN methods substantially. Experimental results show that compared with the state-of-the-art models, which imitate hexagonal processing but using rectangle-shaped filters, HexCNN reduces the training time by up to 42.2%. Meanwhile, HexCNN saves the memory space cost by up to 25% and 41.7% for loading the input and performing convolution, respectively.

cs.CV↗

arXiv2021

INSQ: An Influential Neighbor Set Based Moving kNN Query Processing System

We revisit the moving k nearest neighbor (MkNN) query, which computes one's k nearest neighbor set and maintains it while at move. Existing MkNN algorithms are mostly safe region based, which lack efficiency due to either computing small safe regions with a high recomputation frequency or computing larger safe regions but with a high cost for each computation. In this demonstration, we showcase a system named INSQ that adopts a novel algorithm called the Influential Neighbor Set (INS) algorithm to process the MkNN query in both two-dimensional Euclidean space and road networks. This algorithm uses a small set of safe guarding objects instead of safe regions. As long as the the current k nearest neighbors are closer to the query object than the safe guarding objects are, the current k nearest neighbors stay valid and no recomputation is required. Meanwhile, the region defined by the safe guarding objects is the largest possible safe region. This means that the recomputation frequency is also minimized and hence, the INS algorithm achieves high overall query processing efficiency.

cs.DB↗

arXiv2021

Aerial-Ground Interference Mitigation for Cellular-Connected UAV

To support large-scale deployment of unmanned aerial vehicles (UAVs) in future, a new wireless communication paradigm, namely, cellular-connected UAV, has recently received an upsurge of interests in both academia and industry. Specifically, cellular base stations (BSs) and spectrum are reused to serve UAVs as new aerial user equipments (UEs) for meeting their communication requirements. However, compared to traditional terrestrial UEs, the high altitude of UAVs results in more frequent line-of-sight (LoS) channels with both their associated and non-associated BSs in a much wider area, which causes stronger aerial-ground interference to both UAVs and terrestrial UEs. As such, conventional techniques designed for mitigating the terrestrial interference become ineffective in coping with the new and more severe UAV-terrestrial interference. To tackle this challenge, we propose in this article new interference mitigation solutions for achieving spectral efficient operation of the cellular network with co-existing UAVs and terrestrial UEs. In particular, we exploit the powerful sensing capability of UAVs and inactive BSs in the network for interference mitigation/cancellation. Numerical results are presented to verify the efficacy of the proposed solutions and show their significant spectrum efficiency gains over terrestrial interference mitigation techniques.

cs.IT↗

arXiv2021

Analytically solvable model to the spin Hall effect with Rashba and Dresselhaus spin-orbit couplings

When the Rashba and Dresslhaus spin-orbit coupling are both presented for a two-dimensional electron in a perpendicular magnetic field, a striking resemblance to anisotropic quantum Rabi model in quantum optics is found. We perform a generalized Rashba coupling approximation to obtain a solvable Hamiltonian by keeping the nearest-mixing terms of Laudau states, which is reformulated in the similar form to that with only Rashba coupling. Each Landau state becomes a new displaced-Fock state with a displacement shift instead of the original Harmonic oscillator Fock state, yielding eigenstates in closed form. Analytical energies are consistent with numerical ones in a wide range of coupling strength even for a strong Zeeman splitting. In the presence of an electric field, the spin conductance and the charge conductance obtained analytically are in good agreements with the numerical results. As the component of the Dresselhaus coupling increases, we find that the spin Hall conductance exhibits a pronounced resonant peak at a larger value of the inverse of the magnetic field. Meanwhile, the charge conductance exhibits a series of plateaus as well as a jump at the resonant magnetic field. Our method provides an easy-to-implement analytical treatment to two-dimensional electron gas systems with both types of spin-orbit couplings.

cond-mat.quant-gas↗

arXiv2020

Refined Nonlinear Rectenna Modeling and Optimal Waveform Design for Multi-User Multi-Antenna Wireless Power Transfer

In this paper, we study the optimal waveform design for wireless power transfer (WPT) from a multi-antenna energy transmitter (ET) to multiple single-antenna energy receivers (ERs) simultaneously in multi-path frequency-selective channels. First, we propose a refined nonlinear current-voltage model of the diode in the ER rectifier, and accordingly derive new expressions for the output direct current (DC) voltage and corresponding harvested power at the ER. Leveraging this new rectenna model, we first consider the single-ER case and study the multisine-based power waveform design based on the wireless channel to maximize the harvested power at the ER. We propose two efficient algorithms for finding high-quality suboptimal solutions to this non-convex optimization problem. Next, we extend our formulated waveform design problem to the general multi-ER case for maximizing the weighted sum of the harvested powers by all ERs, and propose an efficient difference-of-convex functions programming (DCP)-based algorithm for solving this problem. Finally, we demonstrate the superior performance of our proposed waveform designs based on the new rectenna model over existing schemes/models via simulations.

cs.IT↗

arXiv2020

Compressive Circular Polarization Snapshot Spectral Imaging

A compressive sensing based circular polarization snapshot spectral imaging system is proposed in this paper to acquire two-dimensional spatial, one-dimensional circular polarization (the right and left circular polarization), and one-dimensional spectral information, simultaneously. Using snapshot can collect the entire four-dimensional datacube in a single integration period. The dispersion prism in the coded aperture snapshot spectral imager is replaced by the combination of an Amici prism and a Wollaston prism to implement the spectral shifting along two orthogonal directions, which greatly improves the spectral resolution of the image. The right and left circular polarization components of objects are extracted by the assemble with an achromatic quarter wave-plate and a Wollaston prism. The encoding and reconstruction are illustrated comprehensively. The feasibility is verified by the simulation. It provides us an alternative approach for circular polarization spectral imaging such as defogging, underwater imaging, and so on.

physics.optics↗

arXiv2020

Intelligent Reflecting Surface Aided Full-Duplex Communication: Passive Beamforming and Deployment Design

This paper investigates the passive beamforming and deployment design for an intelligent reflecting surface (IRS) aided full-duplex (FD) wireless system, where an FD access point (AP) communicates with an uplink (UL) user and a downlink (DL) user simultaneously over the same time-frequency dimension with the help of IRS. Under this setup, we consider three deployment cases: 1) two distributed IRSs placed near the UL user and DL user, respectively; 2) one centralized IRS placed near the DL user; 3) one centralized IRS placed near the UL user. In each case, we aim to minimize the weighted sum transmit power consumption of the AP and UL user by jointly optimizing their transmit power and the passive reflection coefficients at the IRS (or IRSs), subject to the UL and DL users' rate constraints and the uni-modulus constraints on the IRS reflection coefficients. First, we analyze the minimum transmit power required in the IRS-aided FD system under each deployment scheme, and compare it with that of the corresponding half-duplex (HD) system. We show that the FD system outperforms its HD counterpart for all IRS deployment schemes, while the distributed deployment further outperforms the other two centralized deployment schemes. Next, we transform the challenging power minimization problem into an equivalent but more tractable form and propose an efficient algorithm to solve it based on the block coordinate descent (BCD) method. Finally, numerical results are presented to validate our analysis as well as the efficacy of the proposed passive beamforming design.

cs.IT↗

arXiv2020

Radio Map Based 3D Path Planning for Cellular-Connected UAV

In this paper, we study the three-dimensional (3D) path planning for a cellular-connected unmanned aerial vehicle (UAV) to minimize its flying distance from given initial to final locations, while ensuring a target link quality in terms of the expected signal-to-interference-plus-noise ratio (SINR) at the UAV receiver with each of its associated ground base stations (GBSs) during the flight. To exploit the location-dependent and spatially varying channel as well as interference over the 3D space, we propose a new radio map based path planning framework for the UAV. Specifically, we consider the channel gain map of each GBS that provides its large-scale channel gains with uniformly sampled locations on a 3D grid, which are due to static and large-size obstacles (e.g., buildings) and thus assumed to be time-invariant. Based on the channel gain maps of GBSs as well as their loading factors, we then construct an SINR map that depicts the expected SINR levels over the sampled 3D locations. By leveraging the obtained SINR map, we proceed to derive the optimal UAV path by solving an equivalent shortest path problem (SPP) in graph theory. We further propose a grid quantization approach where the grid points in the SINR map are more coarsely sampled by exploiting the spatial channel/interference correlation over neighboring grids. Then, we solve an approximate SPP over the reduced-size SINR map (graph) with reduced complexity. Numerical results show that the proposed solution can effectively minimize the flying distance/time of the UAV subject to its communication quality constraint, and a flexible trade-off between performance and complexity can be achieved by adjusting the grid quantization ratio in the SINR map. Moreover, the proposed solution significantly outperforms various benchmark schemes without fully exploiting the channel/interference spatial distribution in the network.

cs.IT↗

arXiv2020

Scene Text Detection with Scribble Lines

Scene text detection, which is one of the most popular topics in both academia and industry, can achieve remarkable performance with sufficient training data. However, the annotation costs of scene text detection are huge with traditional labeling methods due to the various shapes of texts. Thus, it is practical and insightful to study simpler labeling methods without harming the detection performance. In this paper, we propose to annotate the texts by scribble lines instead of polygons for text detection. It is a general labeling method for texts with various shapes and requires low labeling costs. Furthermore, a weakly-supervised scene text detection framework is proposed to use the scribble lines for text detection. The experiments on several benchmarks show that the proposed method bridges the performance gap between the weakly labeling method and the original polygon-based labeling methods, with even better performance. We will release the weak annotations of the benchmarks in our experiments and hope it will benefit the field of scene text detection to achieve better performance with simpler annotations.

cs.CV↗

arXiv2020

Magnetic order and fluctuations in quasi-two-dimensional planar magnet Sr(Co$_{1-x}$Ni$_x$)$_2$As$_2$

We use neutron scattering to investigate spin excitations in Sr(Co$_{1-x}$Ni$_{x})_2$As$_2$, which has a $c$-axis incommensurate helical structure of the two-dimensional (2D) in-plane ferromagnetic (FM) ordered layers for $0.013\leq x \leq 0.25$. By comparing the wave vector and energy dependent spin excitations in helical ordered Sr(Co$_{0.9}$Ni$_{0.1}$)$_2$As$_2$ and paramagnetic SrCo$_2$As$_2$, we find that Ni-doping, while increasing lattice disorder in Sr(Co$_{1-x}$Ni$_{x})_2$As$_2$, enhances quasi-2D FM spin fluctuations. However, our band structure calculations within the combined density functional theory and dynamic mean field theory (DFT+DMFT) failed to generate a correct incommensurate wave vector for the observed helical order from nested Fermi surfaces. Since transport measurements reveal increased in-plane and $c$-axis electrical resistivity with increasing Ni-doping and associated lattice disorder, we conclude that the helical magnetic order in Sr(Co$_{1-x}$Ni$_{x})_2$As$_2$ may arise from a quantum order-by-disorder mechanism through the itinerant electron mediated Ruderman-Kittel-Kasuya-Yosida (RKKY) interactions.

cond-mat.str-el↗

arXiv2020

Lattice Nucleon Isovector Unpolarized Parton Distribution in the Physical-Continuum Limit

We present the first lattice-QCD calculation of the nucleon isovector unpolarized parton distribution functions (PDFs) at the physical-continuum limit using Large-Momentum Effective Theory (LaMET). The lattice results are calculated using ensembles with multiple sea pion masses with the lightest one around 135~MeV, 3 lattice spacings $a\in[0.06,0.12]$~fm, and multiple volumes with $M_πL$ ranging 3.3 to 5.5. We perform a simultaneous chiral-continuum extrapolation to obtain RI/MOM renormalized nucleon matrix elements with various Wilson-link displacements in the continuum limit at physical pion mass. Then, we apply one-loop perturbative matching to the quasi-PDFs to obtain the lightcone PDFs. We find the lattice-spacing dependence to be much larger than the dependence on pion mass and lattice volume for these LaMET matrix elements. Our physical-continuum limit unpolarized isovector nucleon PDFs are found to be consistent with global-PDF results.

hep-lat↗

arXiv2020

Aerial Intelligent Reflecting Surface: Joint Placement and Passive Beamforming Design with 3D Beam Flattening

This paper proposes a new three-dimensional (3D) wireless passive relaying system enabled by aerial IRS (AIRS). Compared to the conventional terrestrial IRS, AIRS enjoys more deployment flexibility as well as wider-range signal reflection, thanks to its high altitude and thus more likelihood of establishing line-of-sight (LoS) links with ground source/destination nodes. Specifically, we aim to maximize the worst-case signal-to-noise ratio (SNR) over all locations in a target area by jointly optimizing the transmit beamforming for the source node and the placement as well as 3D passive beamforming for the AIRS. The formulated problem is non-convex and thus difficult to solve. To gain useful insights, we first consider the special case of maximizing the SNR at a given target location, for which the optimal solution is obtained in closed-form. The result shows that the optimal horizontal AIRS placement only depends on the ratio between the source-destination distance and the AIRS altitude. Then for the general case of AIRS-enabled area coverage, we propose an efficient solution by decoupling the AIRS passive beamforming design to maximize the worst-case array gain, from its placement optimization by balancing the resulting angular span and the cascaded channel path loss. Our proposed solution is based on a novel 3D beam broadening and flattening technique, where the passive array of the AIRS is divided into sub-arrays of appropriate size, and their phase shifts are designed to form a flattened beam pattern with adjustable beamwidth catering to the size of the coverage area. Both the uniform linear array (ULA)-based and uniform planar array (UPA)-based AIRSs are considered in our design, which enable two-dimensional (2D) and 3D passive beamforming, respectively. Numerical results show that the proposed designs achieve significant performance gains over the benchmark schemes.

eess.SP↗

arXiv2020

Explainable Tensorized Neural Ordinary Differential Equations forArbitrary-step Time Series Prediction

We propose a continuous neural network architecture, termed Explainable Tensorized Neural Ordinary Differential Equations (ETN-ODE), for multi-step time series prediction at arbitrary time points. Unlike the existing approaches, which mainly handle univariate time series for multi-step prediction or multivariate time series for single-step prediction, ETN-ODE could model multivariate time series for arbitrary-step prediction. In addition, it enjoys a tandem attention, w.r.t. temporal attention and variable attention, being able to provide explainable insights into the data. Specifically, ETN-ODE combines an explainable Tensorized Gated Recurrent Unit (Tensorized GRU or TGRU) with Ordinary Differential Equations (ODE). The derivative of the latent states is parameterized with a neural network. This continuous-time ODE network enables a multi-step prediction at arbitrary time points. We quantitatively and qualitatively demonstrate the effectiveness and the interpretability of ETN-ODE on five different multi-step prediction tasks and one arbitrary-step prediction task. Extensive experiments show that ETN-ODE can lead to accurate predictions at arbitrary time points while attaining best performance against the baseline methods in standard multi-step time series prediction.

cs.LG↗

arXiv2020

Deep Learning Approaches for Extracting Adverse Events and Indications of Dietary Supplements from Clinical Text

The objective of our work is to demonstrate the feasibility of utilizing deep learning models to extract safety signals related to the use of dietary supplements (DS) in clinical text. Two tasks were performed in this study. For the named entity recognition (NER) task, Bi-LSTM-CRF (Bidirectional Long-Short-Term-Memory Conditional Random Fields) and BERT (Bidirectional Encoder Representations from Transformers) models were trained and compared with CRF model as a baseline to recognize the named entities of DS and Events from clinical notes. In the relation extraction (RE) task, two deep learning models, including attention-based Bi-LSTM and CNN (Convolutional Neural Network), and a random forest model were trained to extract the relations between DS and Events, which were categorized into three classes: positive (i.e., indication), negative (i.e., adverse events), and not related. The best performed NER and RE models were further applied on clinical notes mentioning 88 DS for discovering DS adverse events and indications, which were compared with a DS knowledge base. For the NER task, deep learning models achieved a better performance than CRF, with F1 scores above 0.860. The attention-based Bi-LSTM model performed the best in the relation extraction task, with the F1 score of 0.893. When comparing DS event pairs generated by the deep learning models with the knowledge base for DS and Event, we found both known and unknown pairs. Deep learning models can detect adverse events and indication of DS in clinical notes, which hold great potential for monitoring the safety of DS use.

cs.IR↗

arXiv2020

Cost-Effective Quasi-Parallel Sensing Instrumentation for Industrial Chemical Species Tomography

Chemical Species Tomography (CST) has been widely applied for imaging of critical gas-phase parameters in industrial processes. To acquire high-fidelity images, CST is typically implemented by line-of-sight Wavelength Modulation Spectroscopy (WMS) measurements from multiple laser beams. The modulated transmission signal on each laser beam needs to be a) digitised by a high-speed analogue-to-digital converter (ADC); b) demodulated by a digital lock-in (DLI) module; and c) transferred to high-level processor for image reconstruction. Although a fully parallel data acquisition (DAQ) and signal processing system can achieve these functionalities with maximised temporal response, it leads to a highly complex, expensive and power-consuming instrumentation system with high potential for inconsistency between the sampled beams due to the electronics alone. In addition, the huge amount of spectral data sampled in parallel significantly burdens the communication process in industrial applications where in situ signal digitisation is distanced from the high-level data processing. To address these issues, a quasi-parallel sensing technique and electronic circuits were developed for industrial CST, in which the digitisation and demodulation of the multi-beam transmission signals are multiplexed over the high-frequency modulation within a wavelength scan. Our development not only maintains the temporal response of the fully parallel sensing scheme, but also facilitates the cost-effective implementation of industrial CST with very low complexity and reduced load on data transfer. The proposed technique is analytically proven, numerically examined by noise-contaminated CST simulations, and experimentally validated using a lab-scale CST system with 32 laser beams.

eess.SY↗

arXiv2020

On characteristic rank for matrix and tensor completion

In this lecture note, we discuss a fundamental concept, referred to as the {\it characteristic rank}, which suggests a general framework for characterizing the basic properties of various low-dimensional models used in signal processing. Below, we illustrate this framework using two examples: matrix and three-way tensor completion problems, and consider basic properties include identifiability of a matrix or tensor, given partial observations. In this note, we consider cases without observation noise to illustrate the principle.

math.ST↗

arXiv2020

Goodness-of-fit tests on manifolds

We develop a general theory for the goodness-of-fit test to non-linear models. In particular, we assume that the observations are noisy samples of a submanifold defined by a \yao{sufficiently smooth non-linear map}. The observation noise is additive Gaussian. Our main result shows that the "residual" of the model fit, by solving a non-linear least-square problem, follows a (possibly noncentral) $χ^2$ distribution. The parameters of the $χ^2$ distribution are related to the model order and dimension of the problem. We further present a method to select the model orders sequentially. We demonstrate the broad application of the general theory in machine learning and signal processing, including determining the rank of low-rank (possibly complex-valued) matrices and tensors from noisy, partial, or indirect observations, determining the number of sources in signal demixing, and potential applications in determining the number of hidden nodes in neural networks.

stat.ML↗