Searcharxiv⌕ Search

arXiv subjects

Liang Zhang

Publications and source records attributed to Liang Zhang.

At least 361 records · Page 20Linked to original sources

MeSIN: Multilevel Selective and Interactive Network for Medication Recommendation

Recommending medications for patients using electronic health records (EHRs) is a crucial data mining task for an intelligent healthcare system. It can assist doctors in making clinical decisions more efficiently. However, the inherent complexity of the EHR data renders it as a challenging task: (1) Multilevel structures: the EHR data typically contains multilevel structures which are closely related with the decision-making pathways, e.g., laboratory results lead to disease diagnoses, and then contribute to the prescribed medications; (2) Multiple sequences interactions: multiple sequences in EHR data are usually closely correlated with each other; (3) Abundant noise: lots of task-unrelated features or noise information within EHR data generally result in suboptimal performance. To tackle the above challenges, we propose a multilevel selective and interactive network (MeSIN) for medication recommendation. Specifically, MeSIN is designed with three components. First, an attentional selective module (ASM) is applied to assign flexible attention scores to different medical codes embeddings by their relevance to the recommended medications in every admission. Second, we incorporate a novel interactive long-short term memory network (InLSTM) to reinforce the interactions of multilevel medical sequences in EHR data with the help of the calibrated memory-augmented cell and an enhanced input gate. Finally, we employ a global selective fusion module (GSFM) to infuse the multi-sourced information embeddings into final patient representations for medications recommendation. To validate our method, extensive experiments have been conducted on a real-world clinical dataset. The results demonstrate a consistent superiority of our framework over several baselines and testify the effectiveness of our proposed approach.

cs.AI↗

Free-form Description Guided 3D Visual Graph Network for Object Grounding in Point Cloud

3D object grounding aims to locate the most relevant target object in a raw point cloud scene based on a free-form language description. Understanding complex and diverse descriptions, and lifting them directly to a point cloud is a new and challenging topic due to the irregular and sparse nature of point clouds. There are three main challenges in 3D object grounding: to find the main focus in the complex and diverse description; to understand the point cloud scene; and to locate the target object. In this paper, we address all three challenges. Firstly, we propose a language scene graph module to capture the rich structure and long-distance phrase correlations. Secondly, we introduce a multi-level 3D proposal relation graph module to extract the object-object and object-scene co-occurrence relationships, and strengthen the visual features of the initial proposals. Lastly, we develop a description guided 3D visual graph module to encode global contexts of phrases and proposals by a nodes matching strategy. Extensive experiments on challenging benchmark datasets (ScanRefer and Nr3D) show that our algorithm outperforms existing state-of-the-art. Our code is available at https://github.com/PNXD/FFL-3DOG.

cs.CV↗

Parasitic modes suppression in CW cold tests of 1.3 GHz 9-cell high Q cavities at IHEP

The CW RF test of 1.3 GHz 9-cell cavity in liquid helium bath at 2 K is a very important key point in the cavity procurement. Some problems can be found through the test, according which to optimized and improve the process of cavity. Recently, Medium temperature (mid-T) furnace bake of 1.3 GHz 9-cell cavities have been carried out at IHEP. Through the proceed of mid-T bake, the quality factor of cavity has been greatly improved. While the excitation of the parasitic modes in the high Q cavities CW cold test has been encountered, which implies an error source for the cavity gradient and quality factor determination. In order to ensure the testing accuracy of superconducting cavity, we have improved the testing system. Finally, the parasitic mode is completely suppressed and the CW RF cold test of high Q cavity is guaranteed.

physics.acc-ph↗

A variable corona for GRS 1915+105

Most models of the low frequency quasi periodic oscillations (QPOs) in low-mass X-ray binaries (LMXBs) explain the dynamical properties of those QPOs. On the other hand, in recent years reverberation models that assume a lamp-post geometry have been successfull in explaining the energy-dependent time lags of the broad-band noise component in stellar mass black-holes and active galactic nuclei. We have recently shown that Comptonisation can explain the spectral-timing properties of the kilo-hertz (kHz) QPOs observed in neutron star (NS) LMXBs. It is therefore worth exploring whether the same family of models would be as successful in explaining the low-frequency QPOs. In this work, we use a Comptonisation model to study the frequency dependence of the phase lags of the type-C QPO in the BH LMXB GRS 1915+105. The phase lags of the QPO in GRS 1915+105 make a transition from hard to soft at a QPO frequency of around 1.8 Hz. Our model shows that at high QPO frequencies a large corona of ~ 100-150 R_g covers most of the accretion disc and makes it 100% feedback dominated, thus producing soft lags. As the observed QPO frequency decreases, the corona gradually shrinks down to around 3-17 R_g, and at 1.8 Hz feedback onto the disc becomes inefficient leading to hard lags. We discuss how changes in the accretion geometry affect the timing properties of the type-C QPO.

astro-ph.HE↗

A two-component Comptonisation model for the type-B QPO in MAXI J1348-630

Spectral-timing analysis of the fast variability observed in X-rays is a powerful tool to study the physical and geometrical properties of the accretion/ejection flows in black-hole binaries. The origin of type-B quasi-periodic oscillations (QPO), predominantly observed in black-hole candidates in the soft-intermediate state, has been linked to emission arising from the relativistic jet. In this state, the X-ray spectrum is characterised by a soft-thermal blackbody-like emission due to the accretion disc, an iron emission line (in the 6-7 keV range), and a power-law like hard component due to Inverse-Compton scattering of the soft-photon source by hot electrons in a corona or the relativistic jet itself. The spectral-timing properties of MAXI J1348-630 have been recently studied using observations obtained with the NICER observatory. The data show a strong type-B QPO at ~4.5 Hz with increasing fractional rms amplitude with energy and positive lags with respect to a reference band at 2-2.5 keV. We use a variable-Comptonisation model that assumes a sinusoidal coherent oscillation of the Comptonised X-ray flux and the physical parameters of the corona at the QPO frequency, to fit simultaneously the energy-dependent fractional rms amplitude and phase lags of this QPO. We show that two physically-connected Comptonisation regions can successfully explain the radiative properties of the QPO in the full 0.8-10 keV energy range.

astro-ph.HE↗

Smoothed Gaussian Mixture Models for Video Classification and Recommendation

Cluster-and-aggregate techniques such as Vector of Locally Aggregated Descriptors (VLAD), and their end-to-end discriminatively trained equivalents like NetVLAD have recently been popular for video classification and action recognition tasks. These techniques operate by assigning video frames to clusters and then representing the video by aggregating residuals of frames with respect to the mean of each cluster. Since some clusters may see very little video-specific data, these features can be noisy. In this paper, we propose a new cluster-and-aggregate method which we call smoothed Gaussian mixture model (SGMM), and its end-to-end discriminatively trained equivalent, which we call deep smoothed Gaussian mixture model (DSGMM). SGMM represents each video by the parameters of a Gaussian mixture model (GMM) trained for that video. Low-count clusters are addressed by smoothing the video-specific estimates with a universal background model (UBM) trained on a large number of videos. The primary benefit of SGMM over VLAD is smoothing which makes it less sensitive to small number of training samples. We show, through extensive experiments on the YouTube-8M classification task, that SGMM/DSGMM is consistently better than VLAD/NetVLAD by a small but statistically significant margin. We also show results using a dataset created at LinkedIn to predict if a member will watch an uploaded video.

cs.CV↗

More Industry-friendly: Federated Learning with High Efficient Design

Although many achievements have been made since Google threw out the paradigm of federated learning (FL), there still exists much room for researchers to optimize its efficiency. In this paper, we propose a high efficient FL method equipped with the double head design aiming for personalization optimization over non-IID dataset, and the gradual model sharing design for communication saving. Experimental results show that, our method has more stable accuracy performance and better communication efficient across various data distributions than other state of art methods (SOTAs), makes it more industry-friendly.

cs.LG↗

Medium-temperature furnace bake of Superconducting Radio-Frequency cavities at IHEP

Recently, heat treatment between 250 C and 500 C has been attempted to improve quality factor of superconducting radio-frequency cavities at FNAL and KEK. Experiments of such medium temperature (mid-T) bake with furnaces have also been carried out at IHEP. Firstly, eleven 1.3 GHz 1-cell cavities were treated with different temperatures at a small furnace. The average quality factor has reached 3.6E10 when the gradient is 16 MV/m. Then, the recipe of mid-T furnace bake at 300 C for 3 hours has been applied to six 1.3 GHz 9-cell cavities at a new big furnace. The average quality factor has reached 3.8E10 when the gradient is 16 MV/m.

physics.acc-ph↗

HMFlow: Hybrid Matching Optical Flow Network for Small and Fast-Moving Objects

In optical flow estimation task, coarse-to-fine (C2F) warping strategy is widely used to deal with the large displacement problem and provides efficiency and speed. However, limited by the small search range between the first images and warped second images, current coarse-to-fine optical flow networks fail to capture small and fast-moving objects which disappear at coarse resolution levels. To address this problem, we introduce a lightweight but effective Global Matching Component (GMC) to grab global matching features. We propose a new Hybrid Matching Optical Flow Network (HMFlow) by integrating GMC into existing coarse-to-fine networks seamlessly. Besides keeping in high accuracy and small model size, our proposed HMFlow can apply global matching features to guide the network to discover the small and fast-moving objects mismatched by local matching features. We also build a new dataset, named Small and Fast-Moving Chairs (SFChairs), for evaluation. The experimental results show that our proposed network achieves considerable performance, especially at regions with small and fast-moving objects.

cs.CV↗

The Internet-of-Things Meets Business Process Management: A Manifesto

The Internet of Things (IoT) refers to a network of connected devices collecting and exchanging data over the Internet. These things can be artificial or natural, and interact as autonomous agents forming a complex system. In turn, Business Process Management (BPM) was established to analyze, discover, design, implement, execute, monitor and evolve collaborative business processes within and across organizations. While the IoT and BPM have been regarded as separate topics in research and practice, we strongly believe that the management of IoT applications will strongly benefit from BPM concepts, methods and technologies on the one hand; on the other one, the IoT poses challenges that will require enhancements and extensions of the current state-of-the-art in the BPM field. In this paper, we question to what extent these two paradigms can be combined and we discuss the emerging challenges.

cs.CY↗

Chiral state conversion in a levitated micromechanical oscillator with in situ control of parameter loops

Physical systems with gain and loss can be described by a non-Hermitian Hamiltonian, which is degenerated at the exceptional points (EPs). Many new and unexpected features have been explored in the non-Hermitian systems with a great deal of recent interest. One of the most fascinating features is that, chiral state conversion appears when one EP is encircled dynamically. Here, we propose an easy-controllable levitated microparticle system that carries a pair of EPs and realize slow evolution of the Hamiltonian along loops in the parameter plane. Utilizing the controllable rotation angle, gain and loss coefficients, we can control the structure, size and location of the loops in situ. We demonstrate that, under the joint action of topological structure of energy surfaces and nonadiabatic transitions (NATs), the chiral behavior emerges both along a loop encircling an EP and even along a straight path away from the EP. This work broadens the range of parameter space for the chiral state conversion, and proposes a useful platform to explore the interesting properties of exceptional points physics.

quant-ph↗

How does Weight Correlation Affect the Generalisation Ability of Deep Neural Networks

This paper studies the novel concept of weight correlation in deep neural networks and discusses its impact on the networks' generalisation ability. For fully-connected layers, the weight correlation is defined as the average cosine similarity between weight vectors of neurons, and for convolutional layers, the weight correlation is defined as the cosine similarity between filter matrices. Theoretically, we show that, weight correlation can, and should, be incorporated into the PAC Bayesian framework for the generalisation of neural networks, and the resulting generalisation bound is monotonic with respect to the weight correlation. We formulate a new complexity measure, which lifts the PAC Bayes measure with weight correlation, and experimentally confirm that it is able to rank the generalisation errors of a set of networks more precisely than existing measures. More importantly, we develop a new regulariser for training, and provide extensive experiments that show that the generalisation error can be greatly reduced with our novel approach.

cs.LG↗

Recommendation with Attribute-aware Product Networks: A Representation Learning Model

With the prosperity of business intelligence, recommender systems have evolved into a new stage that we not only care about what to recommend, but why it is recommended. Explainability of recommendations thus emerges as a focal point of research and becomes extremely desired in e-commerce. Existent studies along this line often exploit item attributes and correlations from different perspectives, but they yet lack an effective way to combine both types of information for deep learning of personalized interests. In light of this, we propose a novel graph structure, \emph{attribute network}, based on both items' co-purchase network and important attributes. A novel neural model called \emph{eRAN} is then proposed to generate recommendations from attribute networks with explainability and cold-start capability. Specifically, eRAN first maps items connected in attribute networks to low-dimensional embedding vectors through a deep autoencoder, and then an attention mechanism is applied to model the attractions of attributes to users, from which personalized item representation can be derived. Moreover, a pairwise ranking loss is constructed into eRAN to improve recommendations, with the assumption that item pairs co-purchased by a user should be more similar than those non-paired with negative sampling in personalized view. Experiments on real-world datasets demonstrate the effectiveness of our method compared with some state-of-the-art competitors. In particular, eRAN shows its unique abilities in recommending cold-start items with higher accuracy, as well as in understanding user preferences underlying complicated co-purchasing behaviors.

cs.IR↗

Discovery of oscillations above 200 keV in a black hole X-ray binary with Insight-HXMT

Low-frequency quasi-periodic oscillations (LFQPOs) are commonly found in black hole X-ray binaries, and their origin is still under debate. The properties of LFQPOs at high energies (above 30 keV) are closely related to the nature of the accretion flow in the innermost regions, and thus play a crucial role in critically testing various theoretical models. The Hard X-ray Modulation Telescope (Insight-HXMT) is capable of detecting emissions above 30 keV, and is therefore an ideal instrument to do so. Here we report the discovery of LFQPOs above 200 keV in the new black hole MAXI J1820+070 in the X-ray hard state, which allows us to understand the behaviours of LFQPOs at hundreds of kiloelectronvolts. The phase lag of the LFQPO is constant around zero below 30 keV, and becomes a soft lag (that is, the high-energy photons arrive first) above 30 keV. The soft lag gradually increases with energy and reaches ~0.9s in the 150-200 keV band. The detection at energies above 200 keV, the large soft lag and the energy-related behaviors of the LFQPO pose a great challenge for most currently existing models, but suggest that the LFQPO probably originates from the precession of a small-scale jet.

astro-ph.HE↗

Perfect coherent transfer in an on-chip reconfigurable nanoelectromechanical network

Realizing a controllable network with multiple degrees of interaction is a challenge to physics and engineering. Here, we experimentally report an on-chip reconfigurable network based on nanoelectromechanical resonators with nearest-neighbor (NN) and next-nearest-neighbor (NNN) strong couplings. By applying different parametric voltages on the same on-chip device, we carry out perfect coherent transfer in NN and NNN coupled array networks. Moreover, the low-loss resonators ensure the desired evolution to achieve perfect transfer and the demonstration of the parity-dependent phase relation at transmission cycles. The realization of NNN couplings demonstrates the capability of engineering coherent coupling beyond a simple model of a NN coupled array of doubly clamped resonators. Our reconfigurable nanoelectromechanical network provides a highly tunable physical platform and offers the possibilities of investigating various interesting phenomena, such as topological transport, synchronization of networks, as well as metamaterials.

quant-ph↗

Realization of programmable nanomechanical lattice with both nearest-neighboring and next-nearest-neighboring couplings

The programmable artificial lattice, based on the controllability of coupling strengths and the scalability of multiple sites, is desperately desired in engineering metamaterials and exploring fundamental physics. In this work, we experimentally present a programmable lattice consisting of multiple paralleled nanomechanical resonators, whose internal interactions can be linearly manipulated by external voltages. Flexural modes of nearest-neighboring (NN) and next-nearest-neighboring (NNN) resonators are parametrically coupled through modulated electrostatic interactions. Particularly, in a wide range up to deep strong coupling regime, both the NN and NNN coupling strengths are precisely proportional to manipulation voltage. The realization of long-range coupling provides a promising prospect in constructing complex lattice structure, which is essential in investigating mechanical logic devices, topological physics and coherent phononic dynamics.

physics.app-ph↗

DeText: A Deep Text Ranking Framework with BERT

Ranking is the most important component in a search system. Mostsearch systems deal with large amounts of natural language data,hence an effective ranking system requires a deep understandingof text semantics. Recently, deep learning based natural languageprocessing (deep NLP) models have generated promising results onranking systems. BERT is one of the most successful models thatlearn contextual embedding, which has been applied to capturecomplex query-document relations for search ranking. However,this is generally done by exhaustively interacting each query wordwith each document word, which is inefficient for online servingin search product systems. In this paper, we investigate how tobuild an efficient BERT-based ranking model for industry use cases.The solution is further extended to a general ranking framework,DeText, that is open sourced and can be applied to various rankingproductions. Offline and online experiments of DeText on threereal-world search systems present significant improvement overstate-of-the-art approaches.

cs.IR↗

MeDaS: An open-source platform as service to help break the walls between medicine and informatics

In the past decade, deep learning (DL) has achieved unprecedented success in numerous fields including computer vision, natural language processing, and healthcare. In particular, DL is experiencing an increasing development in applications for advanced medical image analysis in terms of analysis, segmentation, classification, and furthermore. On the one hand, tremendous needs that leverage the power of DL for medical image analysis are arising from the research community of a medical, clinical, and informatics background to jointly share their expertise, knowledge, skills, and experience. On the other hand, barriers between disciplines are on the road for them often hampering a full and efficient collaboration. To this end, we propose our novel open-source platform, i.e., MeDaS -- the MeDical open-source platform as Service. To the best of our knowledge, MeDaS is the first open-source platform proving a collaborative and interactive service for researchers from a medical background easily using DL related toolkits, and at the same time for scientists or engineers from information sciences to understand the medical knowledge side. Based on a series of toolkits and utilities from the idea of RINV (Rapid Implementation aNd Verification), our proposed MeDaS platform can implement pre-processing, post-processing, augmentation, visualization, and other phases needed in medical image analysis. Five tasks including the subjects of lung, liver, brain, chest, and pathology, are validated and demonstrated to be efficiently realisable by using MeDaS.

cs.CV↗