arXiv subjects

Chen Li

Publications and source records attributed to Chen Li.

At least 505 records · Page 28Linked to original sources

arXiv2020

Effects of annotation granularity in deep learning models for histopathological images

Pathological is crucial to cancer diagnosis. Usually, Pathologists draw their conclusion based on observed cell and tissue structure on histology slides. Rapid development in machine learning, especially deep learning have established robust and accurate classifiers. They are being used to analyze histopathological slides and assist pathologists in diagnosis. Most machine learning systems rely heavily on annotated data sets to gain experiences and knowledge to correctly and accurately perform various tasks such as classification and segmentation. This work investigates different granularity of annotations in histopathological data set including image-wise, bounding box, ellipse-wise, and pixel-wise to verify the influence of annotation in pathological slide on deep learning models. We design corresponding experiments to test classification and segmentation performance of deep learning models based on annotations with different annotation granularity. In classification, state-of-the-art deep learning-based classifiers perform better when trained by pixel-wise annotation dataset. On average, precision, recall and F1-score improves by 7.87%, 8.83% and 7.85% respectively. Thus, it is suggested that finer granularity annotations are better utilized by deep learning algorithms in classification tasks. Similarly, semantic segmentation algorithms can achieve 8.33% better segmentation accuracy when trained by pixel-wise annotations. Our study shows not only that finer-grained annotation can improve the performance of deep learning models, but also help extracts more accurate phenotypic information from histopathological slides. Intelligence systems trained on granular annotations may help pathologists inspecting certain regions for better diagnosis. The compartmentalized prediction approach similar to this work may contribute to phenotype and genotype association studies.

eess.IV↗

arXiv2019

Joint Parsing and Generation for Abstractive Summarization

Sentences produced by abstractive summarization systems can be ungrammatical and fail to preserve the original meanings, despite being locally fluent. In this paper we propose to remedy this problem by jointly generating a sentence and its syntactic dependency parse while performing abstraction. If generating a word can introduce an erroneous relation to the summary, the behavior must be discouraged. The proposed method thus holds promise for producing grammatical sentences and encouraging the summary to stay true-to-original. Our contributions of this work are twofold. First, we present a novel neural architecture for abstractive summarization that combines a sequential decoder with a tree-based decoder in a synchronized manner to generate a summary sentence and its syntactic parse. Secondly, we describe a novel human evaluation protocol to assess if, and to what extent, a summary remains true to its original meanings. We evaluate our method on a number of summarization datasets and demonstrate competitive results against strong baselines.

cs.CL↗

arXiv2019

Graph Neural News Recommendation with Long-term and Short-term Interest Modeling

With the information explosion of news articles, personalized news recommendation has become important for users to quickly find news that they are interested in. Existing methods on news recommendation mainly include collaborative filtering methods which rely on direct user-item interactions and content based methods which characterize the content of user reading history. Although these methods have achieved good performances, they still suffer from data sparse problem, since most of them fail to extensively exploit high-order structure information (similar users tend to read similar news articles) in news recommendation systems. In this paper, we propose to build a heterogeneous graph to explicitly model the interactions among users, news and latent topics. The incorporated topic information would help indicate a user's interest and alleviate the sparsity of user-item interactions. Then we take advantage of graph neural networks to learn user and news representations that encode high-order structure information by propagating embeddings over the graph. The learned user embeddings with complete historic user clicks capture the users' long-term interests. We also consider a user's short-term interest using the recent reading history with an attention based LSTM model. Experimental results on real-world datasets show that our proposed model significantly outperforms state-of-the-art methods on news recommendation.

cs.IR↗

arXiv2019

Towards a terramechanics for bio-inspired locomotion in granular environments

Granular media (GM) present locomotor challenges for terrestrial and extraterrestrial devices because they can flow and solidify in response to localized intrusion of wheels, limbs, and bodies. While the development of airplanes and submarines is aided by understanding of hydrodynamics, fundamental theory does not yet exist to describe the complex interactions of locomotors with GM. In this paper, we use experimental, computational, and theoretical approaches to develop a terramechanics for bio-inspired locomotion in granular environments. We use a fluidized bed to prepare GM with a desired global packing fraction, and use empirical force measurements and the Discrete Element Method (DEM) to elucidate interaction mechanics during locomotion-relevant intrusions in GM such as vertical penetration and horizontal drag. We develop a resistive force theory (RFT) to account for more complex intrusions. We use these force models to understand the locomotor performance of two bio-inspired robots moving on and within GM.

physics.bio-ph↗

arXiv2019

A resistive force model of legged locomotion on granular media

Compared to agile legged animals, wheeled and tracked vehicles often suffer large performance loss on granular surfaces like sand and gravel. Understanding the mechanics of legged locomotion on granular media can aid the development of legged robots with improved mobility on granular surfaces; however, no general force model yet exists for granular media to predict ground reaction forces during complex limb intrusions. Inspired by a recent study of sand-swimming, we develop a resistive force model in the vertical plane for legged locomotion on granular media. We divide an intruder of complex morphology and kinematics, e.g., a bio-inspired robot L-leg rotated through uniform granular media (loosely packed ~ 1 mm diameter poppy seeds), into small segments, and measure stresses as a function of depth, orientation, and direction of motion using a model leg segment. Summation of segmental forces over the intruder predicts the net forces on both an L-leg and a reversed L-leg rotated through granular media with better accuracy than using simple one-dimensional penetration and drag force models. A multi-body dynamic simulation using the resistive force model predicts the speeds of a small legged robot (15 cm, 150 g) moving on granular media using both L-legs and reversed L-legs.

physics.bio-ph↗

arXiv2019

State-of-the-art in 360° Video/Image Processing: Perception, Assessment and Compression

Nowadays, 360° video/image has been increasingly popular and drawn great attention. The spherical viewing range of 360° video/image accounts for huge data, which pose the challenges to 360° video/image processing in solving the bottleneck of storage, transmission, etc. Accordingly, the recent years have witnessed the explosive emergence of works on 360° video/image processing. In this paper, we review the state-of-the-art works on 360° video/image processing from the aspects of perception, assessment and compression. First, this paper reviews both datasets and visual attention modelling approaches for 360° video/image. Second, we survey the related works on both subjective and objective visual quality assessment (VQA) of 360° video/image. Third, we overview the compression approaches for 360° video/image, which either utilize the spherical characteristics or visual attention models. Finally, we summarize this overview paper and outlook the future research trends on 360° video/image processing.

eess.IV↗

arXiv2019

Low-Resource Sequence Labeling via Unsupervised Multilingual Contextualized Representations

Previous work on cross-lingual sequence labeling tasks either requires parallel data or bridges the two languages through word-byword matching. Such requirements and assumptions are infeasible for most languages, especially for languages with large linguistic distances, e.g., English and Chinese. In this work, we propose a Multilingual Language Model with deep semantic Alignment (MLMA) to generate language-independent representations for cross-lingual sequence labeling. Our methods require only monolingual corpora with no bilingual resources at all and take advantage of deep contextualized representations. Experimental results show that our approach achieves new state-of-the-art NER and POS performance across European languages, and is also effective on distant language pairs such as English and Chinese.

cs.CL↗

arXiv2019

Multi-Document Summarization with Determinantal Point Processes and Contextualized Representations

Emerged as one of the best performing techniques for extractive summarization, determinantal point processes select the most probable set of sentences to form a summary according to a probability measure defined by modeling sentence prominence and pairwise repulsion. Traditionally, these aspects are modelled using shallow and linguistically informed features, but the rise of deep contextualized representations raises an interesting question of whether, and to what extent, contextualized representations can be used to improve DPP modeling. Our findings suggest that, despite the success of deep representations, it remains necessary to combine them with surface indicators for effective identification of summary sentences.

cs.CL↗

arXiv2019

Leveraging Multi-grained Sentiment Lexicon Information for Neural Sequence Models

Neural sequence models have achieved great success in sentence-level sentiment classification. However, some models are exceptionally complex or based on expensive features. Some other models recognize the value of existed linguistic resource but utilize it insufficiently. This paper proposes a novel and general method to incorporate lexicon information, including sentiment lexicons(+/-), negation words and intensifiers. Words are annotated in fine-grained and coarse-grained labels. The proposed method first encodes the fine-grained labels into sentiment embedding and concatenates it with word embedding. Second, the coarse-grained labels are utilized to enhance the attention mechanism to give large weight on sentiment-related words. Experimental results show that our method can increase classification accuracy for neural sequence models on both SST-5 and MR dataset. Specifically, the enhanced Bi-LSTM model can even compare with a Tree-LSTM which uses expensive phrase-level annotations. Further analysis shows that in most cases the lexicon resource can offer the right annotations. Besides, the proposed method is capable of overcoming the effect from inevitably wrong annotations.

cs.CL↗

arXiv2019

Adversarial Examples: Opportunities and Challenges

Deep neural networks (DNNs) have shown huge superiority over humans in image recognition, speech processing, autonomous vehicles and medical diagnosis. However, recent studies indicate that DNNs are vulnerable to adversarial examples (AEs), which are designed by attackers to fool deep learning models. Different from real examples, AEs can mislead the model to predict incorrect outputs while hardly be distinguished by human eyes, therefore threaten security-critical deep-learning applications. In recent years, the generation and defense of AEs have become a research hotspot in the field of artificial intelligence (AI) security. This article reviews the latest research progress of AEs. First, we introduce the concept, cause, characteristics and evaluation metrics of AEs, then give a survey on the state-of-the-art AE generation methods with the discussion of advantages and disadvantages. After that, we review the existing defenses and discuss their limitations. Finally, future research opportunities and challenges on AEs are prospected.

cs.LG↗

arXiv2019

Assessing Visual Quality of Omnidirectional Videos

In contrast with traditional video, omnidirectional video enables spherical viewing direction with support for head-mounted displays, providing an interactive and immersive experience. Unfortunately, to the best of our knowledge, there are few visual quality assessment (VQA) methods, either subjective or objective, for omnidirectional video coding. This paper proposes both subjective and objective methods for assessing quality loss in encoding omnidirectional video. Specifically, we first present a new database, which includes the viewing direction data from several subjects watching omnidirectional video sequences. Then, from our database, we find a high consistency in viewing directions across different subjects. The viewing directions are normally distributed in the center of the front regions, but they sometimes fall into other regions, related to video content. Given this finding, we present a subjective VQA method for measuring difference mean opinion score (DMOS) of the whole and regional omnidirectional video, in terms of overall DMOS (O-DMOS) and vectorized DMOS (V-DMOS), respectively. Moreover, we propose two objective VQA methods for encoded omnidirectional video, in light of human perception characteristics of omnidirectional video. One method weighs the distortion of pixels with regard to their distances to the center of front regions, which considers human preference in a panorama. The other method predicts viewing directions according to video content, and then the predicted viewing directions are leveraged to allocate weights to the distortion of each pixel in our objective VQA method. Finally, our experimental results verify that both the subjective and objective methods proposed in this paper advance state-of-the-art VQA for omnidirectional video.

eess.IV↗

arXiv2019

Isolating hydrogen in hexagonal boron nitride bubbles by a plasma treatment

Atomically thin hexagonal boron nitride (h-BN) is often regarded as an elastic film that is impermeable to gases. The high stabilities in thermal and chemical properties allow h-BN to serve as a gas barrier under extreme conditions.In this work, we demonstrate the isolation of hydrogen in bubbles of h-BN via plasma treatment.Detailed characterizations reveal that the substrates do not show chemical change after treatment. The bubbles are found to withstand thermal treatment in air,even at 800 degree celsius. Scanning transmission electron microscopy investigation shows that the h-BN multilayer has a unique aligned porous stacking nature, which is essential for the character of being transparent to atomic hydrogen but impermeable to hydrogen molecules. We successfully demonstrated the extraction of hydrogen gases from gaseous compounds or mixtures containing hydrogen element. The successful production of hydrogen bubbles on h-BN flakes has potential for further application in nano/micro-electromechanical systems and hydrogen storage.

physics.app-ph↗

arXiv2019

BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization

Most existing text summarization datasets are compiled from the news domain, where summaries have a flattened discourse structure. In such datasets, summary-worthy content often appears in the beginning of input articles. Moreover, large segments from input articles are present verbatim in their respective summaries. These issues impede the learning and evaluation of systems that can understand an article's global content structure as well as produce abstractive summaries with high compression ratio. In this work, we present a novel dataset, BIGPATENT, consisting of 1.3 million records of U.S. patent documents along with human written abstractive summaries. Compared to existing summarization datasets, BIGPATENT has the following properties: i) summaries contain a richer discourse structure with more recurring entities, ii) salient content is evenly distributed in the input, and iii) lesser and shorter extractive fragments are present in the summaries. Finally, we train and evaluate baselines and popular learning models on BIGPATENT to shed light on new challenges and motivate future directions for summarization research.

cs.CL↗

arXiv2019

Tunable dual-comb from an all-polarization-maintaining single-cavity dual-color Yb:fiber laser

We demonstrate dual-comb generation from an all-polarization-maintaining dual-color ytterbium (Yb) fiber laser. Two pulse trains with center wavelengths at 1030 nm and 1060 nm respectively are generated within the same laser cavity with a repetition rate around 77 MHz. Dual-color operation is induced using a tunable mechanical spectral filter, which cuts the gain spectrum into two spectral regions that can be independently mode-locked. Spectral overlap of the two pulse trains is achieved outside the laser cavity by amplifying the 1030-nm pulses and broadening them in a nonlinear fiber. Spatially overlapping the two arms on a simple photodiode then generates a down-converted radio frequency comb. The difference in repetition rates between the two pulse trains and hence the line spacing of the down-converted comb can easily be tuned in this setup. This feature allows for a flexible adjustment of the tradeoff between non-aliasing bandwidth vs. measurement time in spectroscopy applications. Furthermore, we show that by fine-tuning the center-wavelengths of the two pulse trains, we are able to shift the down-converted frequency comb along the radio-frequency axis. The usability of this dual-comb setup is demonstrated by measuring the transmission of two different etalons while the laser is completely free-running.

physics.optics↗

arXiv2019

Generating Multiple Hypotheses for 3D Human Pose Estimation with Mixture Density Network

3D human pose estimation from a monocular image or 2D joints is an ill-posed problem because of depth ambiguity and occluded joints. We argue that 3D human pose estimation from a monocular input is an inverse problem where multiple feasible solutions can exist. In this paper, we propose a novel approach to generate multiple feasible hypotheses of the 3D pose from 2D joints.In contrast to existing deep learning approaches which minimize a mean square error based on an unimodal Gaussian distribution, our method is able to generate multiple feasible hypotheses of 3D pose based on a multimodal mixture density networks. Our experiments show that the 3D poses estimated by our approach from an input of 2D joints are consistent in 2D reprojections, which supports our argument that multiple solutions exist for the 2D-to-3D inverse problem. Furthermore, we show state-of-the-art performance on the Human3.6M dataset in both best hypothesis and multi-view settings, and we demonstrate the generalization capacity of our model by testing on the MPII and MPI-INF-3DHP datasets. Our code is available at the project website.

cs.CV↗

arXiv2018

Observation of atom-number fluctuations in optical lattices via quantum collapse and revival dynamics

Using the quantum collapse and revival phenomenon of a Bose--Einstein condensate in three-dimensional optical lattices, the atom number statistics on each lattice site are experimentally investigated. We observe an interaction driven time evolution of on-site number fluctuations in a constant lattice potential with the collapse and revival time ratio as the figure of merit. Through a shortcut loading procedure, we prepare a three-dimensional array of coherent states with Poissonian number fluctuations. The following dynamics clearly show the interaction effect on the evolution of the number fluctuations from Poissonian to sub-Poissonian. Our method can be used to create squeezed states which are important in precision measurement.

cond-mat.quant-gas↗

arXiv2018

Sparse solutions in optimal control of PDEs with uncertain parameters: the linear case

We study sparse solutions of optimal control problems governed by PDEs with uncertain coefficients. We propose two formulations, one where the solution is a deterministic control optimizing the mean objective, and a formulation aiming at stochastic controls that share the same sparsity structure. In both formulations, regions where the controls do not vanish can be interpreted as optimal locations for placing control devices. In this paper, we focus on linear PDEs with linearly entering uncertain parameters. Under these assumptions, the deterministic formulation reduces to a problem with known structure, and thus we mainly focus on the stochastic control formulation. Here, shared sparsity is achieved by incorporating the $L^1$-norm of the mean of the pointwise squared controls in the objective. We reformulate the problem using a norm reweighting function that is defined over physical space only and thus helps to avoid approximation of the random space using samples or quadrature. We show that a fixed point algorithm applied to the norm reweighting formulation leads to a variant of the well-studied iterative reweighted least squares (IRLS) algorithm, and we propose a novel preconditioned Newton-conjugate gradient method to speed up the IRLS algorithm. We combine our algorithms with low-rank operator approximations, for which we provide estimates of the truncation error. We carefully examine the computational complexity of the resulting algorithms. The sparsity structure of the optimal controls and the performance of the solution algorithms are studied numerically using control problems governed by the Laplace and Helmholtz equations. In these experiments the Newton variant clearly outperforms the IRLS method.

math.NA↗

arXiv2018

Approximating Quasiparticle and Excitation Energies from Ground State Generalized Kohn-Sham Calculations

Quasiparticle energies and fundamental band gaps in particular are critical properties of molecules and materials. It was rigorously established that the generalized Kohn-Sham HOMO and LUMO orbital energies are the chemical potentials of electron removal and addition and thus good approximations to band edges and fundamental gaps from a density functional approximation (DFA) with minimal delocalization error. For other quasiparticle energies, their connection to the generalized Kohn-Sham orbital energies has not been established but remains highly interesting. We provide the comparison of experimental quasiparticle energies for many finite systems with calculations from the GW Green's function and localized orbitals scaling correction (LOSC), a recently developed correction to semilocal DFAs, which has minimal delocalization error. Extensive results with over forty systems clearly show that LOSC orbital energies achieve slightly better accuracy than the GW calculations with little dependence on the semilocal DFA, supporting the use of LOSC DFA orbital energies to predict quasiparticle energies. This also leads to the calculations of excitation energies of the $N$-electron systems from the ground state DFA calculations of the $\left(N-1\right)$-electron systems. Results show good performance with accuracy similar to TDDFT and the delta SCF approach for valence excitations with commonly used DFAs with or without LOSC. For Rydberg states, good accuracy was obtained only with the use of LOSC DFA. This work highlights the pathway to quasiparticle and excitation energies from ground density functional calculations.

physics.chem-ph↗