arXiv subjects

Fei Liu

Publications and source records attributed to Fei Liu.

At least 253 records · Page 14Linked to original sources

arXiv2020

Learning to Fuse Sentences with Transformers for Summarization

The ability to fuse sentences is highly attractive for summarization systems because it is an essential step to produce succinct abstracts. However, to date, summarizers can fail on fusing sentences. They tend to produce few summary sentences by fusion or generate incorrect fusions that lead the summary to fail to retain the original meaning. In this paper, we explore the ability of Transformers to fuse sentences and propose novel algorithms to enhance their ability to perform sentence fusion by leveraging the knowledge of points of correspondence between sentences. Through extensive experiments, we investigate the effects of different design choices on Transformer's performance. Our findings highlight the importance of modeling points of correspondence between sentences for effective sentence fusion.

cs.CL↗

arXiv2020

One-dimensional van der Waals heterostructures as efficient metal-free oxygen electrocatalysts

Two-dimensional covalent organic frameworks (2D-COFs) are an emerging family of catalytical materials with well-defined molecular structures. The stacking of 2D nanosheets and large intrinsic bandgaps significantly impair their performance. Here, we report coaxial one-dimensional van der Waals heterostructures (1D vdWHs) comprised of a carbon nanotube (CNT) core and a thickness tunable thienothiophene-pyrene COF shell using a solution based in situ wrapping method. Density functional theory calculations and in-operando and ex-situ spectroscopic analysis show that the carbon-sulfur region in the thienothiophene groups is the active catalytic site. The unique coaxial structure enables controllable n-doping from the CNT core to the COF shell depending on COF shell thickness, which lowers the bandgap and work function of COF. Consequently, the charge transfer barrier between the active catalytic site and adsorbed oxygen intermediates becomes lower, resulting in a dramatic enhancement in their catalytic activity for oxygen redox reactions. It enables a high-performance rechargeable zinc-air battery with a specific capacity of 696 mAh gZn-1 under a high current density of 40 mA cm-2 and excellent cycling stability. 1D vdWHs open the door to create multi-dimensional vdWHs for exploring fundamental physics and chemistry, as well as practical applications in electrochemistry, electronics, photonics, and beyond.

cond-mat.mtrl-sci↗

arXiv2020

Dynamically Constrained Motion Planning Networks for Non-Holonomic Robots

Reliable real-time planning for robots is essential in today's rapidly expanding automated ecosystem. In such environments, traditional methods that plan by relaxing constraints become unreliable or slow-down for kinematically constrained robots. This paper describes the algorithm Dynamic Motion Planning Networks (Dynamic MPNet), an extension to Motion Planning Networks, for non-holonomic robots that address the challenge of real-time motion planning using a neural planning approach. We propose modifications to the training and planning networks that make it possible for real-time planning while improving the data efficiency of training and trained models' generalizability. We evaluate our model in simulation for planning tasks for a non-holonomic robot. We also demonstrate experimental results for an indoor navigation task using a Dubins car.

cs.RO↗

arXiv2020

Antiferromagnetism of Double Molybdate LiFe(MoO$_4$)$_2$

The magnetic properties of the spin-5/2 double molybdate LiFe(MoO$_4$)$_2$ have been characterized by heat capacity, magnetic susceptibility, and neutron powder diffraction techniques. Unlike the multiferroic system LiFe(MoO$_4$)$_2$ which exhibits two successive magnetic transitions, LiFe(MoO$_4$)$_2$ undergoes only one antiferromagnetic transition at $T_N$ ~ 23.8 K. Its antiferromagnetic magnetic structure with the commensurate propagation vector k = (0, 0.5, 0) has been determined. Density functional theory calculations confirm the antiferromagnetic ground state and provide a numerical estimate of the relevant exchange coupling constants.

cond-mat.mtrl-sci↗

arXiv2020

Comparison of Different Methods for Time Sequence Prediction in Autonomous Vehicles

As a combination of various kinds of technologies, autonomous vehicles could complete a series of driving tasks by itself, such as perception, decision-making, planning, and control. Since there is no human driver to handle the emergency situation, future transportation information is significant for automated vehicles. This paper proposes different methods to forecast the time series for autonomous vehicles, which are the nearest neighborhood (NN), fuzzy coding (FC), and long short term memory (LSTM). First, the formulation and operational process for these three approaches are introduced. Then, the vehicle velocity is regarded as a case study and the real-world dataset is utilized to predict future information via these techniques. Finally, the performance, merits, and drawbacks of the presented methods are analyzed and discussed.

cs.LG↗

arXiv2020

Stochastic Floquet quantum heat engines and stochastic efficiencies

Based on the notion of quantum trajectory, we present a stochastic theoretical framework for Floquet quantum heat engines. As an application, the large deviation functions of two types of stochastic efficiencies for a two-level Floquet quantum heat engine are investigated. We find that the statistics of one efficiency agree well with the predictions of the universal theory of efficiency fluctuations developed by Verley et al. [Phys. Rev. E {\bf 90}, 052145 (2014)], whereas the statistics of the other efficiency do not. The reason for this discrepancy is attributed to the lack of fluctuation theorems for the latter type of efficiency.

cond-mat.stat-mech↗

arXiv2020

Understanding Points of Correspondence between Sentences for Abstractive Summarization

Fusing sentences containing disparate content is a remarkable human ability that helps create informative and succinct summaries. Such a simple task for humans has remained challenging for modern abstractive summarizers, substantially restricting their applicability in real-world scenarios. In this paper, we present an investigation into fusing sentences drawn from a document by introducing the notion of points of correspondence, which are cohesive devices that tie any two sentences together into a coherent text. The types of points of correspondence are delineated by text cohesion theory, covering pronominal and nominal referencing, repetition and beyond. We create a dataset containing the documents, source and fusion sentences, and human annotations of points of correspondence between sentences. Our dataset bridges the gap between coreference resolution and summarization. It is publicly shared to serve as a basis for future work to measure the success of sentence fusion systems. (https://github.com/ucfnlp/points-of-correspondence)

cs.CL↗

arXiv2020

Motivic double zeta values of odd weight

For odd $N\geq 5$, we establish a short exact sequence about motivic double zeta values $ζ^{\mathfrak{m}}(r,N-r)$ with $r\geq3$ odd, $N-r\geq2$. From this we classify all the relations among depth-graded motivic double zeta values $ζ^{\mathfrak{m}}(r,N-r)$ with $r\geq3$ odd, $N-r\geq2$. As a corollary, we confirm a conjecture of Zagier on the rank of a matrix which concerns relations among multiple zeta values of odd weight.

math.NT↗

arXiv2020

Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Review

Recently, the advancement of deep learning in discriminative feature learning from 3D LiDAR data has led to rapid development in the field of autonomous driving. However, automated processing uneven, unstructured, noisy, and massive 3D point clouds is a challenging and tedious task. In this paper, we provide a systematic review of existing compelling deep learning architectures applied in LiDAR point clouds, detailing for specific tasks in autonomous driving such as segmentation, detection, and classification. Although several published research papers focus on specific topics in computer vision for autonomous vehicles, to date, no general survey on deep learning applied in LiDAR point clouds for autonomous vehicles exists. Thus, the goal of this paper is to narrow the gap in this topic. More than 140 key contributions in the recent five years are summarized in this survey, including the milestone 3D deep architectures, the remarkable deep learning applications in 3D semantic segmentation, object detection, and classification; specific datasets, evaluation metrics, and the state of the art performance. Finally, we conclude the remaining challenges and future researches.

cs.CV↗

arXiv2020

AdaptiveWeighted Attention Network with Camera Spectral Sensitivity Prior for Spectral Reconstruction from RGB Images

Recent promising effort for spectral reconstruction (SR) focuses on learning a complicated mapping through using a deeper and wider convolutional neural networks (CNNs). Nevertheless, most CNN-based SR algorithms neglect to explore the camera spectral sensitivity (CSS) prior and interdependencies among intermediate features, thus limiting the representation ability of the network and performance of SR. To conquer these issues, we propose a novel adaptive weighted attention network (AWAN) for SR, whose backbone is stacked with multiple dual residual attention blocks (DRAB) decorating with long and short skip connections to form the dual residual learning. Concretely, we investigate an adaptive weighted channel attention (AWCA) module to reallocate channel-wise feature responses via integrating correlations between channels. Furthermore, a patch-level second-order non-local (PSNL) module is developed to capture long-range spatial contextual information by second-order non-local operations for more powerful feature representations. Based on the fact that the recovered RGB images can be projected by the reconstructed hyperspectral image (HSI) and the given CSS function, we incorporate the discrepancies of the RGB images and HSIs as a finer constraint for more accurate reconstruction. Experimental results demonstrate the effectiveness of our proposed AWAN network in terms of quantitative comparison and perceptual quality over other state-of-the-art SR methods. In the NTIRE 2020 Spectral Reconstruction Challenge, our entries obtain the 1st ranking on the Clean track and the 3rd place on the Real World track. Codes are available at https://github.com/Deep-imagelab/AWAN.

eess.IV↗

arXiv2020

6G White paper: Research challenges for Trust, Security and Privacy

The roles of trust, security and privacy are somewhat interconnected, but different facets of next generation networks. The challenges in creating a trustworthy 6G are multidisciplinary spanning technology, regulation, techno-economics, politics and ethics. This white paper addresses their fundamental research challenges in three key areas. Trust: Under the current "open internet" regulation, the telco cloud can be used for trust services only equally for all users. 6G network must support embedded trust for increased level of information security in 6G. Trust modeling, trust policies and trust mechanisms need to be defined. 6G interlinks physical and digital worlds making safety dependent on information security. Therefore, we need trustworthy 6G. Security: In 6G era, the dependence of the economy and societies on IT and the networks will deepen. The role of IT and the networks in national security keeps rising - a continuation of what we see in 5G. The development towards cloud and edge native infrastructures is expected to continue in 6G networks, and we need holistic 6G network security architecture planning. Security automation opens new questions: machine learning can be used to make safer systems, but also more dangerous attacks. Physical layer security techniques can also represent efficient solutions for securing less investigated network segments as first line of defense. Privacy: There is currently no way to unambiguously determine when linked, deidentified datasets cross the threshold to become personally identifiable. Courts in different parts of the world are making decisions about whether privacy is being infringed, while companies are seeking new ways to exploit private data to create new business revenues. As solution alternatives, we may consider blockchain, distributed ledger technologies and differential privacy approaches.

cs.CR↗

arXiv2020

Abrupt declines in tropospheric nitrogen dioxide over China after the outbreak of COVID-19

China's policy interventions to reduce the spread of the coronavirus disease 2019 have environmental and economic impacts. Tropospheric nitrogen dioxide indicates economic activities, as nitrogen dioxide is primarily emitted from fossil fuel consumption. Satellite measurements show a 48% drop in tropospheric nitrogen dioxide vertical column densities from the 20 days averaged before the 2020 Lunar New Year to the 20 days averaged after. This is 20% larger than that from recent years. We relate to this reduction to two of the government's actions: the announcement of the first report in each province and the date of a province's lockdown. Both actions are associated with nearly the same magnitude of reductions. Our analysis offers insights into the unintended environmental and economic consequences through reduced economic activities.

physics.ao-ph↗

arXiv2020

Development of a Flexible Coupling Framework for Coastal Inundation Studies

To enable flexible model coupling in coastal inundation studies, a coupling framework based on ESMF/NUOPC technology under a common modeling framework called the NOAA Environmental Modeling System (NEMS) was developed. The framework is essentially a software wrapper around atmospheric, wave and storm surge models that enables its components communicate seamlessly, and efficiently run in massively parallel environments. We implemented the coupled application including ADCIRC and unstructured WWAVEWATCHIII caps as well as NUOPC compliant caps to read Hurricane Weather Research and Forecasting Model (HWRF) generated forcing fields. We validated the coupled application for a laboratory test and a full scale inundation case of the Hurricane Ike, 2008, on a high resolution mesh covering the whole US Atlantic coast. We showed that how nonlinear interaction between surface waves and total water level results in significant enhancements and progression of the inundation and wave action into land in and around the hurricane landfall region. We also presented that how the maximum wave setup and maximum surge regions may happen at the various time and locations depending on the storm track and geographical properties of the landfall area.

physics.ao-ph↗

arXiv2020

Global Attention based Graph Convolutional Neural Networks for Improved Materials Property Prediction

Machine learning (ML) methods have gained increasing popularity in exploring and developing new materials. More specifically, graph neural network (GNN) has been applied in predicting material properties. In this work, we develop a novel model, GATGNN, for predicting inorganic material properties based on graph neural networks composed of multiple graph-attention layers (GAT) and a global attention layer. Through the application of the GAT layers, our model can efficiently learn the complex bonds shared among the atoms within each atom's local neighborhood. Subsequently, the global attention layer provides the weight coefficients of each atom in the inorganic crystal material which are used to considerably improve our model's performance. Notably, with the development of our GATGNN model, we show that our method is able to both outperform the previous models' predictions and provide insight into the crystallization of the material.

physics.comp-ph↗

arXiv2020

A fluctuation theorem for Floquet quantum master equations

We present a fluctuation theorem for Floquet quantum master equations. This is a detailed version of the famous Gallavotti-Cohen theorem. In contrast to the latter theorem, which involves the probability distribution of the total heat current, the former involves the joint probability distribution of positive and negative heat currents and can be used to derive the latter. A quantum two-level system driven by a periodic external field is used to verify this result.

cond-mat.stat-mech↗

arXiv2019

Self-Attention Network for Skeleton-based Human Action Recognition

Skeleton-based action recognition has recently attracted a lot of attention. Researchers are coming up with new approaches for extracting spatio-temporal relations and making considerable progress on large-scale skeleton-based datasets. Most of the architectures being proposed are based upon recurrent neural networks (RNNs), convolutional neural networks (CNNs) and graph-based CNNs. When it comes to skeleton-based action recognition, the importance of long term contextual information is central which is not captured by the current architectures. In order to come up with a better representation and capturing of long term spatio-temporal relationships, we propose three variants of Self-Attention Network (SAN), namely, SAN-V1, SAN-V2 and SAN-V3. Our SAN variants has the impressive capability of extracting high-level semantics by capturing long-range correlations. We have also integrated the Temporal Segment Network (TSN) with our SAN variants which resulted in improved overall performance. Different configurations of Self-Attention Network (SAN) variants and Temporal Segment Network (TSN) are explored with extensive experiments. Our chosen configuration outperforms state-of-the-art Top-1 and Top-5 by 4.4% and 7.9% respectively on Kinetics and shows consistently better performance than state-of-the-art methods on NTU RGB+D.

cs.CV↗

arXiv2019

Joint Parsing and Generation for Abstractive Summarization

Sentences produced by abstractive summarization systems can be ungrammatical and fail to preserve the original meanings, despite being locally fluent. In this paper we propose to remedy this problem by jointly generating a sentence and its syntactic dependency parse while performing abstraction. If generating a word can introduce an erroneous relation to the summary, the behavior must be discouraged. The proposed method thus holds promise for producing grammatical sentences and encouraging the summary to stay true-to-original. Our contributions of this work are twofold. First, we present a novel neural architecture for abstractive summarization that combines a sequential decoder with a tree-based decoder in a synchronized manner to generate a summary sentence and its syntactic parse. Secondly, we describe a novel human evaluation protocol to assess if, and to what extent, a summary remains true to its original meanings. We evaluate our method on a number of summarization datasets and demonstrate competitive results against strong baselines.

cs.CL↗

arXiv2019

Controlling the Amount of Verbatim Copying in Abstractive Summarization

An abstract must not change the meaning of the original text. A single most effective way to achieve that is to increase the amount of copying while still allowing for text abstraction. Human editors can usually exercise control over copying, resulting in summaries that are more extractive than abstractive, or vice versa. However, it remains poorly understood whether modern neural abstractive summarizers can provide the same flexibility, i.e., learning from single reference summaries to generate multiple summary hypotheses with varying degrees of copying. In this paper, we present a neural summarization model that, by learning from single human abstracts, can produce a broad spectrum of summaries ranging from purely extractive to highly generative ones. We frame the task of summarization as language modeling and exploit alternative mechanisms to generate summary hypotheses. Our method allows for control over copying during both training and decoding stages of a neural summarization model. Through extensive experiments we illustrate the significance of our proposed method on controlling the amount of verbatim copying and achieve competitive results over strong baselines. Our analysis further reveals interesting and unobvious facts.

cs.CL↗