arXiv subjects

Liang Wang

Publications and source records attributed to Liang Wang.

At least 559 records · Page 31Linked to original sources

arXiv2020

Programmable In-Network Obfuscation of Traffic

Recent advances in programmable switch hardware offer a fresh opportunity to protect user privacy. This paper presents PINOT, a lightweight in-network anonymity solution that runs at line rate within the memory and processing constraints of hardware switches. PINOT encrypts a client's IPv4 address with an efficient encryption scheme to hide the address from downstream ASes and the destination server. PINOT is readily deployable, requiring no end-user software or cooperation from networks other than the trusted network where it runs. We implement a PINOT prototype on the Barefoot Tofino switch, deploy PINOT in a campus network, and present results on protecting user identity against public DNS, NTP, and WireGuard VPN services.

cs.NI↗

arXiv2020

Investigating Label Bias in Beam Search for Open-ended Text Generation

Beam search is an effective and widely used decoding algorithm in many sequence-to-sequence (seq2seq) text generation tasks. However, in open-ended text generation, beam search is often found to produce repetitive and generic texts, sampling-based decoding algorithms like top-k sampling and nucleus sampling are more preferred. Standard seq2seq models suffer from label bias due to its locally normalized probability formulation. This paper provides a series of empirical evidence that label bias is a major reason for such degenerate behaviors of beam search. By combining locally normalized maximum likelihood estimation and globally normalized sequence-level training, label bias can be reduced with almost no sacrifice in perplexity. To quantitatively measure label bias, we test the model's ability to discriminate the groundtruth text and a set of context-agnostic distractors. We conduct experiments on large-scale response generation datasets. Results show that beam search can produce more diverse and meaningful texts with our approach, in terms of both automatic and human evaluation metrics. Our analysis also suggests several future working directions towards the grand challenge of open-ended text generation.

cs.CL↗

arXiv2020

The backbone-residual model. Accurately characterising the instrumental profile of a fibre-fed echelle spectrograph

Context: Instrumental profile (IP) is the basic property of a spectrograph. Accurate IP characterisation is the prerequisite of accurate wavelength solution. It also facilitates new spectral acquisition methods such as the forward modeling and deconvolution. Aims: We investigate an IP modeling method for the fibre-fed echelle spectrograph with the emission lines of the ThAr lamp, and explore the method to evaluate the accuracy of IP characterisation. Methods: The backbone-residual (BR) model is put forward and tested on the fibre-fed High Resolution Spectrograph (HRS) at the Chinese Xinglong 2.16-m Telescope, which is the sum of the backbone function and the residual function. The backbone function is a bell-shaped function to describe the main component and the spatial variation of IP. The residual function, which is expressed as the cubic spline function, accounts for the difference between the bell-shaped function and the actual IP. The method of evaluating the accuracy of IP characterisation is based on the spectral reconstruction and Monte Carlo simulation. Results: The IP of HRS is characterised with the BR model, and the accuracy of the characterised IP reaches 0.006 of the peak value of the backbone function. This result demonstrates that the accurate IP characterisation has been achieved on HRS with the BR model, and the BR model is an excellent choice for accurate IP characterisation of fibre-fed echelle spectrographs.

astro-ph.IM↗

arXiv2020

Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks

Text classification is fundamental in natural language processing (NLP), and Graph Neural Networks (GNN) are recently applied in this task. However, the existing graph-based works can neither capture the contextual word relationships within each document nor fulfil the inductive learning of new words. In this work, to overcome such problems, we propose TextING for inductive text classification via GNN. We first build individual graphs for each document and then use GNN to learn the fine-grained word representations based on their local structures, which can also effectively produce embeddings for unseen words in the new document. Finally, the word nodes are aggregated as the document embedding. Extensive experiments on four benchmark datasets show that our method outperforms state-of-the-art text classification methods.

cs.CL↗

arXiv2020

TAGNN: Target Attentive Graph Neural Networks for Session-based Recommendation

Session-based recommendation nowadays plays a vital role in many websites, which aims to predict users' actions based on anonymous sessions. There have emerged many studies that model a session as a sequence or a graph via investigating temporal transitions of items in a session. However, these methods compress a session into one fixed representation vector without considering the target items to be predicted. The fixed vector will restrict the representation ability of the recommender model, considering the diversity of target items and users' interests. In this paper, we propose a novel target attentive graph neural network (TAGNN) model for session-based recommendation. In TAGNN, target-aware attention adaptively activates different user interests with respect to varied target items. The learned interest representation vector varies with different target items, greatly improving the expressiveness of the model. Moreover, TAGNN harnesses the power of graph neural networks to capture rich item transitions in sessions. Comprehensive experiments conducted on real-world datasets demonstrate its superiority over state-of-the-art methods.

cs.IR↗

arXiv2020

Stochastic SIR Levy jump model with heavy tailed increments

This paper considers a general stochastic SIR epidemic model driven by a multidimensional Levy jump process with heavy tailed increments and possible correlation between noise components. In this framework, we derive new sufficient conditions for disease extinction and persistence in the mean. Our method differs from previous approaches by the use of Kunita's inequality instead of the Burkholder-Davis-Gundy inequality for continuous processes, and allows for the treatment of infinite Levy measures by the definition of new threshold values. An SIR model driven by a tempered stable process is presented as an example of application with the ability to model sudden disease outbreak, illustrated by numerical simulations. The results show that persistence and extinction are dependent not only on the variance of the processes increments, but also on the shapes of their distributions.

math.PR↗

arXiv2020

Toward a Wearable RFID System for Real-Time Activity Recognition Using Radio Patterns

Elderly care is one of the many applications supported by real-time activity recognition systems. Traditional approaches use cameras, body sensor networks, or radio patterns from various sources for activity recognition. However, these approaches are limited due to ease-of-use, coverage, or privacy preserving issues. In this paper, we present a novel wearable Radio Frequency Identification (RFID) system aims at providing an easy-to-use solution with high detection coverage. Our system uses passive tags which are maintenance-free and can be embedded into the clothes to reduce the wearing and maintenance efforts. A small RFID reader is also worn on the user's body to extend the detection coverage as the user moves. We exploit RFID radio patterns and extract both spatial and temporal features to characterize various activities. We also address the issues of false negative of tag readings and tag/antenna calibration, and design a fast online recognition system. Antenna and tag selection is done automatically to explore the minimum number of devices required to achieve target accuracy. We develop a prototype system which consists of a wearable RFID system and a smartphone to demonstrate the working principles, and conduct experimental studies with four subjects over two weeks. The results show that our system achieves a high recognition accuracy of 93.6 percent with a latency of 5 seconds. Additionally, we show that the system only requires two antennas and four tagged body parts to achieve a high recognition accuracy of 85 percent.

cs.OH↗

arXiv2020

Deep Self-Supervised Representation Learning for Free-Hand Sketch

In this paper, we tackle for the first time, the problem of self-supervised representation learning for free-hand sketches. This importantly addresses a common problem faced by the sketch community -- that annotated supervisory data are difficult to obtain. This problem is very challenging in that sketches are highly abstract and subject to different drawing styles, making existing solutions tailored for photos unsuitable. Key for the success of our self-supervised learning paradigm lies with our sketch-specific designs: (i) we propose a set of pretext tasks specifically designed for sketches that mimic different drawing styles, and (ii) we further exploit the use of a textual convolution network (TCN) in a dual-branch architecture for sketch feature learning, as means to accommodate the sequential stroke nature of sketches. We demonstrate the superiority of our sketch-specific designs through two sketch-related applications (retrieval and recognition) on a million-scale sketch dataset, and show that the proposed approach outperforms the state-of-the-art unsupervised representation learning methods, and significantly narrows the performance gap between with supervised representation learning.

cs.CV↗

arXiv2019

Pose-Guided Multi-Granularity Attention Network for Text-Based Person Search

Text-based person search aims to retrieve the corresponding person images in an image database by virtue of a describing sentence about the person, which poses great potential for various applications such as video surveillance. Extracting visual contents corresponding to the human description is the key to this cross-modal matching problem. Moreover, correlated images and descriptions involve different granularities of semantic relevance, which is usually ignored in previous methods. To exploit the multilevel corresponding visual contents, we propose a pose-guided multi-granularity attention network (PMA). Firstly, we propose a coarse alignment network (CA) to select the related image regions to the global description by a similarity-based attention. To further capture the phrase-related visual body part, a fine-grained alignment network (FA) is proposed, which employs pose information to learn latent semantic alignment between visual body part and textual noun phrase. To verify the effectiveness of our model, we perform extensive experiments on the CUHK Person Description Dataset (CUHK-PEDES) which is currently the only available dataset for text-based person search. Experimental results show that our approach outperforms the state-of-the-art methods by 15 \% in terms of the top-1 metric.

cs.CV↗

arXiv2019

The Pan-Pacific Planet Search. VIII. Complete results and the occurrence rate of planets around low-luminosity giants

Our knowledge of the populations and occurrence rates of planets orbiting evolved intermediate-mass stars lags behind that for solar-type stars by at least a decade. Some radial velocity surveys have targeted these low-luminosity giant stars, providing some insights into the properties of their planetary systems. Here we present the final data release of the Pan-Pacific Planet Search, a 5-year radial velocity survey using the 3.9m Anglo-Australian Telescope. We present 1293 precise radial velocity measurements for 129 stars, and highlight six potential substellar-mass companions which require additional observations to confirm. Correcting for the substantial incompleteness in the sample, we estimate the occurrence rate of giant planets orbiting low-luminosity giant stars to be approximately 7.8$^{+9.1}_{-3.3}$\%. This result is consistent with the frequency of such planets found to orbit main-sequence A-type stars, from which the PPPS stars have evolved.

astro-ph.EP↗

arXiv2019

Learning Preferences and Demands in Visual Recommendation

Visual information is an important factor in recommender systems, in which users' selections consist of two components: \emph{preferences} and \emph{demands}. Some studies has been done for modeling users' preferences in visual recommendation. However, conventional methods models items in a common visual feature space, which may fail in capturing \emph{styles} of items. We propose a DeepStyle method for learning style features of items. DeepStyle eliminates the categorical information of items, which is dominant in the original visual feature space, based on a Convolutional Neural Networks (CNN) architecture. For modeling users' demands on different categories of items, the problem can be formulated as recommendation with contextual and sequential information. To solve this problem, we propose a Context-Aware Gated Recurrent Unit (CA-GRU) method, which can capture sequential and contextual information simultaneously. Furthermore, the aggregation of prediction on preferences and demands, i.e., prediction generated by DeepStyle and CA-GRU, can model users' selection behaviors more completely. Experiments conducted on real-world datasets illustrates the effectiveness of our proposed methods in visual recommendation.

cs.IR↗

arXiv2019

Exact and Locally Implicit Source Term Solvers for Multifluid-Maxwell Systems

Recently, a family of models that couple multifluid systems to the full Maxwell equations draw a lot of attention in laboratory, space, and astrophysical plasma modeling. These models are more complete descriptions of the plasma than reduced models like magnetohydrodynamic (MHD) since they naturally retain non-ideal effects like electron inertia, Hall term, pressure anisotropy/nongyrotropy, etc. One obstacle to broader application of these model is that an explicit treatment of their source terms leads to the need to resolve rapid kinetic processes like plasma oscillation and electron cyclotron motion, even when they are not important. In this paper, we suggest two ways to address this issue. First, we derive the analytic forms solutions to the source update equations, which can be implemented as a practical, but less generic solver. We then develop a time-centered, locally implicit algorithm to update the source terms, allowing stepping over the fast kinetic time-scales. For a plasma with $S$ species, the locally implict algorithm involves inverting a local $3S+3$ matrix only, thus is very efficient. The performance can be further elevated by using the direct update formulas to skip null calculations. Benchmarks illustrated the exact energy-conservation of the locally implicit solver, as well as its efficiency and robustness for both small-scale, idealized problems and large-scale, complex systems. The locally implicit algorithm can be also easily extended to include other local sources, like collisions and ionization, which are difficult to solve analytically.

physics.comp-ph↗

arXiv2019

Learning Efficient Convolutional Networks through Irregular Convolutional Kernels

As deep neural networks are increasingly used in applications suited for low-power devices, a fundamental dilemma becomes apparent: the trend is to grow models to absorb increasing data that gives rise to memory intensive; however low-power devices are designed with very limited memory that can not store large models. Parameters pruning is critical for deep model deployment on low-power devices. Existing efforts mainly focus on designing highly efficient structures or pruning redundant connections for networks. They are usually sensitive to the tasks or relay on dedicated and expensive hashing storage strategies. In this work, we introduce a novel approach for achieving a lightweight model from the views of reconstructing the structure of convolutional kernels and efficient storage. Our approach transforms a traditional square convolution kernel to line segments, and automatically learn a proper strategy for equipping these line segments to model diverse features. The experimental results indicate that our approach can massively reduce the number of parameters (pruned 69% on DenseNet-40) and calculations (pruned 59% on DenseNet-40) while maintaining acceptable performance (only lose less than 2% accuracy).

cs.CV↗

arXiv2019

Global Ten-Moment Multifluid Simulations of the Solar Wind Interaction with Mercury: From the Planetary Conducting Core to the Dynamic Magnetosphere

For the first time, we explore the tightly coupled interior-magnetosphere system of Mercury by employing a three-dimensional ten-moment multifluid model. This novel fluid model incorporates the non-ideal effects including the Hall effect, inertia, and tensorial pressures that are critical for collisionless magnetic reconnection; therefore, it is particularly well suited for investigating $collisionless$ magnetic reconnection in Mercury's magnetotail and at the planet's magnetopause. The model is able to reproduce the observed magnetic field vectors, field-aligned currents, and cross-tail current sheet asymmetry (beyond the MHD approach) and the simulation results are in good agreement with spacecraft observations. We also study the magnetospheric response of Mercury to a hypothetical extreme event with an enhanced solar wind dynamic pressure, which demonstrates the significance of induction effects resulting from the electromagnetically-coupled interior. More interestingly, plasmoids (or flux ropes) are formed in Mercury's magnetotail during the event, indicating the highly dynamic nature of Mercury's magnetosphere.

physics.space-ph↗

arXiv2019

Denoising based Sequence-to-Sequence Pre-training for Text Generation

This paper presents a new sequence-to-sequence (seq2seq) pre-training method PoDA (Pre-training of Denoising Autoencoders), which learns representations suitable for text generation tasks. Unlike encoder-only (e.g., BERT) or decoder-only (e.g., OpenAI GPT) pre-training approaches, PoDA jointly pre-trains both the encoder and decoder by denoising the noise-corrupted text, and it also has the advantage of keeping the network architecture unchanged in the subsequent fine-tuning stage. Meanwhile, we design a hybrid model of Transformer and pointer-generator networks as the backbone architecture for PoDA. We conduct experiments on two text generation tasks: abstractive summarization, and grammatical error correction. Results on four datasets show that PoDA can improve model performance over strong baselines without using any task-specific techniques and significantly speed up convergence.

cs.CL↗

arXiv2019

An End-to-end Video Text Detector with Online Tracking

Video text detection is considered as one of the most difficult tasks in document analysis due to the following two challenges: 1) the difficulties caused by video scenes, i.e., motion blur, illumination changes, and occlusion; 2) the properties of text including variants of fonts, languages, orientations, and shapes. Most existing methods attempt to enhance the performance of video text detection by cooperating with video text tracking, but treat these two tasks separately. In this work, we propose an end-to-end video text detection model with online tracking to address these two challenges. Specifically, in the detection branch, we adopt ConvLSTM to capture spatial structure information and motion memory. In the tracking branch, we convert the tracking problem to text instance association, and an appearance-geometry descriptor with memory mechanism is proposed to generate robust representation of text instances. By integrating these two branches into one trainable framework, they can promote each other and the computational cost is significantly reduced. Experiments on existing video text benchmarks including ICDAR2013 Video, Minetto and YVT demonstrate that the proposed method significantly outperforms state-of-the-art methods. Our method improves F-score by about 2 on all datasets and it can run realtime with 24.36 fps on TITAN Xp.

cs.CV↗

arXiv2019

Learn to Compress CSI and Allocate Resources in Vehicular Networks

Resource allocation has a direct and profound impact on the performance of vehicle-to-everything (V2X) networks. In this paper, we develop a hybrid architecture consisting of centralized decision making and distributed resource sharing (the C-Decision scheme) to maximize the long-term sum rate of all vehicles. To reduce the network signaling overhead, each vehicle uses a deep neural network to compress its observed information that is thereafter fed back to the centralized decision making unit. The centralized decision unit employs a deep Q-network to allocate resources and then sends the decision results to all vehicles. We further adopt a quantization layer for each vehicle that learns to quantize the continuous feedback. In addition, we devise a mechanism to balance the transmission of vehicle-to-vehicle (V2V) links and vehicle-to-infrastructure (V2I) links. To further facilitate distributed spectrum sharing, we also propose a distributed decision making and spectrum sharing architecture (the D-Decision scheme) for each V2V link. Through extensive simulation results, we demonstrate that the proposed C-Decision and D-Decision schemes can both achieve near-optimal performance and are robust to feedback interval variations, input noise, and feedback noise.

eess.SP↗

arXiv2019

Learning Compact Target-Oriented Feature Representations for Visual Tracking

Many state-of-the-art trackers usually resort to the pretrained convolutional neural network (CNN) model for correlation filtering, in which deep features could usually be redundant, noisy and less discriminative for some certain instances, and the tracking performance might thus be affected. To handle this problem, we propose a novel approach, which takes both advantages of good generalization of generative models and excellent discrimination of discriminative models, for visual tracking. In particular, we learn compact, discriminative and target-oriented feature representations using the Laplacian coding algorithm that exploits the dependence among the input local features in a discriminative correlation filter framework. The feature representations and the correlation filter are jointly learnt to enhance to each other via a fast solver which only has very slight computational burden on the tracking speed. Extensive experiments on three benchmark datasets demonstrate that this proposed framework clearly outperforms baseline trackers with a modest impact on the frame rate, and performs comparably against the state-of-the-art methods.

cs.CV↗