arXiv subjects

Jie Hao

Publications and source records attributed to Jie Hao.

72 records · Page 4Linked to original sources

arXiv2021

Optimal Quaternary (r,delta)-Locally Repairable Codes Achieving the Singleton-type Bound

Locally repairable codes enables fast repair of node failure in a distributed storage system. The code symbols in a codeword are stored in different storage nodes, such that a disk failure can be recovered by accessing a small fraction of the storage nodes. The number of storage nodes that are contacted during the repair of a failed node is a parameter called locality. We consider locally repairable codes that can be locally recovered in the presence of multiple node failures. The punctured code obtained by removing the code symbols in the complement of a repair group is called a local code. We aim at designing a code such that all local codes have a prescribed minimum distance, so that any node failure can be repaired locally, provided that the total number of node failures is less than the tolerance parameter. We consider linear locally repairable codes defined over a finite field of size four. This alphabet has characteristic 2, and hence is amenable to practical implementation. We classify all quaternary locally repairable codes that attain the Singleton-type upper bound for minimum distance. For each combination of achievable code parameters, an explicit code construction is given.

cs.IT↗

arXiv2020

Robust Dialogue Utterance Rewriting as Sequence Tagging

The task of dialogue rewriting aims to reconstruct the latest dialogue utterance by copying the missing content from the dialogue context. Until now, the existing models for this task suffer from the robustness issue, i.e., performances drop dramatically when testing on a different domain. We address this robustness issue by proposing a novel sequence-tagging-based model so that the search space is significantly reduced, yet the core of this task is still well covered. As a common issue of most tagging models for text generation, the model's outputs may lack fluency. To alleviate this issue, we inject the loss signal from BLEU or GPT-2 under a REINFORCE framework. Experiments show huge improvements of our model over the current state-of-the-art systems on domain transfer.

cs.CL↗

arXiv2020

The Tianlai Cylinder Pathfinder Array: System Functions and Basic Performance Analysis

The Tianlai Cylinder Pathfinder is a radio interferometer array designed to test techniques for 21 cm intensity mapping in the post-reionization Universe, with the ultimate aim of mapping the large scale structure and measuring cosmological parameters such as the dark energy equation of state. Each of its three parallel cylinder reflectors is oriented in the north-south direction, and the array has a large field of view. As the Earth rotates, the northern sky is observed by drift scanning. The array is located in Hongliuxia, a radio-quiet site in Xinjiang, and saw its first light in September 2016. In this first data analysis paper for the Tianlai cylinder array, we discuss the sub-system qualification tests, and present basic system performance obtained from preliminary analysis of the commissioning observations during 2016-2018. We show typical interferometric visibility data, from which we derive the actual beam profile in the east-west direction and the frequency band-pass response. We describe also the calibration process to determine the complex gains for the array elements, either using bright astronomical point sources, or an artificial on site calibrator source, and discuss the instrument response stability, crucial for transit interferometry. Based on this analysis, we find a system temperature of about 90 K, and we also estimate the sensitivity of the array.

astro-ph.IM↗

arXiv2019

Towards Better Modeling Hierarchical Structure for Self-Attention with Ordered Neurons

Recent studies have shown that a hybrid of self-attention networks (SANs) and recurrent neural networks (RNNs) outperforms both individual architectures, while not much is known about why the hybrid models work. With the belief that modeling hierarchical structure is an essential complementary between SANs and RNNs, we propose to further enhance the strength of hybrid models with an advanced variant of RNNs - Ordered Neurons LSTM (ON-LSTM), which introduces a syntax-oriented inductive bias to perform tree-like composition. Experimental results on the benchmark machine translation task show that the proposed approach outperforms both individual architectures and a standard hybrid model. Further analyses on targeted linguistic evaluation and logical inference tasks demonstrate that the proposed approach indeed benefits from a better modeling of hierarchical structure.

cs.CL↗

arXiv2019

Bounds and Constructions of Locally Repairable Codes: Parity-check Matrix Approach

A $q$-ary $(n,k,r)$ locally repairable code (LRC) is an $[n,k,d]$ linear code over $\mathbb{F}_q$ such that every code symbol can be recovered by accessing at most $r$ other code symbols. The well-known Singleton-like bound says that $d \le n-k-\lceil k/r\rceil +2$ and an LRC is said to be optimal if it attains this bound. In this paper, we study the bounds and constructions of LRCs from the view of parity-check matrices. Firstly, a simple and unified framework based on parity-check matrix to analyze the bounds of LRCs is proposed. Several useful structural properties on $q$-ary optimal LRCs are obtained. We derive an upper bound on the minimum distance of $q$-ary optimal $(n,k,r)$-LRCs in terms of the field size $q$. Then, we focus on constructions of optimal LRCs over binary field. It is proved that there are only 5 classes of possible parameters with which optimal binary $(n,k,r)$-LRCs exist. Moreover, by employing the proposed parity-check matrix approach, we completely enumerate all these 5 classes of possible optimal binary LRCs attaining the Singleton-like bound in the sense of equivalence of linear codes.

cs.IT↗

arXiv2019

Monte Carlo Co-Ordinate Ascent Variational Inference

In Variational Inference (VI), coordinate-ascent and gradient-based approaches are two major types of algorithms for approximating difficult-to-compute probability densities. In real-world implementations of complex models, Monte Carlo methods are widely used to estimate expectations in coordinate-ascent approaches and gradients in derivative-driven ones. We discuss a Monte Carlo Co-ordinate Ascent VI (MC-CAVI) algorithm that makes use of Markov chain Monte Carlo (MCMC) methods in the calculation of expectations required within Co-ordinate Ascent VI (CAVI). We show that, under regularity conditions, an MC-CAVI recursion will get arbitrarily close to a maximiser of the evidence lower bound (ELBO) with any given high probability. In numerical examples, the performance of MC-CAVI algorithm is compared with that of MCMC and -- as a representative of derivative-based VI methods -- of Black Box VI (BBVI). We discuss and demonstrate MC-CAVI's suitability for models with hard constraints in simulated and real examples. We compare MC-CAVI's performance with that of MCMC in an important complex model used in Nuclear Magnetic Resonance (NMR) spectroscopy data analysis -- BBVI is nearly impossible to be employed in this setting due to the hard constraints involved in the model.

stat.CO↗

arXiv2019

Multi-Granularity Self-Attention for Neural Machine Translation

Current state-of-the-art neural machine translation (NMT) uses a deep multi-head self-attention network with no explicit phrase information. However, prior work on statistical machine translation has shown that extending the basic translation unit from words to phrases has produced substantial improvements, suggesting the possibility of improving NMT performance from explicit modeling of phrases. In this work, we present multi-granularity self-attention (Mg-Sa): a neural network that combines multi-head self-attention and phrase modeling. Specifically, we train several attention heads to attend to phrases in either n-gram or syntactic formalism. Moreover, we exploit interactions among phrases to enhance the strength of structure modeling - a commonly-cited weakness of self-attention. Experimental results on WMT14 English-to-German and NIST Chinese-to-English translation tasks show the proposed approach consistently improves performance. Targeted linguistic analysis reveals that Mg-Sa indeed captures useful phrase information at various levels of granularities.

cs.CL↗

arXiv2019

Observation of multi-component atomic Schrödinger cat states of up to 20 qubits

We report on deterministic generation of 18-qubit genuinely entangled Greenberger-Horne-Zeilinger (GHZ) state and multi-component atomic Schrödinger cat states of up to 20 qubits on a quantum processor, which features 20 superconducting qubits interconnected by a bus resonator. By engineering a one-axis twisting Hamiltonian enabled by the resonator-mediated interactions, the system of qubits initialized coherently evolves to an over-squeezed, non-Gaussian regime, where atomic Schrödinger cat states, i.e., superpositions of atomic coherent states including GHZ state, appear at specific time intervals in excellent agreement with theory. With high controllability, we are able to take snapshots of the dynamics by plotting quasidistribution $Q$-functions of the 20-qubit atomic cat states, and globally characterize the 18-qubit GHZ state which yields a fidelity of $0.525\pm0.005$ confirming genuine eighteen-partite entanglement. Our results demonstrate the largest entanglement controllably created so far in solid state architectures, and the process of generating and detecting multipartite entanglement may promise applications in practical quantum metrology, quantum information processing and quantum computation.

quant-ph↗

arXiv2019

Modeling Recurrence for Transformer

Recently, the Transformer model that is based solely on attention mechanisms, has advanced the state-of-the-art on various machine translation tasks. However, recent studies reveal that the lack of recurrence hinders its further improvement of translation capacity. In response to this problem, we propose to directly model recurrence for Transformer with an additional recurrence encoder. In addition to the standard recurrent neural network, we introduce a novel attentive recurrent network to leverage the strengths of both attention and recurrent networks. Experimental results on the widely-used WMT14 English-German and WMT17 Chinese-English translation tasks demonstrate the effectiveness of the proposed approach. Our studies also reveal that the proposed model benefits from a short-cut that bridges the source and target sequences with a single recurrent layer, which outperforms its deep counterpart.

cs.CL↗

arXiv2018

Progress in the Construction and Testing of the Tianlai Radio Interferometers

The Tianlai Pathfinder is designed to demonstrate the feasibility of using a wide field of view radio interferometers to map the density of neutral hydrogen in the Universe after the Epoch of Reionizaton. This approach, called 21~cm intensity-mapping, promises an inexpensive means for surveying the large-scale structure of the cosmos. The Tianlai Pathfinder presently consists of an array of three, 15~m $\times$ 40~m cylinder telescopes and an array of sixteen, 6~m diameter dish antennas located in a radio-quiet part of western China. The two types of arrays were chosen to determine the advantages and disadvantages of each approach. The primary goal of the Pathfinder is to make 3D maps by surveying neutral hydrogen over large areas of the sky %$20,000 {\rm deg}^2$ in two different redshift ranges: first at $1.03 > z > 0.78$ ($700 - 800$~MHz) and later at $0.21 > z > 0.12$ ($1170 - 1270$~MHz). The most significant challenge to $21$~cm intensity-mapping is the removal of strong foreground radiation that dwarfs the cosmological signal. It requires exquisite knowledge of the instrumental response, i.e. calibration. In this paper, we provide an overview of the status of the Pathfinder and discuss the details of some of the analysis that we have carried out to measure the beam function of both arrays. We compare electromagnetic simulations of the arrays to measurements, discuss measurements of the gain and phase stability of the instrument, and provide a brief overview of the data processing pipeline.

astro-ph.IM↗

arXiv2018

Adversarial adaptive 1-D convolutional neural networks for bearing fault diagnosis under varying working condition

Traditional intelligent fault diagnosis of rolling bearings work well only under a common assumption that the labeled training data (source domain) and unlabeled testing data (target domain) are drawn from the same distribution. However, in many real-world applications, this assumption does not hold, especially when the working condition varies. In this paper, a new adversarial adaptive 1-D CNN called A2CNN is proposed to address this problem. A2CNN consists of four parts, namely, a source feature extractor, a target feature extractor, a label classifier and a domain discriminator. The layers between the source and target feature extractor are partially untied during the training stage to take both training efficiency and domain adaptation into consideration. Experiments show that A2CNN has strong fault-discriminative and domain-invariant capacity, and therefore can achieve high accuracy under different working conditions. We also visualize the learned features and the networks to explore the reasons behind the high performance of our proposed model.

eess.SP↗

arXiv2017

Locally Repairable Codes with Multiple $(r_{i}, δ_{i})$-Localities

In distributed storage systems, locally repairable codes (LRCs) are introduced to realize low disk I/O and repair cost. In order to tolerate multiple node failures, the LRCs with \emph{$(r, δ)$-locality} are further proposed. Since hot data is not uncommon in a distributed storage system, both Zeh \emph{et al.} and Kadhe \emph{et al.} focus on the LRCs with \emph{multiple localities or unequal localities} (ML-LRCs) recently, which said that the localities among the code symbols can be different. ML-LRCs are attractive and useful in reducing repair cost for hot data. In this paper, we generalize the ML-LRCs to the $(r,δ)$-locality case of multiple node failures, and define an LRC with multiple $(r_{i}, δ_{i})_{i\in [s]}$ localities ($s\ge 2$), where $r_{1}\leq r_{2}\leq\dots\leq r_{s}$ and $δ_{1}\geqδ_{2}\geq\dots\geqδ_{s}\geq2$. Such codes ensure that some hot data could be repaired more quickly and have better failure-tolerance in certain cases because of relatively smaller $r_{i}$ and larger $δ_{i}$. Then, we derive a Singleton-like upper bound on the minimum distance for the proposed LRCs by employing the regenerating-set technique. Finally, we obtain a class of explicit and structured constructions of optimal ML-LRCs, and further extend them to the cases of multiple $(r_{i}, δ)_{i\in [s]}$ localities.

cs.IT↗

arXiv2017

On the Weight Hierarchy of Locally Repairable Codes

An $(n,k,r)$ \emph{locally repairable code} (LRC) is an $[n,k,d]$ linear code where every code symbol can be repaired from at most $r$ other code symbols. An LRC is said to be optimal if the minimum distance attains the Singleton-like bound $d \le n-k-\lceil k/r \rceil +2$. The \emph{generalized Hamming weights} (GHWs) of linear codes are fundamental parameters which have many useful applications. Generally it is difficult to determine the GHWs of linear codes. In this paper, we study the GHWs of LRCs. Firstly, we obtain a generalized Singleton-like bound on the $i$-th $(1\le i \le k)$ GHWs of general $(n,k,r)$ LRCs. Then, it is shown that for an optimal $(n,k,r)$ LRC with $r \mid k$, its weight hierarchy can be completely determined, and the $i$-th GHW of an optimal $(n,k,r)$ LRC with $r \mid k$ attains the proposed generalized Singleton-like bound for all $1\le i \le k$. For an optimal $(n,k,r)$ LRC with $r \nmid k$, we give lower bounds on the GHWs of the LRC and its dual code. Finally, two general bounds on linear codes in terms of the GHWs are presented. Moreover, it is also shown that some previous results on the bounds of minimum distances of linear codes can also be explained or refined in terms of the GHWs.

cs.IT↗

arXiv2017

On Optimal Ternary Locally Repairable Codes

In an $[n,k,d]$ linear code, a code symbol is said to have locality $r$ if it can be repaired by accessing at most $r$ other code symbols. For an $(n,k,r)$ \emph{locally repairable code} (LRC), the minimum distance satisfies the well-known Singleton-like bound $d\le n-k-\lceil k/r\rceil +2$. In this paper, we study optimal ternary LRCs meeting this Singleton-like bound by employing a parity-check matrix approach. It is proved that there are only $8$ classes of possible parameters with which optimal ternary LRCs exist. Moreover, we obtain explicit constructions of optimal ternary LRCs for all these $8$ classes of parameters, where the minimum distance could only be 2, 3, 4, 5 and 6.

cs.IT↗

arXiv2016

Constructions of Optimal Cyclic $(r,δ)$ Locally Repairable Codes

A code is said to be a $r$-local locally repairable code (LRC) if each of its coordinates can be repaired by accessing at most $r$ other coordinates. When some of the $r$ coordinates are also erased, the $r$-local LRC can not accomplish the local repair, which leads to the concept of $(r,δ)$-locality. A $q$-ary $[n, k]$ linear code $\cC$ is said to have $(r, δ)$-locality ($δ\ge 2$) if for each coordinate $i$, there exists a punctured subcode of $\cC$ with support containing $i$, whose length is at most $r + δ- 1$, and whose minimum distance is at least $δ$. The $(r, δ)$-LRC can tolerate $δ-1$ erasures in total, which degenerates to a $r$-local LRC when $δ=2$. A $q$-ary $(r,δ)$ LRC is called optimal if it meets the Singleton-like bound for $(r,δ)$-LRCs. A class of optimal $q$-ary cyclic $r$-local LRCs with lengths $n\mid q-1$ were constructed by Tamo, Barg, Goparaju and Calderbank based on the $q$-ary Reed-Solomon codes. In this paper, we construct a class of optimal $q$-ary cyclic $(r,δ)$-LRCs ($δ\ge 2$) with length $n\mid q-1$, which generalizes the results of Tamo \emph{et al.} Moreover, we construct a new class of optimal $q$-ary cyclic $r$-local LRCs with lengths $n\mid q+1$ and a new class of optimal $q$-ary cyclic $(r,δ)$-LRCs ($δ\ge 2$) with lengths $n\mid q+1$. The constructed optimal LRCs with length $n=q+1$ have the best-known length $q+1$ for the given finite field with size $q$ when the minimum distance is larger than $4$.

cs.IT↗

arXiv2014

Telescoping Sums, Permutations, and First Occurrence Distributions

Telescoping sums very naturally lead to probability distributions on ${\mathbb Z}^+$. But are these distributions typically cosmetic and devoid of motivation? In this paper we give three examples of "first occurrence" distributions, each defined by telescoping sums, and that each arise from concrete questions about the structure of permutations.

math.HO↗

arXiv2014

Distribution of the Maximum and Minimum of a Random Number of Bounded Random Variables

We study a new family of random variables, that each arise as the distribution of the maximum or minimum of a random number $N$ of i.i.d.~random variables $X_1,X_2,\ldots,X_N$, each distributed as a variable $X$ with support on $[0,1]$. The general scheme is first outlined, and several special cases are studied in detail. Wherever appropriate, we find estimates of the parameter $θ$ in the one-parameter family in question.

math.ST↗

arXiv2012

BATMAN-an R package for the automated quantification of metabolites from NMR spectra using a Bayesian Model

Motivation: NMR spectra are widely used in metabolomics to obtain metabolite profiles in complex biological mixtures. Common methods used to assign and estimate concentrations of metabolites involve either an expert manual peak fitting or extra pre-processing steps, such as peak alignment and binning. Peak fitting is very time consuming and is subject to human error. Conversely, alignment and binning can introduce artefacts and limit immediate biological interpretation of models. Results: We present the Bayesian AuTomated Metabolite Analyser for NMR spectra (BATMAN), an R package which deconvolutes peaks from 1-dimensional NMR spectra, automatically assigns them to specific metabolites from a target list and obtains concentration estimates. The Bayesian model incorporates information on charac-teristic peak patterns of metabolites and is able to account for shifts in the position of peaks commonly seen in NMR spectra of biological samples. It applies a Markov Chain Monte Carlo (MCMC) algorithm to sample from a joint posterior distribution of the model parameters and obtains concentration estimates with reduced error compared with conventional numerical integration and comparable to manual deconvolution by experienced spectroscopists. Availability: http://www1.imperial.ac.uk/medicine/people/t.ebbels/ Contact: t.ebbels@imperial.ac.uk

stat.AP↗