arXiv subjects

Cheng Zhang

Publications and source records attributed to Cheng Zhang.

At least 343 records · Page 19Linked to original sources

arXiv2022

Tag-Set-Sequence Learning for Generating Question-Answer Pairs

Transformer-based QG models can generate question-answer pairs (QAPs) with high qualities, but may also generate silly questions for certain texts. We present a new method called tag-set sequence learning to tackle this problem, where a tag-set sequence is a sequence of tag sets to capture the syntactic and semantic information of the underlying sentence, and a tag set consists of one or more language feature tags, including, for example, semantic-role-labeling, part-of-speech, named-entity-recognition, and sentiment-indication tags. We construct a system called TSS-Learner to learn tag-set sequences from given declarative sentences and the corresponding interrogative sentences, and derive answers to the latter. We train a TSS-Learner model for the English language using a small training dataset and show that it can indeed generate adequate QAPs for certain texts that transformer-based models do poorly. Human evaluation on the QAPs generated by TSS-Learner over SAT practice reading tests is encouraging.

cs.CL↗

arXiv2022

DNA Scaffold Carrier Assisted Protein Translocation Through Solid-State Nanopore

The detection of biomolecules at the single molecular level have important applications in the fields of biosensing and biomedical diagnosis. Solid state nanopore (SS-nanopore) is an effective tool to perform the single molecular detection, due to its unique properties of label-free and less sample consumption. The current SS-nanopore translocations of small biomolecules are driven by the electronic field force, thus easily influenced by the charges, shapes and sizes of the target molecules. Therefore, it remains a great challenge to control biomolecules to translocate through SS-nanopore, particularly for the protein with complex conformations and different charges. Towards this problem, we developed a DNA scaffold carrier assisted strategy to help protein translocation through SS-nanopore, thus facilitating the target protein detection. Taking advantages of a DNA carrier loading effect, the current signal to noise ratios are significantly improved. Our proposed method is sensitive, convenient and can detect real-time sample nanopore translocations. This method opens up a wide range of applications for SS-nanopore detection and promote the development of single molecular detections.

physics.bio-ph↗

arXiv2022

Toward 6G TK$μ$ Extreme Connectivity: Architecture, Key Technologies and Experiments

Sixth-generation (6G) networks are evolving towards new features and order-of-magnitude enhancement of systematic performance metrics compared to the current 5G. In particular, the 6G networks are expected to achieve extreme connectivity performance with Tbps-scale data rate, Kbps/Hz-scale spectral efficiency, and $μ$s-scale latency. To this end, an original three-layer 6G network architecture is designed to realise uniform full-spectrum cell-free radio access and provide task-centric agile proximate support for diverse applications. The designed architecture is featured by super edge node (SEN) which integrates connectivity, computing, AI, data, etc. On this basis, a technological framework of pervasive multi-level (PML) AI is established in the centralised unit to enable task-centric near-real-time resource allocation and network automation. We then introduce a radio access network (RAN) architecture of full spectrum uniform cell-free networks, which is among the most attractive RAN candidates for 6G TK$μ$ extreme connectivity. A few most promising key technologies, i.e., cell-free massive MIMO, photonics-assisted Terahertz wireless access and spatiotemporal two-dimensional channel coding are further discussed. A testbed is implemented and extensive trials are conducted to evaluate innovative technologies and methodologies. The proposed 6G network architecture and technological framework demonstrate exciting potentials for full-service and full-scenario applications.

cs.NI↗

arXiv2022

Revealing Spatial-temporal Taxi Demand Patterns after Vaccination in COVID-19 Pandemic

The COVID-19 pandemic has had an unprecedented impact on our daily lives. With the increase in vaccination rate, normalcy gradually returns, so is the taxi demand. However, the changes in the spatial-temporal taxi demand pattern and factors impacting the recovery of this demand after COVID-19 vaccination started remain unclear. With the multisource time-series data from Chicago, including pandemic severity, vaccination progress and taxi trip volume, the recovery pattern of taxi demand is analyzed. The result reveals the taxi trip volume and average travel distance increased in most community areas in the city of Chicago after taking the COVID-19 vaccine. Taxi demand recovers relatively faster in the airport and area near the central downtown than in other areas in Chicago. Considering the asynchrony of data, the Pearson coefficient and Dynamic Time Warping (DTW) are both applied to investigate the correlations among different time series. It found that the recovery of taxi demand is not only related to the pandemic severity but strongly correlated with vaccination progress. Then, the leading and lagging relationship between vaccination progress and taxi demand is investigated by Time Lagging Cross-Correlation method. Taxi demand starts to recover after the first-dose vaccination period started and before the second-dose vaccination period. However, it was not until mid-April that the recovery rate of taxi demand exceeded the growth of the vaccination rate.

stat.AP↗

arXiv2022

Learning with Free Object Segments for Long-Tailed Instance Segmentation

One fundamental challenge in building an instance segmentation model for a large number of classes in complex scenes is the lack of training examples, especially for rare objects. In this paper, we explore the possibility to increase the training examples without laborious data collection and annotation. We find that an abundance of instance segments can potentially be obtained freely from object-centric images, according to two insights: (i) an object-centric image usually contains one salient object in a simple background; (ii) objects from the same class often share similar appearances or similar contrasts to the background. Motivated by these insights, we propose a simple and scalable framework FreeSeg for extracting and leveraging these "free" object foreground segments to facilitate model training in long-tailed instance segmentation. Concretely, we investigate the similarity among object-centric images of the same class to propose candidate segments of foreground instances, followed by a novel ranking of segment quality. The resulting high-quality object segments can then be used to augment the existing long-tailed datasets, e.g., by copying and pasting the segments onto the original training images. Extensive experiments show that FreeSeg yields substantial improvements on top of strong baselines and achieves state-of-the-art accuracy for segmenting rare object categories.

cs.CV↗

arXiv2022

Topological Lifshitz transition and one-dimensional Weyl mode in HfTe5

Landau band crossings typically stem from the intra-band evolution of electronic states in magnetic fields and enhance the interaction effect in their vicinity. Here in the extreme quantum limit of topological insulator HfTe5, we report the observation of a topological Lifshitz transition from inter-band Landau level crossings using magneto-infrared spectroscopy. By tracking the Landau level transitions, we demonstrate that band inversion drives the zeroth Landau bands to cross with each other after 4.5 T and forms one-dimensional Weyl mode with fundamental gap persistently closed. The unusual reduction of the zeroth Landau level transition activity suggests a topological Lifshitz transition at 21 T which shifts the Weyl mode close to Fermi level. As a result, a broad and asymmetric absorption feature emerges due to the Pauli blocking effect in one dimension, along with a distinctive negative magneto-resistivity. Our results provide a strategy for realizing one-dimensional Weyl quasiparticles in bulk crystals.

cond-mat.mtrl-sci↗

arXiv2022

Self-referencing 3D characterization of ultrafast optical-vortex beams using tilted interference TERMITES technique

Femtosecond light pulses carrying optical angular momentums (OAMs), possessing intriguing properties of helical phase fronts and ultrafast temporal profiles, enable many applications in nonlinear optics, strong-field physics and laser micro-machining. While generation of OAM-carrying ultrafast pulses and their interactions with matters have been intensively studied in experiments, three-dimensional characterization of ultrafast OAM-carrying light beams in spatio-temporal domain has, however, proved difficult to achieve. Conventional measurement schemes rely on the use of a reference pulsed light beam which needs to be well-characterized in its phase front and to have sufficient overlap and coherence with the beam under test, largely limiting practical applications of these schemes. Here we demonstrate a self-referencing set-up based on a tilted interferometer that can be used to measure complete spatio-temporal information of OAM-carrying femtosecond pulses with different topological charges. Through scanning one interferometer arm, the spectral phase over the pulse spatial profile can be obtained using the tilted interference signal, and the temporal envelope of the light field at one particular position around its phase singularity can be retrieved simultaneously, enabling three-dimensional beam reconstruction. This self-referencing technique, capable of measuring spatio-temporal ultrafast optical-vortex beams, may find many applications in fields of nonlinear optics and light-matter interactions.

physics.optics↗

arXiv2022

Optimistic Optimization of Gaussian Process Samples

Bayesian optimization is a popular formalism for global optimization, but its computational costs limit it to expensive-to-evaluate functions. A competing, computationally more efficient, global optimization framework is optimistic optimization, which exploits prior knowledge about the geometry of the search space in form of a dissimilarity function. We investigate to which degree the conceptual advantages of Bayesian Optimization can be combined with the computational efficiency of optimistic optimization. By mapping the kernel to a dissimilarity, we obtain an optimistic optimization algorithm for the Bayesian Optimization setting with a run-time of up to $\mathcal{O}(N \log N)$. As a high-level take-away we find that, when using stationary kernels on objectives of relatively low evaluation cost, optimistic optimization can be strongly preferable over Bayesian optimization, while for strongly coupled and parametric models, good implementations of Bayesian optimization can perform much better, even at low evaluation cost. We argue that there is a new research domain between geometric and probabilistic search, i.e. methods that run drastically faster than traditional Bayesian optimization, while retaining some of the crucial functionality of Bayesian optimization.

cs.LG↗

arXiv2022

NeurIPS Competition Instructions and Guide: Causal Insights for Learning Paths in Education

In this competition, participants will address two fundamental causal challenges in machine learning in the context of education using time-series data. The first is to identify the causal relationships between different constructs, where a construct is defined as the smallest element of learning. The second challenge is to predict the impact of learning one construct on the ability to answer questions on other constructs. Addressing these challenges will enable optimisation of students' knowledge acquisition, which can be deployed in a real edtech solution impacting millions of students. Participants will run these tasks in an idealised environment with synthetic data and a real-world scenario with evaluation data collected from a series of A/B tests.

cs.CY↗

arXiv2022

On Incorrectness Logic and Kleene Algebra with Top and Tests

Kleene algebra with tests (KAT) is a foundational equational framework for reasoning about programs, which has found applications in program transformations, networking and compiler optimizations, among many other areas. In his seminal work, Kozen proved that KAT subsumes propositional Hoare logic, showing that one can reason about the (partial) correctness of while programs by means of the equational theory of KAT. In this work, we investigate the support that KAT provides for reasoning about incorrectness, instead, as embodied by Ohearn's recently proposed incorrectness logic. We show that KAT cannot directly express incorrectness logic. The main reason for this limitation can be traced to the fact that KAT cannot express explicitly the notion of codomain, which is essential to express incorrectness triples. To address this issue, we study Kleene Algebra with Top and Tests (TopKAT), an extension of KAT with a top element. We show that TopKAT is powerful enough to express a codomain operation, to express incorrectness triples, and to prove all the rules of incorrectness logic sound. This shows that one can reason about the incorrectness of while-like programs by means of the equational theory of TopKAT.

cs.PL↗

arXiv2022

Exploring gluon tomography with polarization dependent diffractive J/$ψ$ production

We study azimuthal asymmetries in diffractive J/$ψ$ production in ultraperipheral heavy-ion collisions at RHIC and LHC energies using the color glass condensate effective theory. Our calculation successfully describes azimuthal averaged $J/ψ$ production cross section measured by STAR and ALICE. We further predict very large $\cos 2ϕ$ and $\cos 4ϕ$ azimuthal asymmetries for diffractive $J/ψ$ production both in UPCs at RHIC and LHC energies and in eA collisions at EIC energy. These novel polarization dependent observables may provide complementary information for constraining gluon transverse spatial distribution inside large nuclei. As compared to all previous analysis of diffractive $J/ψ$ production, the essential new elements integrated in our theoretical calculations are: the double-slit interference effect, the linear polarization of coherent photons, and the final state soft photon radiation effect.

hep-ph↗

arXiv2022

Efficient Real-world Testing of Causal Decision Making via Bayesian Experimental Design for Contextual Optimisation

The real-world testing of decisions made using causal machine learning models is an essential prerequisite for their successful application. We focus on evaluating and improving contextual treatment assignment decisions: these are personalised treatments applied to e.g. customers, each with their own contextual information, with the aim of maximising a reward. In this paper we introduce a model-agnostic framework for gathering data to evaluate and improve contextual decision making through Bayesian Experimental Design. Specifically, our method is used for the data-efficient evaluation of the regret of past treatment assignments. Unlike approaches such as A/B testing, our method avoids assigning treatments that are known to be highly sub-optimal, whilst engaging in some exploration to gather pertinent information. We achieve this by introducing an information-based design objective, which we optimise end-to-end. Our method applies to discrete and continuous treatments. Comparing our information-theoretic approach to baselines in several simulation studies demonstrates the superior performance of our proposed approach.

stat.ML↗

arXiv2022

Deep End-to-end Causal Inference

Causal inference is essential for data-driven decision making across domains such as business engagement, medical treatment and policy making. However, research on causal discovery has evolved separately from inference methods, preventing straight-forward combination of methods from both fields. In this work, we develop Deep End-to-end Causal Inference (DECI), a single flow-based non-linear additive noise model that takes in observational data and can perform both causal discovery and inference, including conditional average treatment effect (CATE) estimation. We provide a theoretical guarantee that DECI can recover the ground truth causal graph under standard causal discovery assumptions. Motivated by application impact, we extend this model to heterogeneous, mixed-type data with missing values, allowing for both continuous and discrete treatment decisions. Our results show the competitive performance of DECI when compared to relevant baselines for both causal discovery and (C)ATE estimation in over a thousand experiments on both synthetic datasets and causal machine learning benchmarks across data-types and levels of missingness.

stat.ML↗

arXiv2022

Measurements of microjoule-level, few-femtosecond ultraviolet dispersive-wave pulses generated in gas-filled hollow capillary fibers

High-energy ultraviolet pulse generation in gas-filled hollow capillary fibers (HCFs) through dispersive-wave-emission process, has attracted considerable attentions in recent several years due to its great application potentials in ultraviolet spectroscopy and photochemistry. While the ability of this technique to deliver high-energy, ultrafast ultraviolet pulses is widely recognized, few-fs duration of μJ-level dispersive-wave (DW) pulses has, however, escaped direct measurements. In this letter, we demonstrate that using several chirped mirrors, few-fs ultraviolet DW pulses can be obtained in atmosphere environment without the use of vacuum chambers. The pulse temporal profiles, measured using a self-diffraction frequency-resolved optical gating set-up, exhibit full-width-half-maximum pulse widths of 9.6 fs at 384 nm and 9.4 fs at 430 nm, close to the Fourier-transform limits. Moreover, theoretical and experimental studies reveal the strong influences of driving pulse energy and HCF length on temporal width and shape of the measured DW pulses. The ultraviolet pulses obtained in atmosphere environment with μJ-level pulse energy, few-fs pulse width and broadband wavelength tunability are ready to be used in many applications.

physics.optics↗

arXiv2022

PVT: Point-Voxel Transformer for Point Cloud Learning

The recently developed pure Transformer architectures have attained promising accuracy on point cloud learning benchmarks compared to convolutional neural networks. However, existing point cloud Transformers are computationally expensive since they waste a significant amount of time on structuring the irregular data. To solve this shortcoming, we present Sparse Window Attention (SWA) module to gather coarse-grained local features from non-empty voxels, which not only bypasses the expensive irregular data structuring and invalid empty voxel computation, but also obtains linear computational complexity with respect to voxel resolution. Meanwhile, to gather fine-grained features about the global shape, we introduce relative attention (RA) module, a more robust self-attention variant for rigid transformations of objects. Equipped with the SWA and RA, we construct our neural architecture called PVT that integrates both modules into a joint framework for point cloud learning. Compared with previous Transformer-based and attention-based models, our method attains top accuracy of 94.0% on classification benchmark and 10x inference speedup on average. Extensive experiments also valid the effectiveness of PVT on part and semantic segmentation benchmarks (86.6% and 69.2% mIoU, respectively).

cs.CV↗

arXiv2022

Downstream Transformer Generation of Question-Answer Pairs with Preprocessing and Postprocessing Pipelines

We present a system called TP3 to perform a downstream task of transformers on generating question-answer pairs (QAPs) from a given article. TP3 first finetunes pretrained transformers on QAP datasets, then uses a preprocessing pipeline to select appropriate answers, feeds the relevant sentences and the answer to the finetuned transformer to generate candidate QAPs, and finally uses a postprocessing pipeline to filter inadequate QAPs. In particular, using pretrained T5 models as transformers and the SQuAD dataset as the finetruning dataset, we show that TP3 generates satisfactory number of QAPs with high qualities on the Gaokao-EN dataset.

cs.CL↗

arXiv2022

Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbations

In this paper, we propose a novel and practical mechanism which enables the service provider to verify whether a suspect model is stolen from the victim model via model extraction attacks. Our key insight is that the profile of a DNN model's decision boundary can be uniquely characterized by its Universal Adversarial Perturbations (UAPs). UAPs belong to a low-dimensional subspace and piracy models' subspaces are more consistent with victim model's subspace compared with non-piracy model. Based on this, we propose a UAP fingerprinting method for DNN models and train an encoder via contrastive learning that takes fingerprint as inputs, outputs a similarity score. Extensive studies show that our framework can detect model IP breaches with confidence > 99.99 within only 20 fingerprints of the suspect model. It has good generalizability across different model architectures and is robust against post-modifications on stolen models.

cs.CR↗

arXiv2022

Robust population inversion in three-level systems by composite pulses

In this work, we exploit the idea of composite pulses to achieve robust population inversion in a three-level quantum system. The scheme is based on the modulation of the coupling strength, while the other physical parameters remain unchanged. The composite pulses sequence is designed by vanishing high-order error terms, and can compensate the systematic errors to any desired order. In particular, this scheme keeps a good performance under the disturbance of waveform deformations. This trait ensures that population inversion can be nearly obtained even when the pulse sequence has a short jump delay. As an example, we employ the designed composite pulse sequence to prepare the W state in a robust manner in the superconducting circuits. The numerical results show that the fidelity can still maintain a high level in a decoherence environment.

quant-ph↗