Searcharxiv⌕ Search

arXiv subjects

Ke Wang

Publications and source records attributed to Ke Wang.

At least 379 records · Page 21Linked to original sources
arXiv2023

Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the performance with prompting. We propose a unified framework, which can integrate effectively multiple types of knowledge including sentences, terminologies/phrases and translation templates into NMT models. We utilize multiple types of knowledge as prefix-prompts of input for the encoder and decoder of NMT models to guide the translation process. The approach requires no changes to the model architecture and effectively adapts to domain-specific translation without retraining. The experiments on English-Chinese and English-German translation demonstrate that our approach significantly outperform strong baselines, achieving high translation quality and terminology match accuracy.

cs.CL↗
arXiv2023

Detecting DBMS Bugs with Context-Sensitive Instantiation and Multi-Plan Execution

DBMS bugs can cause serious consequences, posing severe security and privacy concerns. This paper works towards the detection of memory bugs and logic bugs in DBMSs, and aims to solve the two innate challenges, including how to generate semantically correct SQL queries in a test case, and how to propose effective oracles to capture logic bugs. To this end, our system proposes two key techniques. The first key technique is called context-sensitive instantiation, which considers all static semantic requirements (including but not limited to the identifier type used by existing systems) to generate semantically valid SQL queries. The second key technique is called multi-plan execution, which can effectively capture logic bugs. Given a test case, multi-plan execution makes the DBMS execute all query plans instead of the default optimal one, and compares the results. A logic bug is detected if a difference is found among the execution results of the executed query plans. We have implemented a prototype system called Kangaroo and applied it to three widely used and well-tested DBMSs, including SQLite, PostgreSQL, and MySQL. Our system successfully detected 50 new bugs. The comparison between our system with the state-of-the-art systems shows that our system outperforms them in terms of the number of generated semantically valid SQL queries, the explored code paths during testing, and the detected bugs.

cs.DB↗
arXiv2023

Three-Dimensional Quantum Anomalous Hall Effect in Magnetic Topological Insulator Trilayers of Hundred-Nanometer Thickness

Magnetic topological states refer to a class of exotic phases in magnetic materials with their non-trivial topological property determined by magnetic spin configurations. An example of such states is the quantum anomalous Hall (QAH) state, which is a zero magnetic field manifestation of the quantum Hall effect. Current research in this direction focuses on QAH insulators with a thickness of less than 10nm. The thick QAH insulators in the three-dimensional(3D) regime are limited, largely due to inevitable bulk carriers being introduced in thick magnetic TI samples. Here, we employ molecular beam epitaxy (MBE) to synthesize magnetic TI trilayers with a thickness of up to ~106 nm. We find these samples exhibit well-quantized Hall resistance and vanishing longitudinal resistance at zero magnetic field. By varying magnetic dopants, gate voltages, temperature, and external magnetic fields, we examine the properties of these thick QAH insulators and demonstrate the robustness of the 3D QAH effect. The realization of the well-quantized 3D QAH effect indicates that the nonchiral side surface states of our thick magnetic TI trilayers are gapped and thus do not affect the QAH quantization. The 3D QAH insulators of hundred-nanometer thickness provide a promising platform for the exploration of fundamental physics, including axion physics and image magnetic monopole, and the advancement of electronic and spintronic devices to circumvent Moore's law.

cond-mat.mes-hall↗
arXiv2023

Interface-Induced Superconductivity in Magnetic Topological Insulator-Iron Chalcogenide Heterostructures

When two different electronic materials are brought together, the resultant interface often shows unexpected quantum phenomena, including interfacial superconductivity and Fu-Kane topological superconductivity (TSC). Here, we use molecular beam epitaxy (MBE) to synthesize heterostructures formed by stacking together two magnetic materials, a ferromagnetic topological insulator (TI) and an antiferromagnetic iron chalcogenide (FeTe). We discover emergent interface-induced superconductivity in these heterostructures and demonstrate the trifecta occurrence of superconductivity, ferromagnetism, and topological band structure in the magnetic TI layer, the three essential ingredients of chiral TSC. The unusual coexistence of ferromagnetism and superconductivity can be attributed to the high upper critical magnetic field that exceeds the Pauli paramagnetic limit for conventional superconductors at low temperatures. The magnetic TI/FeTe heterostructures with robust superconductivity and atomically sharp interfaces provide an ideal wafer-scale platform for the exploration of chiral TSC and Majorana physics, constituting an important step toward scalable topological quantum computation.

cond-mat.mes-hall↗
arXiv2023

Frequency Modulation of Gravitational Waves by Ultralight Scalar Dark Matter

The oscillating pressure of the ultralight scalar dark matter (DM) can induce the oscillation of the local gravitational potential. Similar to the time-dependent frequency shift for the pulse signals of pulsars, the oscillation of the local gravitational potential can induce a time-dependent frequency shift (or frequency modulation) for quasi-monochromatic gravitational wave (GW) signals from galactic white dwarf (WD) binaries. To make this effects detectable, we suppose that some galactic WD binaries are located in the DM clumps/subhalos where the energy density of DM is about eight orders of magnitude higher than that at the position of the Earth. Turn to the fisher information matrix, we find that the amplified GW frequency modulation induced by the ultralight scalar DM with mass $m=1.67\times10^{-23}-4.31\times10^{-23}[{\rm eV}/c^2]$ can be detected by LISA.

astro-ph.CO↗
arXiv2023

Selective Manipulation and Tunneling Spectroscopy of Broken-Symmetry Quantum Hall States in a Hybrid-edge Quantum Point Contact

We present a device architecture of hybrid-edge and dual-gated quantum point contact. We demonstrate improved electrostatic control over the separation, position, and coupling of each broken-symmetry compressible strip in graphene. Via low-temperature magneto-transport measurement, we demonstrate selective manipulation over the evolution, hybridization, and transmission of arbitrarily chosen quantum Hall states in the channel. With gate-tunable tunneling spectroscopy, we characterize the energy gap of each symmetry-broken quantum Hall state with high resolution on the order of ~0.1 meV.

cond-mat.mes-hall↗
arXiv2023

Tunable Inter-Moiré Physics in Consecutively-Twisted Trilayer Graphene

We fabricate a twisted trilayer graphene device with consecutive twist angles of 1.33 and 1.64 degrees, in which we electrostatically tune the electronic states from each of the two co-existing moiré superlattices and the interactions between them. When both moiré superlattices contribute equally to electrical transport, we report a new type of inter-moiré Hofstadter butterfly. Its Brown-Zak oscillation corresponds to one of the intermediate quasicrystal length scales of the reconstructed moiré of moiré (MoM) superlattice, shedding new light on emergent physics from competing atomic orders.

cond-mat.mes-hall↗
arXiv2023

The ALMA-QUARKS survey: -- I. Survey description and data reduction

This paper presents an overview of the QUARKS survey, which stands for `Querying Underlying mechanisms of massive star formation with ALMA-Resolved gas Kinematics and Structures'. The QUARKS survey is observing 139 massive clumps covered by 156 pointings at ALMA Band 6 ($λ\sim$ 1.3 mm). In conjunction with data obtained from the ALMA-ATOMS survey at Band 3 ($λ\sim$ 3 mm), QUARKS aims to carry out an unbiased statistical investigation of massive star formation process within protoclusters down to a scale of 1000 au. This overview paper describes the observations and data reduction of the QUARKS survey, and gives a first look at an exemplar source, the mini-starburst Sgr B2(M). The wide-bandwidth (7.5 GHz) and high-angular-resolution (~0.3 arcsec) observations of the QUARKS survey allow to resolve much more compact cores than could be done by the ATOMS survey, and to detect previously unrevealed fainter filamentary structures. The spectral windows cover transitions of species including CO, SO, N$_2$D$^+$, SiO, H$_{30}α$, H$_2$CO, CH$_3$CN and many other complex organic molecules, tracing gas components with different temperatures and spatial extents. QUARKS aims to deepen our understanding of several scientific topics of massive star formation, such as the mass transport within protoclusters by (hub-)filamentary structures, the existence of massive starless cores, the physical and chemical properties of dense cores within protoclusters, and the feedback from already formed high-mass young protostars.

astro-ph.GA↗
arXiv2023

Primordial Black Hole Mass Function with Mass Gap

Primordial black holes (PBHs) are mainly characterized by their mass function, in which there may be some huge suppression for certain mass spans. If this is the case, the absence of these PBHs will form mass gaps. In this paper, we investigate the PBH mass function with mass gap. Firstly, to obtain a data-supported PBH mass function with mass gap for subsolar masses PBHs, we fine-tune the coefficients of a model-independent power spectrum of primordial curvature perturbations. Then we take this unique PBH mass function into consideration and calculate the energy density spectrum of the stochastic gravitational wave background from PBH mergers. We find the location of its first peak almost has no relationship with the mass gap and is only determined by the probability distribution of frequencies at which PBH binaries merge. Apart from the first peak, there must be an accompanying smaller trough at higher frequency resulting from the mass gap. Therefore, the detection of this smaller trough will provide more information about inflation and PBH formation.

astro-ph.CO↗
arXiv2023

i-Razor: A Differentiable Neural Input Razor for Feature Selection and Dimension Search in DNN-Based Recommender Systems

Input features play a crucial role in DNN-based recommender systems with thousands of categorical and continuous fields from users, items, contexts, and interactions. Noisy features and inappropriate embedding dimension assignments can deteriorate the performance of recommender systems and introduce unnecessary complexity in model training and online serving. Optimizing the input configuration of DNN models, including feature selection and embedding dimension assignment, has become one of the essential topics in feature engineering. However, in existing industrial practices, feature selection and dimension search are optimized sequentially, i.e., feature selection is performed first, followed by dimension search to determine the optimal dimension size for each selected feature. Such a sequential optimization mechanism increases training costs and risks generating suboptimal input configurations. To address this problem, we propose a differentiable neural input razor (i-Razor) that enables joint optimization of feature selection and dimension search. Concretely, we introduce an end-to-end differentiable model to learn the relative importance of different embedding regions of each feature. Furthermore, a flexible pruning algorithm is proposed to achieve feature filtering and dimension derivation simultaneously. Extensive experiments on two large-scale public datasets in the Click-Through-Rate (CTR) prediction task demonstrate the efficacy and superiority of i-Razor in balancing model complexity and performance.

cs.IR↗
arXiv2023

The Case of Transparent Cache Invalidation in Web Applications

Application-level caches are widely adopted by web applications to minimize the response time of user requests as well as to reduce the burden on the system backend, such as the database servers. In the state of practice, developers have to take care of the data freshness of application-level caches manually. Given the growing complexities of today's web applications, it becomes increasingly challenging for developers to understand, reason about, and implement cache invalidation methods. Furthermore, according to our survey of open-source web application projects and engineers, it is indeed challenging to map database updates with cache entries at the application level. Therefore, we propose a design to handle data validity in a transparent and precise manner, without requiring any intervention from developers. Its main idea is to modify the DBMS to provide necessary information for cache management and enhance the cache with an invalidation index to identify and invalidate outdated data automatically and efficiently. Based on the design, we further provide two specific solutions. Our preliminary experiments indicate that our solutions could effectively achieve transparent cache invalidation while maintaining cost-effectiveness.

cs.DB↗
arXiv2023

Dirac-Fermion-Assisted Interfacial Superconductivity in Epitaxial Topological Insulator/Iron Chalcogenide Heterostructures

Over the last decade, the possibility of realizing topological superconductivity (TSC) has generated much excitement, mainly due to the potential use of its excitations (Majorana zero modes) in a fault-tolerant topological quantum computer 1,2. TSC can be created in electronic systems where the topological and superconducting orders coexist3, motivating the continued exploration of candidate material platforms to this end. Here, we use molecular beam epitaxy (MBE) to synthesize heterostructures that host emergent interfacial superconductivity when a non-superconducting antiferromagnet (FeTe) is interfaced with a topological insulator (TI) (Bi, Sb)2Te3 wherein the chemical potential can be tuned through varying the Bi/Sb ratio. By performing in-vacuo angle-resolved photoemission spectroscopy (ARPES) and ex-situ electrical transport measurements, we find that the superconducting transition temperature and the upper critical magnetic field are suppressed when the chemical potential approaches the Dirac point. This observation implies a direct correlation between the interfacial superconductivity and Dirac electrons of the TI layer. We provide evidence to show that the observed interfacial superconductivity and its chemical potential dependence is the result of the competition between the Ruderman-Kittel-Kasuya-Yosida-type ferromagnetic coupling mediated by Dirac surface states and antiferromagnetic exchange couplings that generate the bicollinear antiferromagnetic order in the FeTe layer. The Dirac-fermion-assisted interfacial superconductivity in (Bi,Sb)2Te3/FeTe heterostructures provides a new approach to probe TSC and Majorana physics in hybrid devices and potentially constitutes an alternative platform for topological quantum computation.

cond-mat.mes-hall↗
arXiv2023

A High-Mass Young Star-forming Core Escaping from Its Parental Filament

We studied the unique kinematic properties in massive filament G352.63-1.07 at $10^3$-AU spatial scale with the dense molecular tracers observed with the Atacama Large Millimeter/submillimeter Array (ALMA). We find the central massive core M1 (12 $M_\odot$) being separated from the surrounding filament with a velocity difference of $v- {v}_{sys}=-2$ km/s and a transverse separation within 3 arcsec. Meanwhile, as shown in multiple dense-gas tracers, M1 has a spatial extension closely aligned with the main filament and is connected to the filament towards its both ends. M1 thus represents a very beginning state for a massive young star-forming core escaping from the parental filament, within a time scale of $\sim 4000$ years. Based on its kinetic energy ($3.5\times10^{44}$ erg), the core escape is unlikely solely due to the original filament motion or magnetic field, but requires more energetic events such as a rapid intense anisotropic collapse. The released energy also seems to noticeably increase the environmental turbulence. This may help the filament to become stabilized again.

astro-ph.GA↗
arXiv2023

Contrastive Self-supervised Learning in Recommender Systems: A Survey

Deep learning-based recommender systems have achieved remarkable success in recent years. However, these methods usually heavily rely on labeled data (i.e., user-item interactions), suffering from problems such as data sparsity and cold-start. Self-supervised learning, an emerging paradigm that extracts information from unlabeled data, provides insights into addressing these problems. Specifically, contrastive self-supervised learning, due to its flexibility and promising performance, has attracted considerable interest and recently become a dominant branch in self-supervised learning-based recommendation methods. In this survey, we provide an up-to-date and comprehensive review of current contrastive self-supervised learning-based recommendation methods. Firstly, we propose a unified framework for these methods. We then introduce a taxonomy based on the key components of the framework, including view generation strategy, contrastive task, and contrastive objective. For each component, we provide detailed descriptions and discussions to guide the choice of the appropriate method. Finally, we outline open issues and promising directions for future research.

cs.IR↗
arXiv2023

Transport Study of Charge Carrier Scattering in Monolayer WSe$_2$

Employing flux-grown single crystal WSe$_2$, we report charge carrier scattering behaviors measured in $h$-BN encapsulated monolayer field effect transistors. We perform quantum transport measurements across various hole densities and temperatures and observe a non-monotonic change of transport mobility $μ$ as a function of hole density in the degenerately doped sample. This unusual behavior can be explained by energy dependent scattering amplitude of strong defects calculated using the T-matrix approximation. Utilizing long mean-free path ($>$500 nm), we demonstrate the high quality of our electronic devices by showing quantized conductance steps from an electrostatically-defined quantum point contact. Our results show the potential for creating ultra-high quality quantum optoelectronic devices based on atomically thin semiconductors.

cond-mat.mes-hall↗
arXiv2023

Synslator: An Interactive Machine Translation Tool with Online Learning

Interactive machine translation (IMT) has emerged as a progression of the computer-aided translation paradigm, where the machine translation system and the human translator collaborate to produce high-quality translations. This paper introduces Synslator, a user-friendly computer-aided translation (CAT) tool that not only supports IMT, but is adept at online learning with real-time translation memories. To accommodate various deployment environments for CAT services, Synslator integrates two different neural translation models to handle translation memories for online learning. Additionally, the system employs a language model to enhance the fluency of translations in an interactive mode. In evaluation, we have confirmed the effectiveness of online learning through the translation models, and have observed a 13% increase in post-editing efficiency with the interactive functionalities of Synslator. A tutorial video is available at:https://youtu.be/K0vRsb2lTt8.

cs.CL↗
arXiv2023

Burning the Adversarial Bridges: Robust Windows Malware Detection Against Binary-level Mutations

Toward robust malware detection, we explore the attack surface of existing malware detection systems. We conduct root-cause analyses of the practical binary-level black-box adversarial malware examples. Additionally, we uncover the sensitivity of volatile features within the detection engines and exhibit their exploitability. Highlighting volatile information channels within the software, we introduce three software pre-processing steps to eliminate the attack surface, namely, padding removal, software stripping, and inter-section information resetting. Further, to counter the emerging section injection attacks, we propose a graph-based section-dependent information extraction scheme for software representation. The proposed scheme leverages aggregated information within various sections in the software to enable robust malware detection and mitigate adversarial settings. Our experimental results show that traditional malware detection models are ineffective against adversarial threats. However, the attack surface can be largely reduced by eliminating the volatile information. Therefore, we propose simple-yet-effective methods to mitigate the impacts of binary manipulation attacks. Overall, our graph-based malware detection scheme can accurately detect malware with an area under the curve score of 88.32\% and a score of 88.19% under a combination of binary manipulation attacks, exhibiting the efficiency of our proposed scheme.

cs.LG↗
arXiv2023

MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning

The recently released GPT-4 Code Interpreter has demonstrated remarkable proficiency in solving challenging math problems, primarily attributed to its ability to seamlessly reason with natural language, generate code, execute code, and continue reasoning based on the execution output. In this paper, we present a method to fine-tune open-source language models, enabling them to use code for modeling and deriving math equations and, consequently, enhancing their mathematical reasoning abilities. We propose a method of generating novel and high-quality datasets with math problems and their code-based solutions, referred to as MathCodeInstruct. Each solution interleaves natural language, code, and execution results. We also introduce a customized supervised fine-tuning and inference approach. This approach yields the MathCoder models, a family of models capable of generating code-based solutions for solving challenging math problems. Impressively, the MathCoder models achieve state-of-the-art scores among open-source LLMs on the MATH (45.2%) and GSM8K (83.9%) datasets, substantially outperforming other open-source alternatives. Notably, the MathCoder model not only surpasses ChatGPT-3.5 and PaLM-2 on GSM8K and MATH but also outperforms GPT-4 on the competition-level MATH dataset. The dataset and models will be released at https://github.com/mathllm/MathCoder.

cs.CL↗