Searcharxiv⌕ Search

arXiv subjects

Qiao Qiao

Publications and source records attributed to Qiao Qiao.

13 recordsLinked to original sources

Bridging Lexical Divergence: LLM-Assisted, Cost-Efficient, Zero-shot Scientific Entity Linking

Scientific domain entity linking (EL) differs from general domain EL because mentions and entity names often lack lexical overlap. Another challenge is that specialized terminology is used in the scientific domain, which is rarely encountered in models pretrained on general domains. Therefore, models trained on general domains transfer poorly to scientific domains. To address this, in-domain fine-tuning is the natural remedy. However, many scientific domains lack expert-annotated data, motivating the need for a zero-human-annotation approach. Existing zero-shot methods heavily rely on LLMs to generate aliases across entire mention corpora, which incurs substantial computational cost, and those methods provide no mechanism to filter out noise from LLMs. To address these challenges, we propose Sci-ZSEL, a framework that selectively generates entity aliases with an LLM to control computational cost, and applies an ontology-aware filter to remove aliases that semantically drift toward ontology neighbors. Then, filtered aliases are used to construct pseudo-labeled mention-entity pairs for fine-tuning. To enable evaluation of EL under low lexical overlap, we also release a new animal science EL benchmark linked to three livestock trait ontologies, where mentions and entities exhibit substantially lower lexical overlap than in existing benchmarks. Across five benchmarks, Sci-ZSEL outperforms the non-fine-tuned baseline, is most useful on nonoverlapping mentions, and combining it with curated synonyms gives the best performance in most settings.

cs.CL↗

Investigating Context-Faithfulness in Large Language Models: The Roles of Memory Strength and Evidence Style

Retrieval-augmented generation (RAG) improves Large Language Models (LLMs) by incorporating external information into the response generation process. However, how context-faithful LLMs are and what factors influence LLMs' context faithfulness remain largely unexplored. In this study, we investigate the impact of memory strength and evidence presentation on LLMs' receptiveness to external evidence. We quantify the memory strength of LLMs by measuring the divergence in LLMs' responses to different paraphrases of the same question, which is not considered by previous works. We also generate evidence in various styles to examine LLMs' behavior. Our results show that for questions with high memory strength, LLMs are more likely to rely on internal memory. Furthermore, presenting paraphrased evidence significantly increases LLMs' receptiveness compared to simple repetition or adding details. These findings provide key insights for improving retrieval-augmented generation and context-aware LLMs. Our code is available at https://github.com/liyp0095/ContextFaithful.

cs.CL↗

Relation-Aware Network with Attention-Based Loss for Few-Shot Knowledge Graph Completion

Few-shot knowledge graph completion (FKGC) task aims to predict unseen facts of a relation with few-shot reference entity pairs. Current approaches randomly select one negative sample for each reference entity pair to minimize a margin-based ranking loss, which easily leads to a zero-loss problem if the negative sample is far away from the positive sample and then out of the margin. Moreover, the entity should have a different representation under a different context. To tackle these issues, we propose a novel Relation-Aware Network with Attention-Based Loss (RANA) framework. Specifically, to better utilize the plentiful negative samples and alleviate the zero-loss issue, we strategically select relevant negative samples and design an attention-based loss function to further differentiate the importance of each negative sample. The intuition is that negative samples more similar to positive samples will contribute more to the model. Further, we design a dynamic relation-aware entity encoder for learning a context-dependent entity representation. Experiments demonstrate that RANA outperforms the state-of-the-art models on two benchmark datasets.

cs.CL↗

Bridge: A Unified Framework to Knowledge Graph Completion via Language Models and Knowledge Representation

Knowledge graph completion (KGC) is a task of inferring missing triples based on existing Knowledge Graphs (KGs). Both structural and semantic information are vital for successful KGC. However, existing methods only use either the structural knowledge from the KG embeddings or the semantic information from pre-trained language models (PLMs), leading to suboptimal model performance. Moreover, since PLMs are not trained on KGs, directly using PLMs to encode triples may be inappropriate. To overcome these limitations, we propose a novel framework called Bridge, which jointly encodes structural and semantic information of KGs. Specifically, we strategically encode entities and relations separately by PLMs to better utilize the semantic knowledge of PLMs and enable structured representation learning via a structural learning principle. Furthermore, to bridge the gap between KGs and PLMs, we employ a self-supervised representation learning method called BYOL to fine-tune PLMs with two different views of a triple. Unlike BYOL, which uses augmentation methods to create two semantically similar views of the same image, potentially altering the semantic information. We strategically separate the triple into two parts to create different views, thus avoiding semantic alteration. Experiments demonstrate that Bridge outperforms the SOTA models on three benchmark datasets.

cs.CL↗

Towards a More Generalized Approach in Open Relation Extraction

Open Relation Extraction (OpenRE) seeks to identify and extract novel relational facts between named entities from unlabeled data without pre-defined relation schemas. Traditional OpenRE methods typically assume that the unlabeled data consists solely of novel relations or is pre-divided into known and novel instances. However, in real-world scenarios, novel relations are arbitrarily distributed. In this paper, we propose a generalized OpenRE setting that considers unlabeled data as a mixture of both known and novel instances. To address this, we propose MixORE, a two-phase framework that integrates relation classification and clustering to jointly learn known and novel relations. Experiments on three benchmark datasets demonstrate that MixORE consistently outperforms competitive baselines in known relation classification and novel relation clustering. Our findings contribute to the advancement of generalized OpenRE research and real-world applications.

cs.CL↗

Re-Examine Distantly Supervised NER: A New Benchmark and a Simple Approach

Distantly-Supervised Named Entity Recognition (DS-NER) uses knowledge bases or dictionaries for annotations, reducing manual efforts but rely on large human labeled validation set. In this paper, we introduce a real-life DS-NER dataset, QTL, where the training data is annotated using domain dictionaries and the test data is annotated by domain experts. This dataset has a small validation set, reflecting real-life scenarios. Existing DS-NER approaches fail when applied to QTL, which motivate us to re-examine existing DS-NER approaches. We found that many of them rely on large validation sets and some used test set for tuning inappropriately. To solve this issue, we proposed a new approach, token-level Curriculum-based Positive-Unlabeled Learning (CuPUL), which uses curriculum learning to order training samples from easy to hard. This method stabilizes training, making it robust and effective on small validation sets. CuPUL also addresses false negative issues using the Positive-Unlabeled learning paradigm, demonstrating improved performance in real-life applications.

cs.CL↗

Improving Unsupervised Relation Extraction by Augmenting Diverse Sentence Pairs

Unsupervised relation extraction (URE) aims to extract relations between named entities from raw text without requiring manual annotations or pre-existing knowledge bases. In recent studies of URE, researchers put a notable emphasis on contrastive learning strategies for acquiring relation representations. However, these studies often overlook two important aspects: the inclusion of diverse positive pairs for contrastive learning and the exploration of appropriate loss functions. In this paper, we propose AugURE with both within-sentence pairs augmentation and augmentation through cross-sentence pairs extraction to increase the diversity of positive pairs and strengthen the discriminative power of contrastive learning. We also identify the limitation of noise-contrastive estimation (NCE) loss for relation representation learning and propose to apply margin loss for sentence pairs. Experiments on NYT-FB and TACRED datasets demonstrate that the proposed relation representation learning and a simple K-Means clustering achieves state-of-the-art performance.

cs.CL↗

Improving Distantly Supervised Relation Extraction by Natural Language Inference

To reduce human annotations for relation extraction (RE) tasks, distantly supervised approaches have been proposed, while struggling with low performance. In this work, we propose a novel DSRE-NLI framework, which considers both distant supervision from existing knowledge bases and indirect supervision from pretrained language models for other tasks. DSRE-NLI energizes an off-the-shelf natural language inference (NLI) engine with a semi-automatic relation verbalization (SARV) mechanism to provide indirect supervision and further consolidates the distant annotations to benefit multi-classification RE models. The NLI-based indirect supervision acquires only one relation verbalization template from humans as a semantically general template for each relationship, and then the template set is enriched by high-quality textual patterns automatically mined from the distantly annotated corpus. With two simple and effective data consolidation strategies, the quality of training data is substantially improved. Extensive experiments demonstrate that the proposed framework significantly improves the SOTA performance (up to 7.73\% of F1) on distantly supervised RE benchmark datasets.

cs.CL↗

Factors limiting ferroelectric field-effect doping in complex-oxide heterostructures

Ferroelectric field-effect doping has emerged as a powerful approach to manipulate the ground state of correlated oxides, opening the door to a new class of field-effect devices. However, this potential is not fully exploited so far, since the size of the field-effect doping is generally much smaller than expected. Here we study the limiting factors through magneto-transport, scanning transmission electron and piezo-response force microscopy in ferroelectric/superconductor (YBa2Cu3O7-δ /BiFeO3) heterostructures, a model system showing very strong field-effects. Still, we find that they are limited in the first place by an incomplete ferroelectric switching. This can be explained by the existence of a preferential polarization direction set by the atomic terminations at the interface. More importantly, we also find that the field-effect carrier doping is accompanied by a strong modulation of the carrier mobility. Besides making quantification of field-effects via Hall measurements not straightforward, this finding suggests that ferroelectric poling produces structural changes (e.g. charged defects or structural distortions) in the correlated oxide channel. Those findings have important consequences for the understanding of ferroelectric field-effects and for the strategies to further enhance them.

cond-mat.mtrl-sci↗

Ambient Electro-Synthesis of Ammonia - Electrode Porosity and Composition Engineering

Ammonia, key precursor for fertilizer production, convenient hydrogen carrier and emerging clean fuel, plays a pivotal role in sustaining life on earth. Currently, the main route for NH3 synthesis is via the heterogeneous catalytic Haber-Bosch process (N2+3H2 - 2NH3), which proceeds under extreme conditions of temperature and pressure with a very large carbon footprint. Herein we report that a pristine nitrogen-doped nanoporous graphitic carbon membrane (NCM) can electrochemically convert N2 into NH3 in an aqueous acidic solution under ambient conditions. The Faradaic efficiency and rate of production of NH3 on the NCM electrode reach 5.2% and 0.08 g m-2 h-1, respectively. After functionalization of the NCM with Au nanoparticles (Au NPs) these performance metrics are dramatically enhanced to 22% and 0.36 g m-2 h-1, respectively. These efficiencies and rates for the production of NH3 at room temperature and atmospheric pressure are unprecedented. As this system offers the potential to be scaled to industrial proportions there is a high likelihood it might displace the century old Haber-Bosch process.

physics.chem-ph↗

Constructing oxide interfaces and heterostructures by atomic layer-by-layer laser molecular beam epitaxy

Advancements in nanoscale engineering of oxide interfaces and heterostructures have led to discoveries of emergent phenomena and new artificial materials. Combining the strengths of reactive molecular-beam epitaxy and pulsed-laser deposition, we show here, with examples of Sr1+xTi1-xO3+delta, Ruddlesden-Popper phase Lan+1NinO3n+1 (n = 4), and LaAl1+yO3(1+0.5y)/SrTiO3 interfaces, that atomic layer-by-layer laser molecular-beam epitaxy (ALL-Laser MBE) significantly advances the state of the art in constructing oxide materials with atomic layer precision and control over stoichiometry. With ALL-Laser MBE we have produced conducting LaAlO3/SrTiO3 interfaces at high oxygen pressures that show no evidence of oxygen vacancies, a capability not accessible by existing techniques. The carrier density of the interfacial two-dimensional electron gas thus obtained agrees quantitatively with the electronic reconstruction mechanism.

cond-mat.mes-hall↗

Dynamical control of orbital occupations via a ferroelectric-induced polar state in metallic manganites

The breaking of orbital degeneracy on a transition metal cation and the resulting unequal electronic occupations of these orbitals provide a powerful lever over electron density and spin ordering in metal oxides. Here, we show how to dynamically modulate the orbital populations on Mn atoms at ferroelectric/manganite interfaces by switching the ferroelectric polarization. The change in orbital occupation can be as large as 10\%, greatly exceeding that of bulk manganites. This flippable orbital splitting is in large part controlled by the propagation of ferroelectric polar displacements into the interfacial region, a structural motif absent in the bulk and unique to the interface. We use {\it ab initio} theory, epitaxial thin film growth, and scanning transmission electron microscopy to verify the predicted interfacial polar state and concomitant orbital splittings.

cond-mat.mtrl-sci↗

Reversible modulation of orbital occupations via an interface-induced state in metallic manganites

The breaking of orbital degeneracy on a transition metal cation and the resulting unequal electronic occupations of these orbitals provide a powerful lever over electron density and spin ordering inmetal oxides. Here, we use ab initio calculations to show that reversibly modulating the orbital populations on Mn atoms can be achieved at ferroelectric/manganite interfaces by the presence of ferroelectric polarization on the nanoscale. The change in orbital occupation can be as large as 10%, greatly exceeding that of bulk manganites. This reversible orbital splitting is in large part controlled by the propagation of ferroelectric polar displacements into the interfacial region, a structural motif absent in the bulk and unique to the interface. We use epitaxial thin film growth and scanning transmission electron microscopy to verify this key interfacial polar distortion and discuss the potential of reversible control of orbital polarization via nanoscale ferroelectrics.

cond-mat.mtrl-sci↗