arXiv subjects

Xuesong He

Publications and source records attributed to Xuesong He.

3 recordsLinked to original sources

arXiv2025

On the Superimposed Noise Accumulation Problem in Sequential Knowledge Editing of Large Language Models

Sequential knowledge editing techniques aim to continuously update knowledge in large language models at low cost, preventing models from generating outdated or incorrect information. However, existing sequential editing methods suffer from a significant decline in editing success rates after long-term editing. Through theoretical analysis and experiments, our findings reveal that as the number of edits increases, the model's output increasingly deviates from the desired target, leading to a drop in editing success rates. We refer to this issue as the superimposed noise accumulation problem. Our further analysis demonstrates that the problem is related to the erroneous activation of irrelevant knowledge and conflicts between activated knowledge. Based on this analysis, a method named DeltaEdit is proposed that reduces conflicts between knowledge through dynamic orthogonal constraint strategies. Experiments show that DeltaEdit significantly reduces superimposed noise, achieving a 16.8% improvement in editing performance over the strongest baseline.

cs.CL↗

arXiv2024

ChemEval: A Comprehensive Multi-Level Chemical Evaluation for Large Language Models

There is a growing interest in the role that LLMs play in chemistry which lead to an increased focus on the development of LLMs benchmarks tailored to chemical domains to assess the performance of LLMs across a spectrum of chemical tasks varying in type and complexity. However, existing benchmarks in this domain fail to adequately meet the specific requirements of chemical research professionals. To this end, we propose \textbf{\textit{ChemEval}}, which provides a comprehensive assessment of the capabilities of LLMs across a wide range of chemical domain tasks. Specifically, ChemEval identified 4 crucial progressive levels in chemistry, assessing 12 dimensions of LLMs across 42 distinct chemical tasks which are informed by open-source data and the data meticulously crafted by chemical experts, ensuring that the tasks have practical value and can effectively evaluate the capabilities of LLMs. In the experiment, we evaluate 12 mainstream LLMs on ChemEval under zero-shot and few-shot learning contexts, which included carefully selected demonstration examples and carefully designed prompts. The results show that while general LLMs like GPT-4 and Claude-3.5 excel in literature understanding and instruction following, they fall short in tasks demanding advanced chemical knowledge. Conversely, specialized LLMs exhibit enhanced chemical competencies, albeit with reduced literary comprehension. This suggests that LLMs have significant potential for enhancement when tackling sophisticated tasks in the field of chemistry. We believe our work will facilitate the exploration of their potential to drive progress in chemistry. Our benchmark and analysis will be available at {\color{blue} \url{https://github.com/USTC-StarTeam/ChemEval}}.

cs.CL↗

arXiv2023

Unraveling the Link between Periodontitis and Inflammatory Bowel Disease: Challenges and Outlook

Periodontitis and Inflammatory Bowel Disease (IBD) are chronic inflammatory conditions, characterized by microbial dysbiosis and hyper-immunoinflammatory responses. Growing evidence suggest an interconnection between periodontitis and IBD, implying a shift from the traditional concept of independent diseases to a complex, reciprocal cycle. This review outlines the evidence supporting an Oral-Gut axis, marked by a higher prevalence of periodontitis in IBD patients and vice versa. The specific mechanisms linking periodontitis and IBD remain to be fully elucidated, but emerging evidence points to the ectopic colonization of the gut by oral bacteria, which promote intestinal inflammation by activating host immune responses. This review presents an in-depth examination of the interconnection between periodontitis and IBD, highlighting the shared microbiological and immunological pathways, and proposing a multi-hit hypothesis in the pathogenesis of periodontitis-mediated intestinal inflammation. Furthermore, the review underscores the critical need for a collaborative approach between dentists and gastroenterologists to provide holistic oral-systemic healthcare.

q-bio.TO↗