SearcharxivSearch

arXiv subjects

Qiyao Peng

Publications and source records attributed to Qiyao Peng.

At least 19 recordsLinked to original sources

Unsupervised Graph Representation Learning with Complementary View Alignment

Unsupervised graph representation learning aims to derive meaningful node embeddings by capturing both structural and attribute information without relying on labeled data. Existing methods, such as GAEs, have demonstrated effectiveness but typically rely on message-passing mechanisms that assume homophily, leading to performance degradation on heterophilous graphs, where connected nodes exhibit dissimilar features. This homophily bias results in the loss of critical high-frequency components that are essential for identifying heterophilous patterns. To address these challenges, we propose \textsc{AlignGAE}, a novel extension of \textit{MaskGAE} that preserves the full frequency spectrum through complementary view alignment. Our framework introduces a dual-encoder architecture that separately processes structural and attribute information, incorporates node positional encoding to approximate Neighborhood Identity Distribution (NID), and employs dual reconstruction tasks for both edges and node attributes. We further propose theoretically grounded NID alignment strategies that ensure semantic consistency across views while preserving their distinct characteristics. Through comprehensive spectral analysis, we demonstrate that \textsc{AlignGAE} achieves optimal representation properties when the alignment loss converges. Extensive experiments across 12 benchmark datasets validate our approach, showing that \textsc{AlignGAE} outperforms state-of-the-art methods by up to 18.7\% on heterophilous graphs in node classification, while maintaining competitive performance on homophilous graphs. Our results establish a new paradigm for frequency-aware graph representation learning.

cs.LG

MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QA

Iterative retrieval-reasoning agents have recently shown promise for multimodal long-document question answering. However, most existing systems maintain a single growing context that mixes retrieval traces, observations, and intermediate reasoning. As interactions accumulate, key evidence becomes scattered and diluted, making multi-hop reasoning noisy. We propose MARDoc, a Memory-Aware Refinement Agent framework that decouples long-document QA into three specialized agents: an Explorer for multi-granularity multimodal retrieval, a Refiner for distilling interaction traces into structured evidence and reasoning memories, and a Reflector for checking evidence sufficiency and providing targeted feedback. Across iterations, the agents rely on a dynamically updated structured memory rather than a full accumulated interaction history. This design reduces context noise while preserving answer-critical facts and their logical dependencies. Experiments on MMLongBench-Doc and DocBench show that MARDoc achieves strong results, outperforming same-backbone baselines and demonstrating the effectiveness of structured memory for agentic document QA.

cs.CL

Recent Analytical and Computational Developments on the Advection-Diffusion-Reaction Wildfire Model

Wildfires represent a problem for ecosystems, human activities, and economies, driven by the climate crisis and land-use changes. Predicting wildfire propagation through mathematical modelling is essential for damage mitigation and risk assessment. This paper provides a comprehensive review of a physics-based Advection-Diffusion-Reaction (ADR) model, focusing on the balance between physical accuracy and computational efficiency. We analyze the ability of the ADR model to estimate fire front speed and behaviour and discuss its preliminary mathematical properties. Additionally, we discuss some modelling improvements which enhance the physical realism of the model. Furthermore, we address the challenge of reducing computational costs, emphasizing the need for inexpensive but precise numerical schemes. We report recent findings outlining open challenges in model discretization and technological solutions. All these developments highlight the potential of ADR models as powerful tools for efficient wildfire simulation and risk assessment.

math.AP

Towards Data-Driven Modeling of Cell Cycle and Wound Closure Processes

Effective wound repair treatments rely on a clear picture of how cell proliferation and migration are coordinated during tissue restoration. Fibroblasts are key contributors to tissue restoration in the dermis, and modern imaging tools allow their cell-cycle progression to be observed directly, enabling comparison between experiments and computational models. Here we investigate how different stages of the cell cycle influence fibroblast-driven wound closure using the Discrete Laplacian Cell Mechanics (DLCM) framework driven by time-lapse microscopy data. \textit{In vitro} assays provide cell positions, migration behaviour, and cycle-stage information, and we show that incorporating proliferation, migration, and cell cycle arrest allows the computational model to reproduce the essential experimental trends. The results reveal that arrest in the G1 phase notably impacts the cell cycle dynamics and that the initial spatial arrangement of cycle states significantly affects wound closure. By linking single-cell cycle dynamics with emergent tissue behaviour this work establishes a quantitative approach for exploring how intracellular processes shape repair processes. More broadly, it demonstrates the value of integrating high-resolution data with cell-based mechanical models and provides a foundation for systematic \textit{in silico} evaluation of therapeutic interventions.

q-bio.CB

Benchmark Leakage Trap: Can We Trust LLM-based Recommendation?

The expanding integration of Large Language Models (LLMs) into recommender systems poses critical challenges to evaluation reliability. This paper identifies and investigates a previously overlooked issue: benchmark data leakage in LLM-based recommendation. This phenomenon occurs when LLMs are exposed to and potentially memorize benchmark datasets during pre-training or fine-tuning, leading to artificially inflated performance metrics that fail to reflect true model performance. To validate this phenomenon, we simulate diverse data leakage scenarios by conducting continued pre-training of foundation models on strategically blended corpora, which include user-item interactions from both in-domain and out-of-domain sources. Our experiments reveal a dual-effect of data leakage: when the leaked data is domain-relevant, it induces substantial but spurious performance gains, misleadingly exaggerating the model's capability. In contrast, domain-irrelevant leakage typically degrades recommendation accuracy, highlighting the complex and contingent nature of this contamination. Our findings reveal that data leakage acts as a critical, previously unaccounted-for factor in LLM-based recommendation, which could impact the true model performance. We release our code at https://github.com/yusba1/LLMRec-Data-Leakage.

cs.LG

Positivity and long-term behaviour of a diffusion model with measure-valued nonlocal reaction term

The behaviour is investigated of solutions to a diffusion equation on the real line with nonlocal and singular reaction term, i.e., given by a Dirac source or sink at the origin. It gives a simplified representation of for example a control system that senses concentration at a distance, but "intervenes" at the origin. Positivity of solutions (for positive initial conditions) cannot be guaranteed for all parameter settings in the model. We determine a parameter regime and conditions on the positive initial condition in terms of monotonicity and symmetry, that do allow us to conclude the positivity of the solution for all time. In addition, we provide conditions that ensure convergence of the system to a constant steady state (pointwise), outside the region of observation. Technically, we extensively use Laplace transform arguments to achieve these results.

math.AP

A Stabilized Finite Element Method for Morpho-Visco-Poroelastic Model

We propose a mathematical model that combines elastic, viscous and porous effects with growth or shrinkage due to microstructural changes. This phenomenon is important in tissue or tumor growth, as well as in dermal contraction. Although existence results of the solution to the problem are not given, the current study assesses stability of the equilibria for both the continuous and semi-discrete versions of the model. Furthermore, a numerical condition for monotonicity of the numerical solution is described, as well as a way to stabilize the numerical solution so that spurious oscillations are avoided. The derived stabilization result is confirmed by computer simulations. In order to have a more quantitative picture, the total variation has been evaluated as a function of the stabilization parameter.

math.NA

On the Inversion of Polynomials of Discrete Laplace Matrices

The efficient inversion of matrix polynomials is a critical challenge in computational mathematics. We design a procedure to determine the inverse of matrices polynomial of multidimensional Laplace matrices. The method is based on eigenvector and eigenvalue expansions. The method is consistent with previous expressions of the inverse discretized Laplacian in one spatial dimension \citep{Vermolen_2022}. Several examples are given.

math.NA

FRONTIER-RevRec: A Large-scale Dataset for Reviewer Recommendation

Reviewer recommendation is a critical task for enhancing the efficiency of academic publishing workflows. However, research in this area has been persistently hindered by the lack of high-quality benchmark datasets, which are often limited in scale, disciplinary scope, and comparative analyses of different methodologies. To address this gap, we introduce FRONTIER-RevRec, a large-scale dataset constructed from authentic peer review records (2007-2025) from the Frontiers open-access publishing platform https://www.frontiersin.org/. The dataset contains 177941 distinct reviewers and 478379 papers across 209 journals spanning multiple disciplines including clinical medicine, biology, psychology, engineering, and social sciences. Our comprehensive evaluation on this dataset reveals that content-based methods significantly outperform collaborative filtering. This finding is explained by our structural analysis, which uncovers fundamental differences between academic recommendation and commercial domains. Notably, approaches leveraging language models are particularly effective at capturing the semantic alignment between a paper's content and a reviewer's expertise. Furthermore, our experiments identify optimal aggregation strategies to enhance the recommendation pipeline. FRONTIER-RevRec is intended to serve as a comprehensive benchmark to advance research in reviewer recommendation and facilitate the development of more effective academic peer review systems. The FRONTIER-RevRec dataset is available at: https://anonymous.4open.science/r/FRONTIER-RevRec-5D05.

cs.IR

Approximating a spatially-heterogeneously mass-emitting object by multiple point sources in a diffusion model

Various biological cells secrete diffusing chemical compounds into their environment for communication purposes. Secretion usually takes place over the cell membrane in a spatially heterogeneous manner. Mathematical models of these processes will be part of more elaborate models, e.g. of the movement of immune cells that react to cytokines in their environment. Here, we compare two approaches to modelling of the secretion-diffusion process of signalling compounds. The first is the so-called spatial exclusion model, in which the intracellular space is excluded from consideration and the computational space is the extracellular environment. The second consists of point source models, where the secreting cell is replaced by one or more non-spatial point sources or sinks, using -- mathematically -- Dirac delta distributions. We propose a multi-Dirac approach and provide explicit expressions for the intensities of the Dirac distributions. We show that two to three well-positioned Dirac points suffice to approximate well a temporally constant but spatially heterogeneous flux distribution of compound over the cell membrane, for a wide range of variation in flux density and diffusivity. The multi-Dirac approach is compared to a single-Dirac approach that was studied in previous work. Moreover, an explicit Green's function approach is introduced that has significant benefits in circumventing numerical instability that may occur when the Dirac sources have high intensities.

math.NA

A Survey on LLM-powered Agents for Recommender Systems

Recommender systems are essential components of many online platforms, yet traditional approaches still struggle with understanding complex user preferences and providing explainable recommendations. The emergence of Large Language Model (LLM)-powered agents offers a promising approach by enabling natural language interactions and interpretable reasoning, potentially transforming research in recommender systems. This survey provides a systematic review of the emerging applications of LLM-powered agents in recommender systems. We identify and analyze three key paradigms in current research: (1) Recommender-oriented approaches, which leverage intelligent agents to enhance the fundamental recommendation mechanisms; (2) Interaction-oriented approaches, which facilitate dynamic user engagement through natural dialogue and interpretable suggestions; and (3) Simulation-oriented approaches, which employ multi-agent frameworks to model complex user-item interactions and system dynamics. Beyond paradigm categorization, we analyze the architectural foundations of LLM-powered recommendation agents, examining their essential components: profile construction, memory management, strategic planning, and action execution. Our investigation extends to a comprehensive analysis of benchmark datasets and evaluation frameworks in this domain. This systematic examination not only illuminates the current state of LLM-powered agent recommender systems but also charts critical challenges and promising research directions in this transformative field.

cs.IR

Multi-Agent Collaboration for Multilingual Code Instruction Tuning

Recent advancement in code understanding and generation demonstrates that code LLMs fine-tuned on a high-quality instruction dataset can gain powerful capabilities to address wide-ranging code-related tasks. However, most previous existing methods mainly view each programming language in isolation and ignore the knowledge transfer among different programming languages. To bridge the gap among different programming languages, we introduce a novel multi-agent collaboration framework to enhance multilingual instruction tuning for code LLMs, where multiple language-specific intelligent agent components with generation memory work together to transfer knowledge from one language to another efficiently and effectively. Specifically, we first generate the language-specific instruction data from the code snippets and then provide the generated data as the seed data for language-specific agents. Multiple language-specific agents discuss and collaborate to formulate a new instruction and its corresponding solution (A new programming language or existing programming language), To further encourage the cross-lingual transfer, each agent stores its generation history as memory and then summarizes its merits and faults. Finally, the high-quality multilingual instruction data is used to encourage knowledge transfer among different programming languages to train Qwen2.5-xCoder. Experimental results on multilingual programming benchmarks demonstrate the superior performance of Qwen2.5-xCoder in sharing common knowledge, highlighting its potential to reduce the cross-lingual gap.

cs.CL

ExecRepoBench: Multi-level Executable Code Completion Evaluation

Code completion has become an essential tool for daily software development. Existing evaluation benchmarks often employ static methods that do not fully capture the dynamic nature of real-world coding environments and face significant challenges, including limited context length, reliance on superficial evaluation metrics, and potential overfitting to training datasets. In this work, we introduce a novel framework for enhancing code completion in software development through the creation of a repository-level benchmark ExecRepoBench and the instruction corpora Repo-Instruct, aim at improving the functionality of open-source large language models (LLMs) in real-world coding scenarios that involve complex interdependencies across multiple files. ExecRepoBench includes 1.2K samples from active Python repositories. Plus, we present a multi-level grammar-based completion methodology conditioned on the abstract syntax tree to mask code fragments at various logical units (e.g. statements, expressions, and functions). Then, we fine-tune the open-source LLM with 7B parameters on Repo-Instruct to produce a strong code completion baseline model Qwen2.5-Coder-Instruct-C based on the open-source model. Qwen2.5-Coder-Instruct-C is rigorously evaluated against existing benchmarks, including MultiPL-E and ExecRepoBench, which consistently outperforms prior baselines across all programming languages. The deployment of \ourmethod{} can be used as a high-performance, local service for programming development\footnote{\url{https://execrepobench.github.io/}}.

cs.CL

ULMRec: User-centric Large Language Model for Sequential Recommendation

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches predominantly focus on modeling item-level co-occurrence patterns while failing to adequately capture user-level personalized preferences. This is problematic since even users who display similar behavioral patterns (e.g., clicking or purchasing similar items) may have fundamentally different underlying interests. To alleviate this problem, in this paper, we propose ULMRec, a framework that effectively integrates user personalized preferences into LLMs for sequential recommendation. Considering there has the semantic gap between item IDs and LLMs, we replace item IDs with their corresponding titles in user historical behaviors, enabling the model to capture the item semantics. For integrating the user personalized preference, we design two key components: (1) user indexing: a personalized user indexing mechanism that leverages vector quantization on user reviews and user IDs to generate meaningful and unique user representations, and (2) alignment tuning: an alignment-based tuning stage that employs comprehensive preference alignment tasks to enhance the model's capability in capturing personalized information. Through this design, ULMRec achieves deep integration of language semantics with user personalized preferences, facilitating effective adaptation to recommendation. Extensive experiments on two public datasets demonstrate that ULMRec significantly outperforms existing methods, validating the effectiveness of our approach.

cs.IR

Convergence of the Immersed Interface Method in Linear Elasticity

We consider an open, bounded, simply connected (Lipschitz) domain in $\mathbb{R}^d$, which contains a closed polyhedral surface or polygonal contour, referred to as the interface. From this interface, forces are exerted in the normal direction. The forces are continuously distributed over the interface, resulting in an integral expression. This features an important characteristic of the immersed interface method. Since the integral cannot be resolved exactly, one relies on numerical quadrature rules to approximate the integral. Therefore, we consider two different linear elasticity problems with forces over a curve or surface (interface) that is located within the (open) domain of computation: (1) The force is defined by an integral over the interface; (2) The force is defined by a quadrature approximation of the integral over the interface. We prove that the ${\bf L}^2$-norm of the difference between the solutions from the two elasticity problems is of the same order as the error of quadrature. The results are demonstrated for both bounded and unbounded domains. The proof that we establish relies on the use of: (i) fundamental solutions for linear elasticity, exhibiting singular behaviors (in particular around points of action) and not being in ${\bf H}^1$, and (ii) on the use of singularity removal principle and the Extended Trace Theorem. Convergence is demonstrated in the ${\bf L}^2$-norm on curves and manifolds. We show some numerical experiments on the basis of fundamental solutions with a Midpoint quadrature rule in an unbounded and a bounded domain. We note that the error that we estimate is for the exact solutions and not for finite element solutions. Hence in the numerical finite element-based simulations, the numerical results contain an additional error due to the finite element approach.

math.NA

Approximation of a compound-exchanging cell by a Dirac point

Communication between single cells or higher organisms by means of diffusive compounds is an important phenomenon in biological systems. Modelling therefore often occurs, most straightforwardly by a diffusion equation with suitable flux boundary conditions at the cell boundaries. Such a model will become computationally inefficient and analytically complex when there are many cells, even more so when they are moving. We propose to consider instead a point source model. Each cell is virtually reduced to a point and appears in the diffusion equation for the compound on the full spatial domain as a singular reaction term in the form of a Dirac delta `function' (measure) located at the cell's centre. In this model, it has an amplitude that is a non-local function of the concentration of compound on the (now virtual) cell boundary. We prove the well-posedness of this particular parabolic problem with non-local and singular reaction term in suitable Sobolev spaces. We show for a square bounded domain and for the plane that the solution cannot be $H^1$-smooth at the Dirac point. Further, we show a preliminary numerical comparison between the solutions to the two models that suggests that the two models are highly comparable to each other.

math.AP

Crafting Synthetic Realities: Examining Visual Realism and Misinformation Potential of Photorealistic AI-Generated Images

Advances in generative models have created Artificial Intelligence-Generated Images (AIGIs) nearly indistinguishable from real photographs. Leveraging a large corpus of 30,824 AIGIs collected from Instagram and Twitter, and combining quantitative content analysis with qualitative analysis, this study unpacks AI photorealism of AIGIs from four key dimensions, content, human, aesthetic, and production features. We find that photorealistic AIGIs often depict human figures, especially celebrities and politicians, with a high degree of surrealism and aesthetic professionalism, alongside a low degree of overt signals of AI production. This study is the first to empirically investigate photorealistic AIGIs across multiple platforms using a mixed-methods approach. Our findings provide important implications and insights for understanding visual misinformation and mitigating potential risks associated with photorealistic AIGIs. We also propose design recommendations to enhance the responsible use of AIGIs.

cs.CY

PEPT: Expert Finding Meets Personalized Pre-training

Finding experts is essential in Community Question Answering (CQA) platforms as it enables the effective routing of questions to potential users who can provide relevant answers. The key is to personalized learning expert representations based on their historical answered questions, and accurately matching them with target questions. There have been some preliminary works exploring the usability of PLMs in expert finding, such as pre-training expert or question representations. However, these models usually learn pure text representations of experts from histories, disregarding personalized and fine-grained expert modeling. For alleviating this, we present a personalized pre-training and fine-tuning paradigm, which could effectively learn expert interest and expertise simultaneously. Specifically, in our pre-training framework, we integrate historical answered questions of one expert with one target question, and regard it as a candidate aware expert-level input unit. Then, we fuse expert IDs into the pre-training for guiding the model to model personalized expert representations, which can help capture the unique characteristics and expertise of each individual expert. Additionally, in our pre-training task, we design: 1) a question-level masked language model task to learn the relatedness between histories, enabling the modeling of question-level expert interest; 2) a vote-oriented task to capture question-level expert expertise by predicting the vote score the expert would receive. Through our pre-training framework and tasks, our approach could holistically learn expert representations including interests and expertise. Our method has been extensively evaluated on six real-world CQA datasets, and the experimental results consistently demonstrate the superiority of our approach over competitive baseline methods.

cs.IR