arXiv subjects

Xinyi Fan

Publications and source records attributed to Xinyi Fan.

9 recordsLinked to original sources

arXiv2026

Can Agent Memory Systems Track Evolving State?

As LLM-based agents are deployed for longer and higher-stakes tasks, their memory systems continue to have crucial gaps. While existing memory benchmarks focus largely on recall-shaped tasks, we argue an effective memory system must track the evolving state of the world; as facts, constraints, and decisions are revised over a long interaction, answers must reflect the current state and not a superseded one. We define this capability as state tracking and instantiate it in StateMemBench, a benchmark of 234 multi-session scenarios spanning two conversation-length regimes. Its closed-pool grading scores whether an answer reflects the current state, the superseded state, or fails otherwise, separating state-tracking failures from other errors by construction. Our analysis shows that this task is challenging for existing memory systems, retrieval-augmented baselines, and long-context baselines. We then present StateMem, a state-first memory method that explicitly tracks supersession and relational dependencies, and show it improves current-state accuracy over the strongest same-backbone baseline by 1.8x (0.205 -> 0.363) on DeepSeek-V4-Flash and over the strongest memory system by 1.6x (0.149 -> 0.233) on Qwen-3.5-9B, while remaining competitive with the long-context baselines. Finally, we show the same state approach can be applied as a lightweight single-call wrapper over existing memory systems, lifting current-state accuracy by +32 to +67 points on StateMemBench across six memory and retrieval backends. A length- and cost-matched control attributes +15 to +32 of those points to state structure rather than added context.

cs.AI↗

arXiv2026

Trustworthy Agent Network: Trust in Agent Networks Must Be Baked In, Not Bolted On

The rapid advancement of Large Language Models has given rise to autonomous LLM-based agents capable of complex reasoning and execution. As these agents transition from isolated operation to collaborative ecosystems, we witness the emergence of the Agent-to-Agent (A2A) network, a paradigm where heterogeneous agents autonomously coordinate to solve multi-step tasks. While these networks may offer better task performance compared to simply using one agent to complete the entire task, they introduce systemic vulnerabilities, such as adversarial composition, semantic misalignment, and cascading operational failures, that existing agent alignment techniques cannot address. In this vision paper, we argue that the trustworthiness of A2A networks cannot be fully guaranteed via retrofitting on existing protocols that are largely designed for individual agents. Rather, it must be architected from the very beginning of the A2A coordination framework. We present a comprehensive conceptual framework that situates trust in A2A systems through four design pillars.

cs.AI↗

arXiv2025

Spectral localization of single-nanoparticle plasmons through photonic substrate engineering

Surface plasmon resonances (SPRs) are crucial for confining light beyond the diffraction limit, yet heavy metal losses often limit their spectral localization. Here, we propose a practical strategy for enabling the spectral localization of single-nanoparticle SPRs through photonic substrate engineering, which creates distinct optical pathways (OPs) to tailor the electromagnetic environments around plasmonic nanoparticles. By analyzing the multiplication factor spectrum of the projected local density of states, we can trace and control these OPs, enabling strong spatial and spectral confinement of single-nanoparticle SPRs. Simulations reveal that a photonic crystal substrate can reduce the mode volume by fivefold and boost the quality factor by over 80 times compared to a metal nanoparticle on a dielectric substrate. Proof-of-concept experiments using two types of leaking Fabry-Perot photonic substrates demonstrate active manipulation of SPRs in both "open" and "closed" OP states. This multidimensional photonic substrate engineering establishes a customizable platform for single-nanoparticle plasmonics, potentially transforming applications that were previously limited by spectral localization.

physics.optics↗

arXiv2024

FedGraph: A Research Library and Benchmark for Federated Graph Learning

Federated graph learning is an emerging field with significant practical challenges. While algorithms have been proposed to improve the accuracy of training graph neural networks, such as node classification on federated graphs, the system performance is often overlooked, despite it is crucial for real-world deployment. To bridge this gap, we introduce FedGraph, a research library designed for practical distributed training and comprehensive benchmarking of FGL algorithms. FedGraph supports a range of state-of-the-art graph learning methods and includes a monitoring class that evaluates system performance, with a particular focus on communication and computation costs during training. Unlike existing federated learning platforms, FedGraph natively integrates homomorphic encryption to enhance privacy preservation and supports scalable deployment across multiple physical machines with system-level performance evaluation to guide the system design of future algorithms. To enhance efficiency and privacy, we propose a low-rank communication scheme for algorithms like FedGCN that require pre-training communication, accelerating both the pre-training and training phases. Extensive experiments benchmark FGL algorithms on three major graph learning tasks and demonstrate FedGraph as the first efficient FGL framework to support encrypted low-rank communication and scale to graphs with 100 million nodes.

cs.LG↗

arXiv2024

MOSAIC: Modular Foundation Models for Assistive and Interactive Cooking

We present MOSAIC, a modular architecture for coordinating multiple robots to (a) interact with users using natural language and (b) manipulate an open vocabulary of everyday objects. MOSAIC employs modularity at several levels: it leverages multiple large-scale pre-trained models for high-level tasks like language and image recognition, while using streamlined modules designed for low-level task-specific control. This decomposition allows us to reap the complementary benefits of foundation models as well as precise, more specialized models. Pieced together, our system is able to scale to complex tasks that involve coordinating multiple robots and humans. First, we unit-test individual modules with 180 episodes of visuomotor picking, 60 episodes of human motion forecasting, and 46 online user evaluations of the task planner. We then extensively evaluate MOSAIC with 60 end-to-end trials. We discuss crucial design decisions, limitations of the current system, and open challenges in this domain. The project's website is at https://portal-cornell.github.io/MOSAIC/

cs.RO↗

arXiv2023

Third order nonlinear transport properties in topological chiral antiferromagnetic semimetal CoNb3S6

The topology between Bloch states in reciprocal space has attracted tremendous attention in recent years. The quantum geometry of the band structure is composed of quantum metric as real part and berry curvature as imaginary part. While the Berry curvature, the Berry curvature dipole and Berry connection polarizability have been recently revealed by the first order anomalous hall, second order and third order nonlinear Hall effect respectively, the quantum metric induced second order nonlinear transverse and longitudinal response in topological antiferromagnetic material MnBi2Te4 was only very recently reported. Here we demonstrate the similar third order nonlinear transport properties in the topological antiferromagnetic CoNb3S6. We observed that the third order nonlinear longitudinal V3{\omega} xx increase significantly at the antiferromagnetic transition temperature TN ~ 29 K, which was probably induced by the quantum metric without time-reversal symmetry or inversion symmetry. Besides, temperature-dependent nonlinear behaviour was observed in the first order I-V curve below the Neel temperature TN, which was not reported in MnBi2Te4 and FeSn. Such nonlinear I-V behaviour hints for the possible existence of Charge Density Wave (CDW) state, which has been discovered in its sister material FeNb3S6. Simultaneously, two plateaus in the third order nonlinear longitudinal V3{\omega} xx~ I^{\omega} curve are observed, which is also speculated to be related with the possible CDW state. However, the genuine mechanism for the first order nonlinear I-V and its relation with the third order nonlinear transport call for more experimental investigations and theoretical interpretation. Our work provides a way to explore third harmonic nonlinear transport and interaction with magnetic order and CDW.

cond-mat.mtrl-sci↗

arXiv2023

Highly tunable lateral homojunction formed in 2D layered CuInP2S6 via in-plane ionic migration

As basic building blocks for next-generation information technologies devices, high-quality p-n junctions based on van der Waals (vdW) materials have attracted widespread interest.Compared to traditional two dimensional (2D) heterojunction diodes, the emerging homojunctions are more attractive owing to their intrinsic advantages, such as continuous band alignments and smaller carrier trapping. Here, utilizing the long-range migration of Cu + ions under in-plane electric field, a novel lateral p-n homojunction was constructed in the 2D layered copper indium thiophosphate (CIPS). The symmetric Au/CIPS/Au devices demonstrate an electric-field-driven resistance switching (RS) accompanying by a rectification behavior without any gate control. Moreover, such rectification behavior can be continuously modulated by poling voltage. We deduce that the reversable rectifying RS behavior is governed by the effective lateral build-in potential and the change of the interfacial barrier during the poling process. Furthermore, the CIPS p-n homojuction is evidenced by the photovoltaic effect, with the spectral response extending up to visible region due to the better photogenerated carrier separation efficiency. Our study provides a facile route to fabricate homojuctions through electric-field-driven ionic migration and paves the way towards the use of this method in other vdW materials.

cond-mat.mes-hall↗

arXiv2021

The Influence of Dimensionality on the Charge Density Wave Transition and Its Application on Mid-infrared Photodetection

Two-dimensional charge density wave (CDW) materials received much attention for high responsivity and broadband photodetection in recent years, due to their collective electron transport and narrow bandgap. However, the high dark current density problem hinders their real application. Here we report a sharp CDW transition in quasi-1D (TaSe4)2I, and apply it for broadband photodetection. Especially at mid-infrared region, the device shows both high photo responsivity of 1.18e3 A/W and large light on-off ratio of 80, which is superior than 2D CDW TaS2 and most reported low-dimensional materials. The fact for such high performance lies on two aspects. One is the much lower dark current density resulted from the pseudo gap associated with 1D Luttinger liquid state, which is supported by finite size scaling of nonlinear I-V at variable temperatures and occurrence of 1D structural phase transition consolidated by In-situ Raman spectroscopy. The other is the high photocurrent associated with the Frohlich superconductivity state, manifested by an ultrasensitive switching, which can be only accessible in 1D CDW materials, in agreement with our density functional theory calculation. Our work thus reveals the pivotal role of dimensionality in CDW phase transition, and paves a way for implementing highly sensitive broadband photodetector.

cond-mat.mtrl-sci↗

arXiv2021

Polarized Self-Attention: Towards High-quality Pixel-wise Regression

Pixel-wise regression is probably the most common problem in fine-grained computer vision tasks, such as estimating keypoint heatmaps and segmentation masks. These regression problems are very challenging particularly because they require, at low computation overheads, modeling long-range dependencies on high-resolution inputs/outputs to estimate the highly nonlinear pixel-wise semantics. While attention mechanisms in Deep Convolutional Neural Networks(DCNNs) has become popular for boosting long-range dependencies, element-specific attention, such as Nonlocal blocks, is highly complex and noise-sensitive to learn, and most of simplified attention hybrids try to reach the best compromise among multiple types of tasks. In this paper, we present the Polarized Self-Attention(PSA) block that incorporates two critical designs towards high-quality pixel-wise regression: (1) Polarized filtering: keeping high internal resolution in both channel and spatial attention computation while completely collapsing input tensors along their counterpart dimensions. (2) Enhancement: composing non-linearity that directly fits the output distribution of typical fine-grained regression, such as the 2D Gaussian distribution (keypoint heatmaps), or the 2D Binormial distribution (binary segmentation masks). PSA appears to have exhausted the representation capacity within its channel-only and spatial-only branches, such that there is only marginal metric differences between its sequential and parallel layouts. Experimental results show that PSA boosts standard baselines by $2-4$ points, and boosts state-of-the-arts by $1-2$ points on 2D pose estimation and semantic segmentation benchmarks.

cs.CV↗