Searcharxiv⌕ Search

arXiv subjects

Rui Xu

Publications and source records attributed to Rui Xu.

At least 73 records · Page 4Linked to original sources

CoSER: A Comprehensive Literary Dataset and Framework for Training and Evaluating LLM Role-Playing and Persona Simulation

Role-playing language agents (RPLAs) have emerged as promising applications of large language models (LLMs). However, simulating established characters presents a challenging task for RPLAs, due to the lack of authentic character datasets and nuanced evaluation methods using such data. In this paper, we present CoSER, a collection of a high-quality dataset, open models, and an evaluation protocol towards effective RPLAs of established characters. The CoSER dataset covers 17,966 characters from 771 renowned books. It provides authentic dialogues with real-world intricacies, as well as diverse data types such as conversation setups, character experiences and internal thoughts. Drawing from acting methodology, we introduce given-circumstance acting for training and evaluating role-playing LLMs, where LLMs sequentially portray multiple characters in book scenes. Using our dataset, we develop CoSER 8B and CoSER 70B, i.e., advanced open role-playing LLMs built on LLaMA-3.1 models. Extensive experiments demonstrate the value of the CoSER dataset for RPLA training, evaluation and retrieval. Moreover, CoSER 70B exhibits state-of-the-art performance surpassing or matching GPT-4o on our evaluation and three existing benchmarks, i.e., achieving 75.80% and 93.47% accuracy on the InCharacter and LifeChoice benchmarks respectively.

cs.CL↗

EgoReAct: Egocentric Video-Driven 3D Human Reaction Generation

Humans exhibit adaptive, context-sensitive responses to egocentric visual input. However, faithfully modeling such reactions from egocentric video remains challenging due to the dual requirements of strictly causal generation and precise 3D spatial alignment. To tackle this problem, we first construct the Human Reaction Dataset (HRD) to address data scarcity and misalignment by building a spatially aligned egocentric video-reaction dataset, as existing datasets (e.g., ViMo) suffer from significant spatial inconsistency between the egocentric video and reaction motion, e.g., dynamically moving motions are always paired with fixed-camera videos. Leveraging HRD, we present EgoReAct, the first autoregressive framework that generates 3D-aligned human reaction motions from egocentric video streams in real-time. We first compress the reaction motion into a compact yet expressive latent space via a Vector Quantised-Variational AutoEncoder and then train a Generative Pre-trained Transformer for reaction generation from the visual input. EgoReAct incorporates 3D dynamic features, i.e., metric depth, and head dynamics during the generation, which effectively enhance spatial grounding. Extensive experiments demonstrate that EgoReAct achieves remarkably higher realism, spatial consistency, and generation efficiency compared with prior methods, while maintaining strict causality during generation. We will release code, models, and data upon acceptance.

cs.CV↗

Curvilinear magnonic crystal based on 3D hierarchical nanotemplates

Curvilinear magnetic nanostructures enable control of magnetization dynamics through geometry-induced anisotropy and chiral interactions as well as magnetic field modulation. In this work, we report a curvilinear magnonic crystal based on large-area square arrays of truncated nanospikes fabricated by conformal coating of 3D hierarchical templates with permalloy thin films. Brillouin light scattering spectroscopy reveals anisotropic band structure with multiple dispersive and folded Bloch-type dispersive spin-wave modes as well as non-dispersive modes exhibiting direction-dependent frequency shifts and intensity asymmetries along lattice principal axes. Finite element micromagnetic simulations indicate that curvature-induced variations of the demagnetizing field govern the magnonic response, enabling the identification of modes propagating in nanochannels and other localized on nanospike apexes or along the ridges connecting adjacent nanospikes. The combination of geometric curvature and optical probing asymmetry produces directional dependence of magnonic bands, establishing 3D hierarchical templates as a versatile platform for curvature-engineered magnonics.

cond-mat.str-el↗

MCMoE: Completing Missing Modalities with Mixture of Experts for Incomplete Multimodal Action Quality Assessment

Multimodal Action Quality Assessment (AQA) has recently emerged as a promising paradigm. By leveraging complementary information across shared contextual cues, it enhances the discriminative evaluation of subtle intra-class variations in highly similar action sequences. However, partial modalities are frequently unavailable at the inference stage in reality. The absence of any modality often renders existing multimodal models inoperable. Furthermore, it triggers catastrophic performance degradation due to interruptions in cross-modal interactions. To address this issue, we propose a novel Missing Completion Framework with Mixture of Experts (MCMoE) that unifies unimodal and joint representation learning in single-stage training. Specifically, we propose an adaptive gated modality generator that dynamically fuses available information to reconstruct missing modalities. We then design modality experts to learn unimodal knowledge and dynamically mix the knowledge of all experts to extract cross-modal joint representations. With a mixture of experts, missing modalities are further refined and complemented. Finally, in the training phase, we mine the complete multimodal features and unimodal expert knowledge to guide modality generation and generation-based joint representation extraction. Extensive experiments demonstrate that our MCMoE achieves state-of-the-art results in both complete and incomplete multimodal learning on three public AQA benchmarks. Code is available at https://github.com/XuHuangbiao/MCMoE.

cs.CV↗

MambaScope: Coarse-to-Fine Scoping for Efficient Vision Mamba

Vision Mamba has emerged as a promising and efficient alternative to Vision Transformers, yet its efficiency remains fundamentally constrained by the number of input tokens. Existing token reduction approaches typically adopt token pruning or merging to reduce computation. However, they inherently lead to information loss as they discard or compress token representations. This problem is further exacerbated when the same fine-grained token processing is uniformly applied across all images regardless of visual complexity. We observe that not all inputs require fine-grained processing: simple images can be effectively handled at a coarse resolution, while only complex ones require refinement. Based on this insight, we propose MambaScope, an adaptive framework for efficient inference for Vision Mamba. MambaScope first performs coarse-grained inference by dividing the input image into large patches, significantly reducing token length and computation. When the model's prediction confidence is low, selected regions are re-processed at a finer resolution to recover essential visual details with minimal additional cost. This dynamic resolution assignment strategy allows MambaScope to allocate computation adaptively according to image complexity, achieving efficient processing without compromising accuracy. Experiments across various vision tasks demonstrate that MambaScope outperforms both the baseline Vision Mamba and state-of-the-art token reduction techniques in terms of accuracy and efficiency.

cs.CV↗

Realization of polytype heterostructures via delicate structural transitions from a doped-Mott insulator

Transition metal dichalcogenides (TMDs) host multiple competing structural and electronic phases, making them an ideal platform for constructing polytype heterostructures with emergent quantum properties. However, controlling phase transitions to form diverse heterostructures inside a single crystal remains challenging. Here, we realize vertical/lateral polytype heterostructures in a hole-doped Mott insulator via thermal-annealing-induced structural transitions. Raman spectroscopy, atomic force microscopy (AFM) and scanning Kelvin probe force microscopy (SKPM) confirm the coexistence of T-H polytype heterostructures. Atomic-scale scanning tunneling microscopy/spectroscopy (STM/STS) measurements reveal the transparent effect in 1H/1T vertical heterostructures, where the charge density wave (CDW) of the underlying 1T-layer superposes on the top 1H-layer under positive bias. By systematically comparing 1T/1H and 1T/1T interfaces, we demonstrate that the metallic 1H-layer imposes a Coulomb screening effect on the 1T-layer, suppressing the formation of CDW domain walls and forming more ordered electronic states. These results clarify the interfacial coupling between distinct quantum many-body phases and establish a controllable pathway for constructing two-dimensional polytype heterostructures with tunable electronic properties.

cond-mat.mtrl-sci↗

Memetic Search for Green Vehicle Routing Problem with Private Capacitated Refueling Stations

The green vehicle routing problem with private capacitated alternative fuel stations (GrVRP-PCAFS) extends the traditional green vehicle routing problem by considering capacitated refueling stations, where a limited number of vehicles can refuel simultaneously and additional vehicles must wait. This feature presents new challenges for route planning, as waiting times at stations must be managed while keeping route durations within limits and reducing total travel distance. This article presents METS, a novel memetic algorithm (MA) with separate constraint-based tour segmentation (SCTS) and a local search procedure tailored for solving GrVRP-PCAFS. METS balances exploration and exploitation through three key components. For exploration, the SCTS strategy splits giant tours to generate diverse solutions, and the search process is guided by a comprehensive fitness evaluation function to dynamically control feasibility and diversity to produce solutions that are both diverse and near-feasible. For exploitation, the local search procedure incorporates tailored move operators with constant-time evaluation mechanisms, enabling efficient examination of large solution neighborhoods. Experimental results demonstrate that METS discovers 31 new best-known solutions out of 40 instances in existing benchmark sets, achieving substantial improvements over current state-of-the-art methods. Additionally, a new large-scale benchmark set based on real-world logistics data is introduced to facilitate future research.

cs.NE↗

ORIGAMISPACE: Benchmarking Multimodal LLMs in Multi-Step Spatial Reasoning with Mathematical Constraints

Spatial reasoning is a key capability in the field of artificial intelligence, especially crucial in areas such as robotics, computer vision, and natural language understanding. However, evaluating the ability of multimodal large language models(MLLMs) in complex spatial reasoning still faces challenges, particularly in scenarios requiring multi-step reasoning and precise mathematical constraints. This paper introduces ORIGAMISPACE, a new dataset and benchmark designed to evaluate the multi-step spatial reasoning ability and the capacity to handle mathematical constraints of MLLMs through origami tasks. The dataset contains 350 data instances,each comprising a strictly formatted crease pattern (CP diagram), the Compiled Flat Pattern, the complete Folding Process, and the final Folded Shape Image. We propose four evaluation tasks: Pattern Prediction, Multi-step Spatial Reasoning, Spatial Relationship Prediction, and End-to-End CP Code Generation. For the CP code generation task, we design an interactive environment and explore the possibility of using reinforcement learning methods to train MLLMs. Through experiments on existing MLLMs, we initially reveal the strengths and weaknesses of these models in handling complex spatial reasoning tasks.

cs.AI↗

MeshMosaic: Scaling Artist Mesh Generation via Local-to-Global Assembly

Scaling artist-designed meshes to high triangle numbers remains challenging for autoregressive generative models. Existing transformer-based methods suffer from long-sequence bottlenecks and limited quantization resolution, primarily due to the large number of tokens required and constrained quantization granularity. These issues prevent faithful reproduction of fine geometric details and structured density patterns. We introduce MeshMosaic, a novel local-to-global framework for artist mesh generation that scales to over 100K triangles--substantially surpassing prior methods, which typically handle only around 8K faces. MeshMosaic first segments shapes into patches, generating each patch autoregressively and leveraging shared boundary conditions to promote coherence, symmetry, and seamless connectivity between neighboring regions. This strategy enhances scalability to high-resolution meshes by quantizing patches individually, resulting in more symmetrical and organized mesh density and structure. Extensive experiments across multiple public datasets demonstrate that MeshMosaic significantly outperforms state-of-the-art methods in both geometric fidelity and user preference, supporting superior detail representation and practical mesh generation for real-world applications.

cs.GR↗

Unveiling the delicate "hidden" interface conditions in WS2 flakes by advanced atomic force microscopy

The delicate interfacial conditions and behaviors play critical roles in determining the valuable physical properties of two-dimensional materials and their heterostructures on substrates. However, directly probing these complex interface conditions remains challenging. Here, we reveal the coupled in-plane strain and out-of-plane bonding conditions in strain-engineered WS2 flakes by combining dual-harmonic electrostatic force microscopy (DH-EFM) and scanning microwave impedance microscopy (sMIM). A striking contradiction is observed between the compressive-strain-induced larger bandgap (lower electrical conductivity) detected by DH-EFM, and the enhanced conductivity probed by sMIM. Comparative measurements under different sMIM modes demonstrate that this contradiction originates from a tip-loading-force-induced dynamic puckering effect, which is governed by the interfacial bonding strength. Furthermore, the progressive accumulation and subsequent release of conductivity during forward/backward sMIM-contact scans further confirms this dynamic puckering behavior, revealing pronounced differences in interface conditions between the open- and closed-ring regions of WS2. This work resolves the correlation between electrical properties and interface conditions, and provides fundamental insights for interface-engineered devices.

cond-mat.mtrl-sci↗

Gaussian Copula-Based Outage Performance Analysis of Fluid Antenna Systems: Channel Coefficient- or Envelope-Level Correlation Matrix?

Gaussian copula has been employed to evaluate the outage performance of Fluid Antenna Systems (FAS), with the covariance matrix reflecting the dependence among multivariate normal random variables (RVs). While prior studies approximate this matrix using the channel coefficient correlation matrix from Jake's model, this work instead employs the channel envelope correlation matrix, motivated by the fact that the multivariate normal RVs are generated by transforming correlated channel envelopes. This raises an open question of whether using the coefficient- or envelope-level correlation matrix yields better accuracy in accessing FAS performance. Toward this end, this paper explores the benefits of using the envelope-level correlation matrix under fully correlated Nakagami-m fading, and develops a method for generating such fading channels for Monte Carlo simulations, which serve as a benchmark for validating the theoretical results. Simulation results confirm the effectiveness of the proposed channel modeling approach and demonstrate the superior accuracy of using the envelope-level correlation matrix, particularly in sparse port deployment and low-outage regime.

cs.IT↗

Tackling Incomplete Data in Air Quality Prediction: A Bayesian Deep Learning Framework for Uncertainty Quantification

Accurate air quality forecasts are vital for public health alerts, exposure assessment, and emissions control. In practice, observational data are often missing in varying proportions and patterns due to collection and transmission issues. These incomplete spatiotemporal records impede reliable inference and risk assessment and can lead to overconfident extrapolation. To address these challenges, we propose an end to end framework, the channel gated learning unit based spatiotemporal bayesian neural field (CGLUBNF). It uses Fourier features with a graph attention encoder to capture multiscale spatial dependencies and seasonal temporal dynamics. A channel gated learning unit, equipped with learnable activations and gated residual connections, adaptively filters and amplifies informative features. Bayesian inference jointly optimizes predictive distributions and parameter uncertainty, producing point estimates and calibrated prediction intervals. We conduct a systematic evaluation on two real world datasets, covering four typical missing data patterns and comparing against five state of the art baselines. CGLUBNF achieves superior prediction accuracy and sharper confidence intervals. In addition, we further validate robustness across multiple prediction horizons and analysis the contribution of extraneous variables. This research lays a foundation for reliable deep learning based spatio-temporal forecasting with incomplete observations in emerging sensing paradigms, such as real world vehicle borne mobile monitoring.

cs.LG↗

Curse of Knowledge: When Complex Evaluation Context Benefits yet Biases LLM Judges

As large language models (LLMs) grow more capable, they face increasingly diverse and complex tasks, making reliable evaluation challenging. The paradigm of LLMs as judges has emerged as a scalable solution, yet prior work primarily focuses on simple settings. Their reliability in complex tasks--where multi-faceted rubrics, unstructured reference answers, and nuanced criteria are critical--remains understudied. In this paper, we constructed ComplexEval, a challenge benchmark designed to systematically expose and quantify Auxiliary Information Induced Biases. We systematically investigated and validated 6 previously unexplored biases across 12 basic and 3 advanced scenarios. Key findings reveal: (1) all evaluated models exhibit significant susceptibility to these biases, with bias magnitude scaling with task complexity; (2) notably, Large Reasoning Models (LRMs) show paradoxical vulnerability. Our in-depth analysis offers crucial insights for improving the accuracy and verifiability of evaluation signals, paving the way for more general and robust evaluation models.

cs.CL↗

Single femtosecond laser pulse-driven ferromagnetic switching

Light pulses offer a faster, more energy-efficient, and direct route to magnetic bit writing, pointing toward a hybrid memory and computing paradigm based on photon transmission and spin retention. Yet progress remains hindered, as deterministic, single-pulse optical toggle switching has so far been achieved only with ferrimagnetic materials, which require too specific a rare-earth composition and temperature conditions for technological use. In mainstream ferromagnet--central to spintronic memory and storage--such bistable switching is considered fundamentally difficult, as laser-induced heating does not inherently break time-reversal symmetry. Here, we report coherent magnetization switching in ferromagnets, driven by thermal anisotropy torque with single laser pulses. The toggle switching behavior is robust over a broad range of pulse durations, from femtoseconds to picoseconds, a prerequisite for practical applications. Furthermore, the phenomenon exhibits reproducibility in CoFeB/MgO-based magnetic tunnel junctions with a high magnetoresistance exceeding 110%, as well as the scalability down to nanoscales with remarkable energy efficiency (17 fJ per 100-nm-sized bit). These results mark a notable step toward integrating opto-spintronics into next-generation memory and storage technologies.

cond-mat.mes-hall↗

Federated Conditional Conformal Prediction via Generative Models

Conformal Prediction (CP) provides distribution-free uncertainty quantification by constructing prediction sets that guarantee coverage of the true labels. This reliability makes CP valuable for high-stakes federated learning scenarios such as multi-center healthcare. However, standard CP assumes i.i.d. data, which is violated in federated settings where client distributions differ substantially. Existing federated CP methods address this by maintaining marginal coverage on each client, but such guarantees often fail to reflect input-conditional uncertainty. In this work, we propose Federated Conditional Conformal Prediction (Fed-CCP) via generative models, which aims for conditional coverage that adapts to local data heterogeneity. Fed-CCP leverages generative models, such as normalizing flows or diffusion models, to approximate conditional data distributions without requiring the sharing of raw data. This enables each client to locally calibrate conformal scores that reflect its unique uncertainty, while preserving global consistency through federated aggregation. Experiments on real datasets demonstrate that Fed-CCP achieves more adaptive prediction sets.

cs.LG↗

A Text-Image Fusion Method with Data Augmentation Capabilities for Referring Medical Image Segmentation

Deep learning relies heavily on data augmentation to mitigate limited data, especially in medical imaging. Recent multimodal learning integrates text and images for segmentation, known as referring or text-guided image segmentation. However, common augmentations like rotation and flipping disrupt spatial alignment between image and text, weakening performance. To address this, we propose an early fusion framework that combines text and visual features before augmentation, preserving spatial consistency. We also design a lightweight generator that projects text embeddings into visual space, bridging semantic gaps. Visualization of generated pseudo-images shows accurate region localization. Our method is evaluated on three medical imaging tasks and four segmentation frameworks, achieving state-of-the-art results. Code is publicly available on GitHub: https://github.com/11yxk/MedSeg_EarlyFusion.

cs.CV↗

Exotic Surface Stripe Orders in Correlated Kagome Metal CsCr3Sb5

The newly discovered kagome superconductor CsCr3Sb5 exhibits distinct features with flat bands and unique magnetism, providing a compelling platform for exploring novel quantum states of correlated electron systems. Emergent charge order in this material is a key for understanding unconventional superconductivity, but it remains unexplored at the atomic scale and the underlying physics is elusive. Here, we identify and unreported stripe orders on the surface which are distinct from the bulk and investigate the underlying bulk electronic properties using a combination of scanning tunneling microscopy (STM), angle-resolved photoemission spectroscopy (ARPES) and density functional theory (DFT) calculations. Specifically, a mixture of 2a0 * a0 and 3a0 * a0 stripe order is found on Cs-terminated surface while 4a0 * root3a0 stripe order is found on the Sb-terminated surface. The electronic spectra exhibit strongly correlated features resembling that of high temperature superconductors, with kagome flat bands lying about 330 meV above EF, suggesting that the electron correlations arise from Coulomb interactions and Hund's coupling. Moreover, a distinct electron-boson coupling mode is observed at approximately 100 meV. These findings provide new insights into the interplay between surface and bulk charge orders in this strongly correlated kagome system.

cond-mat.str-el↗

MATStruct: High-Quality Medial Mesh Computation via Structure-aware Variational Optimization

We propose a novel optimization framework for computing the medial axis transform that simultaneously preserves the medial structure and ensures high medial mesh quality. The medial structure, consisting of interconnected sheets, seams, and junctions, provides a natural volumetric decomposition of a 3D shape. Our method introduces a structure-aware, particle-based optimization pipeline guided by the restricted power diagram (RPD), which partitions the input volume into convex cells whose dual encodes the connectivity of the medial mesh. Structure-awareness is enforced through a spherical quadratic error metric (SQEM) projection that constrains the movement of medial spheres, while a Gaussian kernel energy encourages an even spatial distribution. Compared to feature-preserving methods such as MATFP and MATTopo, our approach produces cleaner and more accurate medial structures with significantly improved mesh quality. In contrast to voxel-based, point-cloud-based, and variational methods, our framework is the first to integrate structural awareness into the optimization process, yielding medial meshes with superior geometric fidelity, topological correctness, and explicit structural decomposition.

cs.GR↗