Searcharxiv⌕ Search

arXiv subjects

Rui Xu

Publications and source records attributed to Rui Xu.

At least 91 records · Page 5Linked to original sources

A Text-Image Fusion Method with Data Augmentation Capabilities for Referring Medical Image Segmentation

Deep learning relies heavily on data augmentation to mitigate limited data, especially in medical imaging. Recent multimodal learning integrates text and images for segmentation, known as referring or text-guided image segmentation. However, common augmentations like rotation and flipping disrupt spatial alignment between image and text, weakening performance. To address this, we propose an early fusion framework that combines text and visual features before augmentation, preserving spatial consistency. We also design a lightweight generator that projects text embeddings into visual space, bridging semantic gaps. Visualization of generated pseudo-images shows accurate region localization. Our method is evaluated on three medical imaging tasks and four segmentation frameworks, achieving state-of-the-art results. Code is publicly available on GitHub: https://github.com/11yxk/MedSeg_EarlyFusion.

cs.CV↗

Exotic Surface Stripe Orders in Correlated Kagome Metal CsCr3Sb5

The newly discovered kagome superconductor CsCr3Sb5 exhibits distinct features with flat bands and unique magnetism, providing a compelling platform for exploring novel quantum states of correlated electron systems. Emergent charge order in this material is a key for understanding unconventional superconductivity, but it remains unexplored at the atomic scale and the underlying physics is elusive. Here, we identify and unreported stripe orders on the surface which are distinct from the bulk and investigate the underlying bulk electronic properties using a combination of scanning tunneling microscopy (STM), angle-resolved photoemission spectroscopy (ARPES) and density functional theory (DFT) calculations. Specifically, a mixture of 2a0 * a0 and 3a0 * a0 stripe order is found on Cs-terminated surface while 4a0 * root3a0 stripe order is found on the Sb-terminated surface. The electronic spectra exhibit strongly correlated features resembling that of high temperature superconductors, with kagome flat bands lying about 330 meV above EF, suggesting that the electron correlations arise from Coulomb interactions and Hund's coupling. Moreover, a distinct electron-boson coupling mode is observed at approximately 100 meV. These findings provide new insights into the interplay between surface and bulk charge orders in this strongly correlated kagome system.

cond-mat.str-el↗

MATStruct: High-Quality Medial Mesh Computation via Structure-aware Variational Optimization

We propose a novel optimization framework for computing the medial axis transform that simultaneously preserves the medial structure and ensures high medial mesh quality. The medial structure, consisting of interconnected sheets, seams, and junctions, provides a natural volumetric decomposition of a 3D shape. Our method introduces a structure-aware, particle-based optimization pipeline guided by the restricted power diagram (RPD), which partitions the input volume into convex cells whose dual encodes the connectivity of the medial mesh. Structure-awareness is enforced through a spherical quadratic error metric (SQEM) projection that constrains the movement of medial spheres, while a Gaussian kernel energy encourages an even spatial distribution. Compared to feature-preserving methods such as MATFP and MATTopo, our approach produces cleaner and more accurate medial structures with significantly improved mesh quality. In contrast to voxel-based, point-cloud-based, and variational methods, our framework is the first to integrate structural awareness into the optimization process, yielding medial meshes with superior geometric fidelity, topological correctness, and explicit structural decomposition.

cs.GR↗

SSFO: Self-Supervised Faithfulness Optimization for Retrieval-Augmented Generation

Retrieval-Augmented Generation (RAG) systems require Large Language Models (LLMs) to generate responses that are faithful to the retrieved context. However, faithfulness hallucination remains a critical challenge, as existing methods often require costly supervision and post-training or significant inference burdens. To overcome these limitations, we introduce Self-Supervised Faithfulness Optimization (SSFO), the first self-supervised alignment approach for enhancing RAG faithfulness. SSFO constructs preference data pairs by contrasting the model's outputs generated with and without the context. Leveraging Direct Preference Optimization (DPO), SSFO aligns model faithfulness without incurring labeling costs or additional inference burden. We theoretically and empirically demonstrate that SSFO leverages a benign form of \emph{likelihood displacement}, transferring probability mass from parametric-based tokens to context-aligned tokens. Based on this insight, we propose a modified DPO loss function to encourage likelihood displacement. Comprehensive evaluations show that SSFO significantly outperforms existing methods, achieving state-of-the-art faithfulness on multiple context-based question-answering datasets. Notably, SSFO exhibits strong generalization, improving cross-lingual faithfulness and preserving general instruction-following capabilities. We release our code and model at the anonymous link: https://github.com/chkwy/SSFO

cs.CL↗

CrossGen: Learning and Generating Cross Fields for Quad Meshing

Cross fields play a critical role in various geometry processing tasks, especially for quad mesh generation. Existing methods for cross field generation often struggle to balance computational efficiency with generation quality, using slow per-shape optimization. We introduce CrossGen, a novel framework that supports both feed-forward prediction and latent generative modeling of cross fields for quad meshing by unifying geometry and cross field representations within a joint latent space. Our method enables extremely fast computation of high-quality cross fields of general input shapes, typically within one second without per-shape optimization. Our method assumes a point-sampled surface, also called a {\em point-cloud surface}, as input, so we can accommodate various surface representations by a straightforward point sampling process. Using an auto-encoder network architecture, we encode input point-cloud surfaces into a sparse voxel grid with fine-grained latent spaces, which are decoded into both SDF-based surface geometry and cross fields(see the teaser figure). We also contribute a dataset of models with both high-quality signed distance fields (SDFs) representations and their corresponding cross fields, and use it to train our network. Once trained, the network is capable of computing a cross field of an input surface in a feed-forward manner, ensuring high geometric fidelity, noise resilience, and rapid inference. Furthermore, leveraging the same unified latent representation, we incorporate a diffusion model for computing cross fields of new shapes generated from partial input, such as sketches. To demonstrate its practical applications, we validate CrossGen on the quad mesh generation task for a large variety of surface shapes. Experimental results...

cs.GR↗

Safe and Efficient Lane-Changing for Autonomous Vehicles: An Improved Double Quintic Polynomial Approach with Time-to-Collision Evaluation

Autonomous driving technology has made significant advancements in recent years, yet challenges remain in ensuring safe and comfortable interactions with human-driven vehicles (HDVs), particularly during lane-changing maneuvers. This paper proposes an improved double quintic polynomial approach for safe and efficient lane-changing in mixed traffic environments. The proposed method integrates a time-to-collision (TTC) based evaluation mechanism directly into the trajectory optimization process, ensuring that the ego vehicle proactively maintains a safe gap from surrounding HDVs throughout the maneuver. The framework comprises state estimation for both the autonomous vehicle (AV) and HDVs, trajectory generation using double quintic polynomials, real-time TTC computation, and adaptive trajectory evaluation. To the best of our knowledge, this is the first work to embed an analytic TTC penalty directly into the closed-form double-quintic polynomial solver, enabling real-time safety-aware trajectory generation without post-hoc validation. Extensive simulations conducted under diverse traffic scenarios demonstrate the safety, efficiency, and comfort of the proposed approach compared to conventional methods such as quintic polynomials, Bezier curves, and B-splines. The results highlight that the improved method not only avoids collisions but also ensures smooth transitions and adaptive decision-making in dynamic environments. This work bridges the gap between model-based and adaptive trajectory planning approaches, offering a stable solution for real-world autonomous driving applications.

cs.RO↗

SCP-116K: A High-Quality Problem-Solution Dataset and a Generalized Pipeline for Automated Extraction in the Higher Education Science Domain

Recent breakthroughs in large language models (LLMs) exemplified by the impressive mathematical and scientific reasoning capabilities of the o1 model have spotlighted the critical importance of high-quality training data in advancing LLM performance across STEM disciplines. While the mathematics community has benefited from a growing body of curated datasets, the scientific domain at the higher education level has long suffered from a scarcity of comparable resources. To address this gap, we present SCP-116K, a new large-scale dataset of 116,756 high-quality problem-solution pairs, automatically extracted from heterogeneous sources using a streamlined and highly generalizable pipeline. Our approach involves stringent filtering to ensure the scientific rigor and educational level of the extracted materials, while maintaining adaptability for future expansions or domain transfers. By openly releasing both the dataset and the extraction pipeline, we seek to foster research on scientific reasoning, enable comprehensive performance evaluations of new LLMs, and lower the barrier to replicating the successes of advanced models like o1 in the broader science community. We believe SCP-116K will serve as a critical resource, catalyzing progress in high-level scientific reasoning tasks and promoting further innovations in LLM development. The dataset and code are publicly available at https://github.com/AQA6666/SCP-116K-open.

cs.CL↗

Multi-modal Knowledge Decomposition based Online Distillation for Biomarker Prediction in Breast Cancer Histopathology

Immunohistochemical (IHC) biomarker prediction benefits from multi-modal data fusion analysis. However, the simultaneous acquisition of multi-modal data, such as genomic and pathological information, is often challenging due to cost or technical limitations. To address this challenge, we propose an online distillation approach based on Multi-modal Knowledge Decomposition (MKD) to enhance IHC biomarker prediction in haematoxylin and eosin (H\&E) stained histopathology images. This method leverages paired genomic-pathology data during training while enabling inference using either pathology slides alone or both modalities. Two teacher and one student models are developed to extract modality-specific and modality-general features by minimizing the MKD loss. To maintain the internal structural relationships between samples, Similarity-preserving Knowledge Distillation (SKD) is applied. Additionally, Collaborative Learning for Online Distillation (CLOD) facilitates mutual learning between teacher and student models, encouraging diverse and complementary learning dynamics. Experiments on the TCGA-BRCA and in-house QHSU datasets demonstrate that our approach achieves superior performance in IHC biomarker prediction using uni-modal data. Our code is available at https://github.com/qiyuanzz/MICCAI2025_MKD.

cs.CV↗

iFairy: the First 2-bit Complex LLM with All Parameters in $\{\pm1, \pm i\}$

Quantization-Aware Training (QAT) integrates quantization into the training loop, enabling LLMs to learn robust low-bit representations, and is widely recognized as one of the most promising research directions. All current QAT research focuses on minimizing quantization error on full-precision models, where the full-precision accuracy acts as an upper bound (accuracy ceiling). No existing method has even attempted to surpass this ceiling. To break this ceiling, we propose a new paradigm: raising the ceiling (full-precision model), and then still quantizing it efficiently into 2 bits. We propose Fairy$\pm i$, the first 2-bit quantization framework for complex-valued LLMs. Specifically, our method leverages the representational advantages of the complex domain to boost full-precision accuracy. We map weights to the fourth roots of unity $\{\pm1, \pm i\}$, forming a perfectly symmetric and information-theoretically optimal 2-bit representation. Importantly, each quantized weight has either a zero real or imaginary part, enabling multiplication-free inference using only additions and element swaps. Experimental results show that Fairy$\pm i$ outperforms the ceiling of existing 2-bit quantization approaches in terms of both PPL and downstream tasks, while maintaining strict storage and compute efficiency. This work opens a new direction for building highly accurate and practical LLMs under extremely low-bit constraints.

cs.LG↗

Single-shot optical precessional magnetization switching of Pt/Co/Pt ferromagnetic trilayers

Ultra-fast magnetization switching triggered by a single femtosecond laser pulse has gained significant attention over the last decade for its potential in low-power consumption, high-speed memory applications. However, this phenomenon has been primarily observed in Gd-based ferrimagnetic materials, which are unsuitable for storage due to their weak perpendicular magnetic anisotropy (PMA). In this work, we demonstrated that applying a single laser pulse and an in-plane magnetic field can facilitate magnetic switching in a Pt/Co/Pt ferromagnetic trilayers stack within a specific laser power window. To further understand this phenomenon, we introduce a Cu layer to accelerates the re-establishment time of the anisotropy field of Pt/Co/Pt trilayers, which leads to bullseye-patterned magnetic switching. We have mapped state diagrams for these phenomena, and through micromagnetic simulations, we have determined that these switchings are influenced by thermal anisotropy torque, which can be modulated through PMA. These findings indicate that single-shot optical precessional magnetization reversal is feasible in a broader range of materials, opening avenues for the development of optical-magnetic memory devices.

cond-mat.mtrl-sci↗

PDT: Point Distribution Transformation with Diffusion Models

Point-based representations have consistently played a vital role in geometric data structures. Most point cloud learning and processing methods typically leverage the unordered and unconstrained nature to represent the underlying geometry of 3D shapes. However, how to extract meaningful structural information from unstructured point cloud distributions and transform them into semantically meaningful point distributions remains an under-explored problem. We present PDT, a novel framework for point distribution transformation with diffusion models. Given a set of input points, PDT learns to transform the point set from its original geometric distribution into a target distribution that is semantically meaningful. Our method utilizes diffusion models with novel architecture and learning strategy, which effectively correlates the source and the target distribution through a denoising process. Through extensive experiments, we show that our method successfully transforms input point clouds into various forms of structured outputs - ranging from surface-aligned keypoints, and inner sparse joints to continuous feature lines. The results showcase our framework's ability to capture both geometric and semantic features, offering a powerful tool for various 3D geometry processing tasks where structured point distributions are desired. Code will be available at this link: https://github.com/shanemankiw/PDT.

cs.CV↗

A reconfigurable arbitrary retarder array as complex structured matter

Tuneable retarder arrays, such as spatially patterned liquid crystal devices, have given rise to impressive photonic functionality, fuelling diverse applications ranging from microscopy and holography to encryption and communications. Presently these solutions are limited by the controllable degrees of freedom of structured matter, hindering applications that demand photonic systems with high flexibility and reconfigurable topologies. Here we demonstrate a compound modulator that implements a synthetic tuneable arbitrary retarder array as virtual pixels derived by cascading low functionality tuneable devices, realising full dynamic control of its arbitrary elliptical axis geometry, retardance value, and induced phase. Our approach offers unprecedented functionality that is user-defined and possesses high flexibility, allowing our modulator to act as a new beam generator, analyser, and corrector, opening an exciting path to tuneable topologies of light and matter.

physics.optics↗

Real-space titration and manipulation of particle-like correlated electrons in doped Mott insulator

The localized (particle-like) correlated electrons deserve particular attention as they govern various exotic quantum phenomena, such as quantum spin liquids, Wigner crystals, and Mott insulators in correlated systems. However, direct observation and manipulation of these particle-like electrons at the atomic or single-electron scale remain highly challenging. Here, we successfully realize and directly visualize particle-like correlated electrons in 1T-TaS2 through hole doping. The potential-dependent local electronic structure of single particle-like electron is revealed by angle-resolved photoemission spectroscopy (ARPES), scanning tunneling spectroscopy (STS) combined with theoretical calculations. The complex correlated interactions including nearest-neighbor attractive interactions and many-body repulsive interactions are further demonstrated and discussed based on the spatial distribution of particle-like electrons. Furthermore, the tentative manipulation of the particle-like electrons is successfully achieved by the energy-excitation mechanism. Our results not only provide profound insights into particle-like electrons in correlated systems, but also establish a versatile platform for designing and controlling quantum states at the atomic scale.

cond-mat.str-el↗

Enhanced oil recovery in reservoirs via diffusion-driven $\text{CO}_{2}$ flooding: Experimental insights and material balance modeling

$\text{CO}_{2}$ flooding is central to carbon utilization technologies, yet conventional waterflooding models fail to capture the complex interactions between CO$_2$ and formation fluids. In this study, one- and two-dimensional nuclear magnetic resonance experiments reveal that $\text{CO}_{2}$ markedly enhances crude oil mobility during miscible displacement via multiple synergistic mechanisms, yielding a recovery factor of $60.97\%$, which surpasses that of immiscible displacement (maximum $57.53\%$). Guided by these findings, we propose a convection-diffusion model that incorporates the diffusion coefficient ($D$) and porosity ($ϕ$) as key parameters. This model captures the spatiotemporal evolution of the $\text{CO}_{2}$ front and addresses a key limitation of conventional formulations-the omission of diffusion effects. It improves predictions of gas breakthrough time and enables optimized injection design for low-permeability reservoirs. Extending classical material balance theory, we develop an enhanced $\text{CO}_{2}$ flooding equation that integrates critical transport phenomena. This formulation incorporates $\text{CO}_{2}$ diffusion, oil phase expansion, reservoir adsorption, and gas compressibility to describe the dynamic transport and mass compensation of injected $\text{CO}_{2}$. Validation through experimental and numerical data confirms the model's robustness and applicability under low-permeability conditions. The proposed framework overcomes limitations of physical experiments under extreme environments and offers theoretical insight into oil recovery enhancement and $\text{CO}_{2}$ injection strategy optimization.

physics.flu-dyn↗

Frequency-enhanced Multi-granularity Context Network for Efficient Vertebrae Segmentation

Automated and accurate segmentation of individual vertebra in 3D CT and MRI images is essential for various clinical applications. Due to the limitations of current imaging techniques and the complexity of spinal structures, existing methods still struggle with reducing the impact of image blurring and distinguishing similar vertebrae. To alleviate these issues, we introduce a Frequency-enhanced Multi-granularity Context Network (FMC-Net) to improve the accuracy of vertebrae segmentation. Specifically, we first apply wavelet transform for lossless downsampling to reduce the feature distortion in blurred images. The decomposed high and low-frequency components are then processed separately. For the high-frequency components, we apply a High-frequency Feature Refinement (HFR) to amplify the prominence of key features and filter out noises, restoring fine-grained details in blurred images. For the low-frequency components, we use a Multi-granularity State Space Model (MG-SSM) to aggregate feature representations with different receptive fields, extracting spatially-varying contexts while capturing long-range dependencies with linear complexity. The utilization of multi-granularity contexts is essential for distinguishing similar vertebrae and improving segmentation accuracy. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches on both CT and MRI vertebrae segmentation datasets. The source code is publicly available at https://github.com/anaanaa/FMCNet.

cs.CV↗

TextBraTS: Text-Guided Volumetric Brain Tumor Segmentation with Innovative Dataset Development and Fusion Module Exploration

Deep learning has demonstrated remarkable success in medical image segmentation and computer-aided diagnosis. In particular, numerous advanced methods have achieved state-of-the-art performance in brain tumor segmentation from MRI scans. While recent studies in other medical imaging domains have revealed that integrating textual reports with visual data can enhance segmentation accuracy, the field of brain tumor analysis lacks a comprehensive dataset that combines radiological images with corresponding textual annotations. This limitation has hindered the exploration of multimodal approaches that leverage both imaging and textual data. To bridge this critical gap, we introduce the TextBraTS dataset, the first publicly available volume-level multimodal dataset that contains paired MRI volumes and rich textual annotations, derived from the widely adopted BraTS2020 benchmark. Building upon this novel dataset, we propose a novel baseline framework and sequential cross-attention method for text-guided volumetric medical image segmentation. Through extensive experiments with various text-image fusion strategies and templated text formulations, our approach demonstrates significant improvements in brain tumor segmentation accuracy, offering valuable insights into effective multimodal integration techniques. Our dataset, implementation code, and pre-trained models are publicly available at https://github.com/Jupitern52/TextBraTS.

cs.CV↗

Atomic to mesoscale hierarchical structures and magnetic states in an anisotropic layered ferromagnet FePd2Te2

Two-dimensional (2D) magnetic materials have predominantly exhibited easy-axis or easy-plane anisotropy and display a high sensitivity to the underlying crystal structure and lattice symmetry. Recently, an in-plane anisotropic 2D ferromagnet of FePd2Te2 has been discovered with intriguing structure and quasi-one-dimensional spin system. Here, we report a real-space investigation of its twinning structure and magnetic states using atomic/magnetic force microscopy (AFM/MFM) combined with scanning tunneling microscopy (STM). The atomic to mesoscale hierarchical structures with the orthogonal and corrugated compressive /tensile(C/T) regions are directly observed due to the intrinsic twinning-domain characteristic. The structure-related intact ferromagnetic (FM), field-induced polarized-FM states and their transitions are comparatively discussed at the mesoscale with the corresponding macroscopic magnetic measurements. Temperature- and field-dependent evolution of magnetic phase are further investigated at the FM and PM states, and summarized to obtain a unique H-T phase diagram of FePd2Te2. Our work provides key results for understanding the complicated magnetic properties of FePd2Te2, and suggests new directions for manipulating magnetic states through the atomic and mesoscale structure engineering.

cond-mat.mtrl-sci↗

A$^2$ATS: Retrieval-Based KV Cache Reduction via Windowed Rotary Position Embedding and Query-Aware Vector Quantization

Long context large language models (LLMs) pose significant challenges for efficient serving due to the large memory footprint and high access overhead of KV cache. Retrieval-based KV cache reduction methods can mitigate these challenges, typically by offloading the complete KV cache to CPU and retrieving necessary tokens on demand during inference. However, these methods still suffer from unsatisfactory accuracy degradation and extra retrieval overhead. To address these limitations, this paper proposes A$^2$ATS, a novel retrieval-based KV cache reduction method. A$^2$ATS aims to obtain an accurate approximation of attention scores by applying the vector quantization technique to key states, thereby enabling efficient and precise retrieval of the top-K tokens. First, we propose Windowed Rotary Position Embedding, which decouples the positional dependency from query and key states after position embedding. Then, we propose query-aware vector quantization that optimizes the objective of attention score approximation directly. Finally, we design the heterogeneous inference architecture for KV cache offloading, enabling long context serving with larger batch sizes. Experimental results demonstrate that A$^2$ATS can achieve a lower performance degradation with similar or lower overhead compared to existing methods, thereby increasing long context serving throughput by up to $2.7 \times$.

cs.CL↗