arXiv subjects

Zhe Qu

Publications and source records attributed to Zhe Qu.

At least 19 recordsLinked to original sources

arXiv2026

Non-Crossing Deep Quantile Regression for Distributional Survival Prediction

In survival analysis the way covariates act on the risk of an event often differs between early and late failure times, yet hazard- and mean-based summaries collapse this variation into a single number. Quantile-based modeling instead describes the full conditional distribution on the original time scale, but existing censored-data methods are either inflexible or produce logically inconsistent crossing quantile curves. We propose a Censored Non-crossing Quantile (CNQ) framework for right-censored data that jointly estimates several conditional survival quantiles and guarantees valid ordering by construction, with flexibility supplied by Kolmogorov-Arnold and Transformer backbones, and we establish a finite-sample excess-risk bound holding jointly across all fitted quantile levels. Across 27 simulation settings and six cohorts the framework attains lower pinball loss than quantile-, hazard- and tree-based competitors whenever the conditional distribution is asymmetric, with interval coverage closer to nominal on all six. In two clinical case studies (METABRIC, breast cancer; FLCHAIN, population mortality) it recovers covariate effects that vary across the survival distribution and would be hidden by a single hazard ratio, and yields coherent individualized quantile milestones. Code: https://github.com/BIG-S2/deepcnq

stat.ML↗

arXiv2026

$5/9-$Magnetization Plateau and Spin Supersolidity in YCu$_3$(OD)$_{7-x}$Br$_{2+x}$ under Magnetic Fields up to 120~T

We performed high-precision magnetization measurements up to 120~T on three compositions of the newly discovered kagome antiferromagnet YCu$_3$(OD)$_{7-x}$Br$_{2+x}$ (YCOB), revealing a previously unobserved 5/9 fractional magnetization plateau. All YCOB samples with different Br$^-$ concentrations exhibit nearly identical magnetization curves below 60~T, whereas the 5/9 plateau appears at markedly different fields in the ultrahigh-field regime. By modeling the experimental data using tensor-network calculations, we derive the effective spin Hamiltonians for the YCOB family with three spatially anisotropic Heisenberg couplings (the 3$J$-type model), which quantitatively reproduces the measured magnetization processes and captures the composition-dependent evolution of the 5/9 plateau. Furthermore, our theoretical analysis suggests the emergence of a spin supersolid phase in the field window between the 1/3 and 5/9 plateaus, which is sensitive to spin exchange parameters and accounts for the significant variation in the critical fields of the 5/9 plateau observed among different YCOB compositions.

cond-mat.str-el↗

arXiv2026

MSD-Score: Multi-Scale Distributional Scoring for Reference-Free Image Caption Evaluation

Evaluating image captions without references remains challenging because global embedding similarity often misses fine-grained mismatches such as hallucinated objects, missing attributes, or incorrect relations. We propose MSD-Score, a reference-free metric that models image patch and text token embeddings as von Mises-Fisher mixtures on the unit hypersphere. Instead of treating each modality as a single point, MSD-Score formulates image-text matching as a multi-scale distributional scoring problem. Semantic discrepancies are quantified via a weighted bi-directional KL divergence and combined with global similarity in a multi-scale framework for both single- and multi-candidate evaluations. Extensive experiments show that MSD-Score achieves state-of-the-art correlation with human judgments among reference-free metrics. Beyond accuracy, its probabilistic formulation yields transparent and decomposable diagnostics of local grounding errors, providing a deterministic complementary signal to holistic similarity metrics and judge-based evaluators.

cs.CV↗

arXiv2026

Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery

Vision-language-action (VLA) models have advanced the field of embodied manipulation by harnessing broad world knowledge and strong generalization. However, current VLA models still face several key challenges, including limited reasoning capability, lack of status monitoring, and difficulty in self-correction. In this paper, we introduce \textbf{Sentinel-VLA}, a metacognitive VLA model equipped with an active ``sentinel'' module to monitor real-time execution status. Only when necessary, such as during initial planning or upon detecting an error, the model triggers a dynamic reasoning or formulate error recovery solutions. This on-demand reasoning mechanism ensures robust decision-making while minimizing computational overhead. Notably, all training data (spanning 44 tasks and over 2.6 million transitions) is automatically generated and annotated through our designed pipeline. We also propose the Self-Evolving Continual Learning (SECL) algorithm, which allows Sentinel-VLA to identify its capability boundaries and automatically collect data for expansion, paired with Orthogonal Continual Adapter (OC-Adapter) to constrain parameter updates to an orthogonal space, thereby preventing catastrophic forgetting. Real-world experiments demonstrate that Sentinel-VLA boosts the task success rate by over 30\% compared to the SOTA model, PI0. We will open-source all the code, weights, and data generation pipeline.

cs.RO↗

arXiv2026

Electrical Transport and Quantum Oscillations in the Metallic Spin Supersolid EuCo2Al9

The discovery of spin supersolid and its giant magnetocaloric effect has opened a new arena in frustrated quantum magnets and cutting-edge cryogenics. The intermetallic EuCo2Al9 (ECA), for the first time, extends this intriguing phase from Mott insulators to a highly conductive metal [1]. In this work, we systematically study the electrical transport properties of ECA, where itinerant electrons serve as a sensitive probe for the spin supersolid states. We observe anomalies both in the temperature-dependent resistivity and field-dependent magnetoresistance and Hall signals, which are attributed to response of electrons to the Eu2+ spins and their fluctuations. Moreover, Shubnikov-de Haas quantum oscillations at high magnetic field reveal pronounced band splitting in the spin polarized state. Our results reveal an intimate correspondence between electrical transport and magnetic transitions in ECA, deepening the understanding of this metallic spin supersolid.

cond-mat.str-el↗

arXiv2026

RKKY-dipolar Interactions and 3D Spin Supersolid on Stacked Triangular Lattice

Inspired by the recent discovery of metallic spin supersolidity and its giant magnetocaloric effect in the rare-earth alloy EuCo$_2$Al$_9$ [Nature 651, 61 (2026)], we perform a combined study through electronic structure analysis, effective spin model, and Monte Carlo simulations on a stacked triangular lattice, and reveal a novel mechanism for the emergence of 3D spin supersolid in a metallic antiferromagnet. From first-principles inputs, we derive a minimal spin model on a stacked triangular lattice (STL), which arises from the interplay between Ruderman-Kittel-Kasuya-Yosida (RKKY) and dipolar interactions and accurately reproduces the experimental thermodynamics. Based on the STL model, we identify a ground state that simultaneously breaks discrete lattice translational symmetry and continuous spin-rotational symmetry -- the hallmark of a spin supersolid. Furthermore, we present the field-temperature phase diagram of the 3D STL model and discuss the various magnetic phases and associated phase transitions. Under zero field, the spin supersolid Y order establishes in two steps: an upper transition at $T_{N1}$, where an emergent U(1) symmetry appears and the system enters a fluctuating collinear regime, followed by a lower transition at $T_{N2}$ into the spin supersolid Y phase. In contrast, the supersolid V phase undergoes a single phase transition at $T_N^V$. Our results not only provide a comprehensive theoretical understanding of the metallic spin supersolid reported for EuCo$_2$Al$_9$ but also pave the way for further experimental investigations into its supersolid transitions and universality class.

cond-mat.str-el↗

arXiv2025

Collective Communication for 100k+ GPUs

The increasing scale of large language models (LLMs) necessitates highly efficient collective communication frameworks, particularly as training workloads extend to hundreds of thousands of GPUs. Traditional communication methods face significant throughput and latency limitations at this scale, hindering both the development and deployment of state-of-the-art models. This paper presents the NCCLX collective communication framework, developed at Meta, engineered to optimize performance across the full LLM lifecycle, from the synchronous demands of large-scale training to the low-latency requirements of inference. The framework is designed to support complex workloads on clusters exceeding 100,000 GPUs, ensuring reliable, high-throughput, and low-latency data exchange. Empirical evaluation on the Llama4 model demonstrates substantial improvements in communication efficiency. This research contributes a robust solution for enabling the next generation of LLMs to operate at unprecedented scales.

cs.DC↗

arXiv2025

Phase-sensitive evidence for pair density waves in a kagome superconductor

Pair density wave (PDW) exhibits periodic amplitude and sign modulations of the superconducting order parameter. Such a pairing state has long been proposed to be highly sensitive to nonmagnetic scattering, but its experimental realization remains elusive. Here we discover a nonmagnetic PDW-breaking effect in a kagome superconductor, using designer atomic nonmagnetic impurities and high-precision scanning tunneling microscopy (STM) at a base temperature of 30mK. We detect 2x2 pair density modulations by Josephson STM with a superconducting tip and 2x2 pairing gap modulations by normal STM. We find that the pairing modulations in both cases are substantially suppressed upon doping the kagome lattice with dilute isovalent nonmagnetic impurities, whereas the charge order and uniform superconductivity remain robust. We further identify the correlation between atomic dopants and the local suppression of PDW. We attribute these findings to a nonmagnetic pair-breaking effect, arising from the phase modulation of PDW in the kagome d-orbital. Taken together with its signatures in other state-of-the-art spectroscopy and transport measurements linked by theory, our findings support the ground state of the kagome superconductor as a correlated topological phase with superconducting loop currents.

cond-mat.supr-con↗

arXiv2025

Contrastive Regularization over LoRA for Multimodal Biomedical Image Incremental Learning

Multimodal Biomedical Image Incremental Learning (MBIIL) is essential for handling diverse tasks and modalities in the biomedical domain, as training separate models for each modality or task significantly increases inference costs. Existing incremental learning methods focus on task expansion within a single modality, whereas MBIIL seeks to train a unified model incrementally across modalities. The MBIIL faces two challenges: I) How to preserve previously learned knowledge during incremental updates? II) How to effectively leverage knowledge acquired from existing modalities to support new modalities? To address these challenges, we propose MSLoRA-CR, a method that fine-tunes Modality-Specific LoRA modules while incorporating Contrastive Regularization to enhance intra-modality knowledge sharing and promote inter-modality knowledge differentiation. Our approach builds upon a large vision-language model (LVLM), keeping the pretrained model frozen while incrementally adapting new LoRA modules for each modality or task. Experiments on the incremental learning of biomedical images demonstrate that MSLoRA-CR outperforms both the state-of-the-art (SOTA) approach of training separate models for each modality and the general incremental learning method (incrementally fine-tuning LoRA). Specifically, MSLoRA-CR achieves a 1.88% improvement in overall performance compared to unconstrained incremental learning methods while maintaining computational efficiency. Our code is publicly available at https://github.com/VentusAislant/MSLoRA_CR.

cs.LG↗

arXiv2025

Giant Self Spin-Valve Effect in the Kagome Helimagnet

Kagome magnets can combine non-trivial band topology and electron correlations, offering a versatile playground for various quantum phenomena. In this work we propose that kagome magnets with frustrated interlayer interactions can intrinsically support a self spin-valve effect, and experimentally confirm this in the kagome helimagnet TmMn$_6$Sn$_6$. Under a magnetic field perpendicular to the helical axis, using magnetic force microscopy we observed stripe domains that stack strictly along the helical axis, which we attribute to the stability loss of the kagome helimagnetic state. Such a domain pattern spontaneously mimics the artificial multilayered structure in traditional spin valves, which, combined with the high spin polarization, leads to a giant magnetoresistance (GMR) ratio over 160%. This discovery opens an avenue to realize inherent spin valves in a variety of quantum magnets, and can hold promise in future spintronics.

cond-mat.str-el↗

arXiv2025

Berezinskii-Kosterlitz-Thouless region and magnetization plateaus in easy-axis triangular weak-dimer antiferromagnet K$_2$Co$_2$(SeO$_3$)$_3$

We investigate the magnetic phase diagram of the bilayer triangular antiferromagnet K$_2$Co$_2$(SeO$_3$)$_3$, revealing a rich interplay among geometric frustration, bilayer coupling, and symmetry-driven phenomena. High-field magnetization measurements show fractional magnetization plateaus at 1/3, 1/2, 2/3, and 5/6 of the saturation magnetization. To elucidate the experimental magnetic phase diagram at low fields, we propose that K$_2$Co$_2$(SeO$_3$)$_3$ can be described as an easy-axis triangular weak-dimer antiferromagnet. We emphasize the critical role of the emergent $U(1) \otimes S_3$ symmetry, where $S_3 = \mathbb{Z}_3 \otimes \mathbb{Z}_2^d$, in determining the magnetic phases at low fields. The remarkable agreement between the experimental and theoretical phase diagrams suggests that the phase transitions are governed by this symmetry. Notably, our combined experimental and theoretical results identify a Berezinskii-Kosterlitz-Thouless (BKT) phase region at finite fields. These findings provide new insights into the phase structure of frustrated magnets and establish K$_2$Co$_2$(SeO$_3$)$_3$ as a compelling platform for exploring unconventional quantum phenomena in $U(1) \otimes S_3$ systems.

cond-mat.str-el↗

arXiv2025

Bias voltage controlled inversions of tunneling magnetoresistance in van der Waals heterostructures Fe3GaTe2/hBN/Fe3GaTe2

We report the bias voltage controlled inversions of tunneling magnetoresistance (TMR) in magnetic tunnel junctions composed of Fe3GaTe2 electrodes and hBN tunneling barrier, observed at room temperature. The polarity reversal of TMR occurs consistently at around 0.625 V across multiple devices and temperatures, highlighting the robustness of the effect. To understand this behavior, we developed a theoretical model incorporating spin-resolved density of states (DOS) at high energy levels. By adjusting the DOS weighting at different k points to account for misalignment between the crystal structure of electrodes in experimental devices, we improved agreement between experimental and theoretical inversion voltages. Our results provide valuable insight into the voltage-controlled spin injection and detection in two-dimensional magnetic tunnel junctions, with implications for the development of energy-efficient spintronic devices.

cond-mat.mes-hall↗

arXiv2024

How Does the Smoothness Approximation Method Facilitate Generalization for Federated Adversarial Learning?

Federated Adversarial Learning (FAL) is a robust framework for resisting adversarial attacks on federated learning. Although some FAL studies have developed efficient algorithms, they primarily focus on convergence performance and overlook generalization. Generalization is crucial for evaluating algorithm performance on unseen data. However, generalization analysis is more challenging due to non-smooth adversarial loss functions. A common approach to addressing this issue is to leverage smoothness approximation. In this paper, we develop algorithm stability measures to evaluate the generalization performance of two popular FAL algorithms: \textit{Vanilla FAL (VFAL)} and {\it Slack FAL (SFAL)}, using three different smooth approximation methods: 1) \textit{Surrogate Smoothness Approximation (SSA)}, (2) \textit{Randomized Smoothness Approximation (RSA)}, and (3) \textit{Over-Parameterized Smoothness Approximation (OPSA)}. Based on our in-depth analysis, we answer the question of how to properly set the smoothness approximation method to mitigate generalization error in FAL. Moreover, we identify RSA as the most effective method for reducing generalization error. In highly data-heterogeneous scenarios, we also recommend employing SFAL to mitigate the deterioration of generalization performance caused by heterogeneity. Based on our theoretical results, we provide insights to help develop more efficient FAL algorithms, such as designing new metrics and dynamic aggregation rules to mitigate heterogeneity.

cs.LG↗

arXiv2024

Way to Specialist: Closing Loop Between Specialized LLM and Evolving Domain Knowledge Graph

Large language models (LLMs) have demonstrated exceptional performance across a wide variety of domains. Nonetheless, generalist LLMs continue to fall short in reasoning tasks necessitating specialized knowledge. Prior investigations into specialized LLMs focused on domain-specific training, which entails substantial efforts in domain data acquisition and model parameter fine-tuning. To address these challenges, this paper proposes the Way-to-Specialist (WTS) framework, which synergizes retrieval-augmented generation with knowledge graphs (KGs) to enhance the specialized capability of LLMs in the absence of specialized training. In distinction to existing paradigms that merely utilize external knowledge from general KGs or static domain KGs to prompt LLM for enhanced domain-specific reasoning, WTS proposes an innovative "LLM$\circlearrowright$KG" paradigm, which achieves bidirectional enhancement between specialized LLM and domain knowledge graph (DKG). The proposed paradigm encompasses two closely coupled components: the DKG-Augmented LLM and the LLM-Assisted DKG Evolution. The former retrieves question-relevant domain knowledge from DKG and uses it to prompt LLM to enhance the reasoning capability for domain-specific tasks; the latter leverages LLM to generate new domain knowledge from processed tasks and use it to evolve DKG. WTS closes the loop between DKG-Augmented LLM and LLM-Assisted DKG Evolution, enabling continuous improvement in the domain specialization as it progressively answers and learns from domain-specific questions. We validate the performance of WTS on 6 datasets spanning 5 domains. The experimental results show that WTS surpasses the previous SOTA in 4 specialized domains and achieves a maximum performance improvement of 11.3%.

cs.CL↗

arXiv2024

Exchange bias-like behavior due to hidden local magnetic state in a Weyl semimetal

Magnetic Weyl semimetals, which couple magnetic order with topological features, have emerged as promising candidates for advanced topological-materials-based applications. The switching of magnetization and the driving of domain wall motion play key roles in developing such applications. In this study, we suggest that a type of hard-magnetic nuclei dominates the magnetic reversal and induces an exchange bias-like behavior with a prior magnetic history in the bulk Co3Sn2S2 Weyl semimetal. The sign change of the exchange bias-like behavior can be realized by controlling the orientation of such hard-magnetic nuclei. Remarkably, these nuclei can retain their magnetic orientation at a temperature well above the Curie temperature of this material, suggesting the existence of a local magnetic state with non-zero magnetization and high stability. This local state is potentially related to the spin-orbit polaron reported in this system. Our study offers a new scenario for manipulating the magnetic reversal and offers new insights into the magnetism in this Weyl system.

cond-mat.mtrl-sci↗

arXiv2024

MARE: Multi-Aspect Rationale Extractor on Unsupervised Rationale Extraction

Unsupervised rationale extraction aims to extract text snippets to support model predictions without explicit rationale annotation. Researchers have made many efforts to solve this task. Previous works often encode each aspect independently, which may limit their ability to capture meaningful internal correlations between aspects. While there has been significant work on mitigating spurious correlations, our approach focuses on leveraging the beneficial internal correlations to improve multi-aspect rationale extraction. In this paper, we propose a Multi-Aspect Rationale Extractor (MARE) to explain and predict multiple aspects simultaneously. Concretely, we propose a Multi-Aspect Multi-Head Attention (MAMHA) mechanism based on hard deletion to encode multiple text chunks simultaneously. Furthermore, multiple special tokens are prepended in front of the text with each corresponding to one certain aspect. Finally, multi-task training is deployed to reduce the training overhead. Experimental results on two unsupervised rationale extraction benchmarks show that MARE achieves state-of-the-art performance. Ablation studies further demonstrate the effectiveness of our method. Our codes have been available at https://github.com/CSU-NLP-Group/MARE.

cs.CL↗

arXiv2024

FedGCA: Global Consistent Augmentation Based Single-Source Federated Domain Generalization

Federated Domain Generalization (FedDG) aims to train the global model for generalization ability to unseen domains with multi-domain training samples. However, clients in federated learning networks are often confined to a single, non-IID domain due to inherent sampling and temporal limitations. The lack of cross-domain interaction and the in-domain divergence impede the learning of domain-common features and limit the effectiveness of existing FedDG, referred to as the single-source FedDG (sFedDG) problem. To address this, we introduce the Federated Global Consistent Augmentation (FedGCA) method, which incorporates a style-complement module to augment data samples with diverse domain styles. To ensure the effective integration of augmented samples, FedGCA employs both global guided semantic consistency and class consistency, mitigating inconsistencies from local semantics within individual clients and classes across multiple clients. The conducted extensive experiments demonstrate the superiority of FedGCA.

cs.AI↗

arXiv2024

Stability and Generalization for Stochastic Recursive Momentum-based Algorithms for (Strongly-)Convex One to $K$-Level Stochastic Optimizations

STOchastic Recursive Momentum (STORM)-based algorithms have been widely developed to solve one to $K$-level ($K \geq 3$) stochastic optimization problems. Specifically, they use estimators to mitigate the biased gradient issue and achieve near-optimal convergence results. However, there is relatively little work on understanding their generalization performance, particularly evident during the transition from one to $K$-level optimization contexts. This paper provides a comprehensive generalization analysis of three representative STORM-based algorithms: STORM, COVER, and SVMR, for one, two, and $K$-level stochastic optimizations under both convex and strongly convex settings based on algorithmic stability. Firstly, we define stability for $K$-level optimizations and link it to generalization. Then, we detail the stability results for three prominent STORM-based algorithms. Finally, we derive their excess risk bounds by balancing stability results with optimization errors. Our theoretical results provide strong evidence to complete STORM-based algorithms: (1) Each estimator may decrease their stability due to variance with its estimation target. (2) Every additional level might escalate the generalization error, influenced by the stability and the variance between its cumulative stochastic gradient and the true gradient. (3) Increasing the batch size for the initial computation of estimators presents a favorable trade-off, enhancing the generalization performance.

cs.LG↗