Searcharxiv⌕ Search

arXiv subjects

Zhenyu Zhang

Publications and source records attributed to Zhenyu Zhang.

At least 127 records · Page 7Linked to original sources

Resonance parameters of the vector charmoniumlike state $G(3900)$

Motivated by the updated analysis of the $G(3900)$ by the BESIII collaboration, we perform a global analysis of the cross sections of the $e^+e^-\to D\bar{D}$, $e^+e^-\to D\bar{D}^*+c.c.$, $e^+e^-\to D^*\bar{D}^*$ processes, especially focusing on the properties of the $G(3900)$. As the energy region of interest is limited by the next opening threshold, i.e. the $D_1\bar{D}$ threshold, we focus on the energy region $[3.7,4.25]~\mathrm{GeV}$, where three charmonia $ψ(1D)$, $ψ(3S)$ and $ψ(2D)$ explicitly contribute to the cross sections. By constructing the $P$-wave contact interaction between the $(D,D^*)$ doublet and its antiparticle in the heavy quark limit, we extract the physical scattering amplitude by solving the Lippmann-Schwinger equation. No matter whether three or two charmonium states are included in our framework, we always find a dynamically generated state corresponding to the $G(3900)$, which suggests it to be a $P$-wave dynamically generated state. We also predict several dynamically generated states in the corresponding $1^{-+}$ channel. These states can be further searched for in the electron-positron annihilation process involving the emission of a single photon.

hep-ph↗

Spin-Valley Locking and Pure Spin-Triplet Superconductivity in Noncollinear Antiferromagnets Proximitized to Conventional Superconductors

Unconventional antiferromagnets with spin-split bands, such as noncollinear magnets and the recently discovered altermagnets, serve as new constituents to explore unconventional superconductivity. Here, we unveil a new type and previously unappreciated nature of spin-valley locking in noncollinear antiferromagnets and exploit this texture to achieve pure spin-triplet superconductivity. Using chiral antiferromagnetic kagome lattices (e.g., Mn$_3$Ge and Mn$_3$Ga) coupled to conventional $s$-wave superconductors as prototypical examples, we demonstrate that the antiferromagnetic chirality strongly favors spin-triplet pairing via superconducting proximity effect, while suppressing spin-singlet pairing in the antiferromagnets away from the interfaces. Crucially, such a long-sought spin-triplet superconducting state is established without invoking the prevailing mechanism of spin-orbit coupling or net magnetization. Furthermore, the spin-triplet supercurrent is resilient to both in-plane and out-of-plane Zeeman fields, which exhibits distinct superiority to Ising superconductivity, serving as a compelling experimental signature of the triplet pairing and spin-valley-locked texture.

cond-mat.supr-con↗

GDC Cohort Copilot: An AI Copilot for Curating Cohorts from the Genomic Data Commons

The Genomic Data Commons (GDC) provides access to high quality, harmonized cancer genomics data through a unified curation and analysis platform centered around patient cohorts. While GDC users can interactively create complex cohorts through the graphical Cohort Builder, users (especially new ones) may struggle to find specific cohort descriptors across hundreds of possible fields and properties. However, users may be better able to describe their desired cohort in free-text natural language. We introduce GDC Cohort Copilot, an open-source copilot tool for curating cohorts from the GDC. GDC Cohort Copilot automatically generates the GDC cohort filter corresponding to a user-input natural language description of their desired cohort, before exporting the cohort back to the GDC for further analysis. An interactive user interface allows users to further refine the generated cohort. We develop and evaluate multiple large language models (LLMs) for GDC Cohort Copilot and demonstrate that our locally-served, open-source GDC Cohort LLM achieves better results than GPT-4o prompting in generating GDC cohorts. We implement and share GDC Cohort Copilot as a containerized Gradio app on HuggingFace Spaces, available at https://huggingface.co/spaces/uc-ctds/GDC-Cohort-Copilot. GDC Cohort LLM weights are available at https://huggingface.co/uc-ctds. All source code is available at https://github.com/uc-cdis/gdc-cohort-copilot.

cs.CL↗

Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesis

We propose a novel spatial-temporal graph Mamba (STG-Mamba) for the music-guided dance video synthesis task, i.e., to translate the input music to a dance video. STG-Mamba consists of two translation mappings: music-to-skeleton translation and skeleton-to-video translation. In the music-to-skeleton translation, we introduce a novel spatial-temporal graph Mamba (STGM) block to effectively construct skeleton sequences from the input music, capturing dependencies between joints in both the spatial and temporal dimensions. For the skeleton-to-video translation, we propose a novel self-supervised regularization network to translate the generated skeletons, along with a conditional image, into a dance video. Lastly, we collect a new skeleton-to-video translation dataset from the Internet, containing 54,944 video clips. Extensive experiments demonstrate that STG-Mamba achieves significantly better results than existing methods.

cs.CV↗

Healing Powers of BERT: How Task-Specific Fine-Tuning Recovers Corrupted Language Models

Language models like BERT excel at sentence classification tasks due to extensive pre-training on general data, but their robustness to parameter corruption is unexplored. To understand this better, we look at what happens if a language model is "broken", in the sense that some of its parameters are corrupted and then recovered by fine-tuning. Strategically corrupting BERT variants at different levels, we find corrupted models struggle to fully recover their original performance, with higher corruption causing more severe degradation. Notably, bottom-layer corruption affecting fundamental linguistic features is more detrimental than top-layer corruption. Our insights contribute to understanding language model robustness and adaptability under adverse conditions, informing strategies for developing resilient NLP systems against parameter perturbations.

cs.CL↗

Prediction of High-Temperature Half Quantum Anomalous Hall Effect in a Semi-magnetic Topological Insulator of MnBi$_2$Te$_4$/Sb$_2$Te$_3$

The classic Thouless-Kohmoto-Nightingale-Nijs theorem dictates that a single electron band of a lattice can only harbor an integer quantum Hall conductance as a multiple of e^2/2h, while recent studies have pointed to the emergence of half quantum anomalous Hall (HQAH) effect, though the underlying microscopic mechanisms remain controversial. Here we propose an ideal platform of MnBi$_2$Te$_4$/Sb$_2$Te$_3$ that allows not only to realize the HQAH effect at much higher temperatures, but also to critically assess the different contributions of the gapped and gapless Dirac bands. We first show that the top surface bands of the Sb$_2$Te$_3$ film become gapped, while the bottom surface bands remain gapless due to proximity coupling with the MnBi$_2$Te$_4$ overlayer. Next we show that such a semi-magnetic topological insulator harbors the HQAH effect at ~20 K, with Cr doping enhancing it to as high as 67 K, driven by large magnetic anisotropy and strong magnetic coupling constants that raise the Curie temperature. Our detailed Berry curvature analysis further helps to reveal that, whereas the gapped surface bands can contribute to the Hall conductance when the chemical potential is tuned to overlap with the bands, these bands have no net contribution when the chemical potential is in the gapped region, leaving the gapless bands to be the sole contributor to the HQAH conductance. Counterintuitively, the part of the gapless bands within the gapped region of the top surface bands have no net contribution, thereby ensuring the plateau nature of the Hall conductance.

cond-mat.mes-hall↗

Ferroelectrically Switchable Half-Quantized Hall Effect

Integrating ferroelectricity, antiferromagnetism, and topological quantum transport within a single material is rare, but crucial for developing next-generation quantum devices. Here, we propose a multiferroic heterostructure consisting of an antiferromagnetic MnBi$_2$Te$_4$ bilayer and an Sb$_2$Te$_3$ film is able to harbor the half-quantized Hall (HQH) effect with a ferroelectrically switchable Hall conductivity of $e^2/2h$. We first show that, in the energetically stable configuration, the antiferromagnetic MnBi$_2$Te$_4$ bilayer opens a gap in the top surface bands of Sb$_2$Te$_3$ through proximity effect, while its bottom surface bands remain gapless; consequently, HQH conductivity of $e^2/2h$ can be sustained clockwise or counterclockwise depending on antiferromagnetic configuration of the MnBi$_2$Te$_4$. Remarkably, when applying interlayer sliding within the MnBi$_2$Te$_4$ bilayer, its electric polarization direction associated with parity-time reversal symmetry breaking is reversed, accompanied by a reversal of the HQH conductivity. The proposed approach offers a powerful route to control topological quantum transport in antiferromagnetic materials by ferroelectricity.

cond-mat.mes-hall↗

Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity

Large Language Models (LLMs), renowned for their remarkable performance across diverse domains, present a challenge when it comes to practical deployment due to their colossal model size. In response to this challenge, efforts have been directed toward the application of traditional network pruning techniques to LLMs, uncovering a massive number of parameters that can be pruned in one-shot without hurting performance. Prevailing LLM pruning strategies have consistently adhered to the practice of uniformly pruning all layers at equivalent sparsity, resulting in robust performance. However, this observation stands in contrast to the prevailing trends observed in the field of vision models, where non-uniform layerwise sparsity typically yields stronger results. To understand the underlying reasons for this disparity, we conduct a comprehensive study and discover a strong correlation with the emergence of activation outliers in LLMs. Inspired by this finding, we introduce a novel LLM pruning methodology that incorporates a tailored set of non-uniform layerwise sparsity ratios, termed as Outlier Weighed Layerwise sparsity (OWL). The sparsity ratio of OWL is proportional to the outlier ratio observed within each layer, facilitating a more effective alignment between layerwise weight sparsity and outlier ratios. Our empirical evaluation, conducted across the LLaMA-V1 family and OPT, spanning various benchmarks, demonstrates the distinct advantages offered by OWL over previous methods. For instance, OWL exhibits a remarkable performance gain, surpassing the state-of-the-art Wanda and SparseGPT by 61.22 and 6.80 perplexity at a high sparsity level of 70%, respectively, while delivering 2.6x end-to-end inference speed-up in the DeepSparse inference engine. Codes are available at https://github.com/luuyin/OWL.

cs.LG↗

On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention

Large language models (LLMs) excel at capturing global token dependencies via self-attention but face prohibitive compute and memory costs on lengthy inputs. While sub-quadratic methods (e.g., linear attention) can reduce these costs, they often degrade accuracy due to overemphasizing recent tokens. In this work, we first propose dual-state linear attention (DSLA), a novel design that maintains two specialized hidden states-one for preserving historical context and one for tracking recency-thereby mitigating the short-range bias typical of linear-attention architectures. To further balance efficiency and accuracy under dynamic workload conditions, we introduce DSLA-Serve, an online adaptive distillation framework that progressively replaces Transformer layers with DSLA layers at inference time, guided by a sensitivity-based layer ordering. DSLA-Serve uses a chained fine-tuning strategy to ensure that each newly converted DSLA layer remains consistent with previously replaced layers, preserving the overall quality. Extensive evaluations on commonsense reasoning, long-context QA, and text summarization demonstrate that DSLA-Serve yields 2.3x faster inference than Llama2-7B and 3.0x faster than the hybrid Zamba-7B, while retaining comparable performance across downstream tasks. Our ablation studies show that DSLA's dual states capture both global and local dependencies, addressing the historical-token underrepresentation seen in prior linear attentions. Codes are available at https://github.com/utnslab/DSLA-Serve.

cs.LG↗

BeamLoRA: Beam-Constraint Low-Rank Adaptation

Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods. Nevertheless, while LoRA improves efficiency, there remains room for improvement in accuracy. Herein, we adopt a novel perspective to assess the characteristics of LoRA ranks. The results reveal that different ranks within the LoRA modules not only exhibit varying levels of importance but also evolve dynamically throughout the fine-tuning process, which may limit the performance of LoRA. Based on these findings, we propose BeamLoRA, which conceptualizes each LoRA module as a beam where each rank naturally corresponds to a potential sub-solution, and the fine-tuning process becomes a search for the optimal sub-solution combination. BeamLoRA dynamically eliminates underperforming sub-solutions while expanding the parameter space for promising ones, enhancing performance with a fixed rank. Extensive experiments across three base models and 12 datasets spanning math reasoning, code generation, and commonsense reasoning demonstrate that BeamLoRA consistently enhances the performance of LoRA, surpassing the other baseline methods.

cs.CL↗

Dual-mode superconducting diode effect enabled by in-plane and out-of-plane magnetic field

The discovery of the superconducting diode effect (SDE) has been cherished as a milestone in developing superconducting electronics. Tremendous efforts are being dedicated to realizing SDE in a wide variety of material platforms. Despite the diversity in the hosting materials and device designs, SDE is usually operated in a single mode which is enabled by either out-of-plane or in-plane magnetic field/magnetization. In this work, we report the realization of a dual-mode SDE in 2H-$\mathrm{NbS_2}$/2H-$\mathrm{NbSe_2}$ heterostructures where both the out-of-plane magnetic field $B_{\perp}$ and in-plane magnetic field $B_{||}$ can independently generate and manipulate SDE. The two modes share similar diode efficiency but differ in two aspects: 1. $B_{\perp}$-induced SDE is activated by a field on the order of 1 mT while $B_{||}$-induced SDE requires a field on the order of 100 mT; 2. $η$ of $B_{\perp}$-induced SDE exhibits a square-root like temperature dependence while $η$ of $B_{||}$-induced SDE takes a more linear-like one. We demonstrate that the dual-mode SDE is most likely a result of mirror symmetry breaking along multiple orientations. Thanks to the two orders difference in the operational field for the two modes, we propose a dual-functionality device scheme to showcase the potential of the dual-mode SDE in realizing advanced superconducting architecture, where fast polarity-switching functionality is implemented with $B_{\perp}$-induced SDE and high-fidelity functionality is enabled with $B_{\perp}$-induced SDE.

cond-mat.supr-con↗

Cluster Counting Algorithm for the CEPC Drift Chamber using LSTM and DGCNN

The particle identification (PID) of hadrons plays a crucial role in particle physics experiments, especially in flavor physics and jet tagging. The cluster-counting method, which measures the number of primary ionizations in gaseous detectors, is a promising breakthrough in PID. However, developing an effective reconstruction algorithm for cluster counting remains challenging. To address this challenge, we propose a cluster-counting algorithm based on long short-term memory and dynamic graph convolutional neural networks for the CEPC drift chamber. Experiments on Monte Carlo simulated samples demonstrate that our machine-learning-based algorithm surpasses traditional methods. It improves the $K/π$ separation of PID by 10\%, meeting the PID requirements of CEPC.

hep-ex↗

Semantic-Guided Diffusion Model for Single-Step Image Super-Resolution

Diffusion-based image super-resolution (SR) methods have demonstrated remarkable performance. Recent advancements have introduced deterministic sampling processes that reduce inference from 15 iterative steps to a single step, thereby significantly improving the inference speed of existing diffusion models. However, their efficiency remains limited when handling complex semantic regions due to the single-step inference. To address this limitation, we propose SAMSR, a semantic-guided diffusion framework that incorporates semantic segmentation masks into the sampling process. Specifically, we introduce the SAM-Noise Module, which refines Gaussian noise using segmentation masks to preserve spatial and semantic features. Furthermore, we develop a pixel-wise sampling strategy that dynamically adjusts the residual transfer rate and noise strength based on pixel-level semantic weights, prioritizing semantically rich regions during the diffusion process. To enhance model training, we also propose a semantic consistency loss, which aligns pixel-wise semantic weights between predictions and ground truth. Extensive experiments on both real-world and synthetic datasets demonstrate that SAMSR significantly improves perceptual quality and detail recovery, particularly in semantically complex images. Our code is released at https://github.com/Liu-Zihang/SAMSR.

cs.CV↗

R-Sparse: Rank-Aware Activation Sparsity for Efficient LLM Inference

Large Language Models (LLMs), while demonstrating remarkable capabilities across various applications, present significant challenges during inference due to their substantial model size, especially when deployed on edge devices. Activation sparsity offers a promising solution to reduce computation and memory movement, enabling more efficient inference, particularly for small-batch on-device applications. However, current approaches face limitations with non-ReLU activation function, which are foundational to most advanced LLMs, or require heavy continual training. Additionally, the difficulty in predicting active channels and limited achievable sparsity ratios constrain the effectiveness of activation sparsity-based methods. In this paper, we introduce R-Sparse, a training-free activation sparsity approach capable of achieving high sparsity levels in advanced LLMs. We conducted two preliminary investigations into how different components contribute to the output within a single linear layer and found two key observations: (i) the non-sparse components of the input function can be regarded as a few bias terms, and (ii) The full computation can be effectively approximated by an appropriate combination of input channels and weight singular values. Building on this, we replace the linear layers in LLMs with a rank-aware sparse inference method that leverages the sparsity of input channels and singular value components, eliminating the need for active channel prediction like the output sparsity based approaches. Experiments on Llama-2/3 and Mistral models across ten diverse tasks demonstrate that R-Sparse achieves comparable performance at 50% model-level sparsity, resulting in a significant 43% end-to-end efficient improvements with customized kernels.

cs.LG↗

NTIRE 2025 Challenge on Cross-Domain Few-Shot Object Detection: Methods and Results

Cross-Domain Few-Shot Object Detection (CD-FSOD) poses significant challenges to existing object detection and few-shot detection models when applied across domains. In conjunction with NTIRE 2025, we organized the 1st CD-FSOD Challenge, aiming to advance the performance of current object detectors on entirely novel target domains with only limited labeled data. The challenge attracted 152 registered participants, received submissions from 42 teams, and concluded with 13 teams making valid final submissions. Participants approached the task from diverse perspectives, proposing novel models that achieved new state-of-the-art (SOTA) results under both open-source and closed-source settings. In this report, we present an overview of the 1st NTIRE 2025 CD-FSOD Challenge, highlighting the proposed solutions and summarizing the results submitted by the participants.

cs.CV↗

Cross-Frame OTFS Parameter Estimation Based On Chinese Remainder Theorem

Orthogonal time-frequency space (OTFS) is a potential waveform for integrated sensing and communications (ISAC) systems because it can manage communication and sensing metrics in one unified domain, and has better performance in high mobility scenarios. In practice, a target might come from far distance or with ultra-high speed. However, the max unambiguous range and max tolerable velocity of OTFS-ISAC system is limited by the unambiguous round-trip delay and Doppler shift, which are related to OTFS frame, i.e., time slots and subcarrier spacing, respectively. To enlarge the sensing range, a novel OTFS cross-frame ranging and velocity estimation model as well as its corresponding method based on the Chinese remainder theorem (CRT) are proposed in this paper. By designing co-prime numbers of subcarriers and time slots in different subframes, the difference in the responses of the subframes for a target can be used to estimate the distance and velocity of an out-of-range target. Several frame structures are further designed for specific sensing scenarios, such as target with ultra-high speed or at far distance. Simulation results show that the proposed method can achieve significantly better performance in NMSE compared with the classic sensing methods under the condition of same time and frequency resources.

eess.SP↗

Polarization Patterns of the Hotspots Plunging into a Kerr Black Hole

The multi-wavelength polarized light signals from supermassive black holes have sparked many studies on polarized images of accretion disks and hotspots. However, the polarization patterns within the innermost stable circular orbit (ISCO) region remain to be explored. In this study, we focus on two specific types of orbits, namely the plunging geodesics inward from the ISCO and homoclinic geodesics, to uncover the polarization features associated with non-circular motion in a Kerr spacetime. For an on-axis observer, we specifically develop an approximate function to describe gravitational lensing along the azimuthal direction and establish a simplified synchrotron emission model. Based on these, we analyze the time-integrated polarized images of hotspots and their Stokes parameters. Moreover, we explore the polarized image of the plunging region within a thin accretion disk.

astro-ph.HE↗

Follow Your Motion: A Generic Temporal Consistency Portrait Editing Framework with Trajectory Guidance

Pre-trained conditional diffusion models have demonstrated remarkable potential in image editing. However, they often face challenges with temporal consistency, particularly in the talking head domain, where continuous changes in facial expressions intensify the level of difficulty. These issues stem from the independent editing of individual images and the inherent loss of temporal continuity during the editing process. In this paper, we introduce Follow Your Motion (FYM), a generic framework for maintaining temporal consistency in portrait editing. Specifically, given portrait images rendered by a pre-trained 3D Gaussian Splatting model, we first develop a diffusion model that intuitively and inherently learns motion trajectory changes at different scales and pixel coordinates, from the first frame to each subsequent frame. This approach ensures that temporally inconsistent edited avatars inherit the motion information from the rendered avatars. Secondly, to maintain fine-grained expression temporal consistency in talking head editing, we propose a dynamic re-weighted attention mechanism. This mechanism assigns higher weight coefficients to landmark points in space and dynamically updates these weights based on landmark loss, achieving more consistent and refined facial expressions. Extensive experiments demonstrate that our method outperforms existing approaches in terms of temporal consistency and can be used to optimize and compensate for temporally inconsistent outputs in a range of applications, such as text-driven editing, relighting, and various other applications.

cs.CV↗