Searcharxiv⌕ Search

arXiv subjects

Zhiyuan Li

Publications and source records attributed to Zhiyuan Li.

At least 181 records · Page 10Linked to original sources
arXiv2025

AMUSE-Antlia. II. Intracluster X-ray Population in the Antlia Cluster

We conduct a systematic survey of X-ray sources in the inner ($r\sim200$ kpc) region of the Antlia cluster based on \Chandra observations, down to a source detection limit of $ L(0.5\text{--}8\ \mathrm{keV})\sim4.2\times10^{-7}\ \mathrm{ph\ cm^{-2}\ s^{-1}}$ ($2\times10^{38}\ \mathrm{erg\ s^{-1}}$). We present an X-ray source catalog with 202 sources and provide their coordinates, multi-band flux information and hardness ratios. We find a statistically significant excess at a significance level of $4.2σ$ with 37.6 excess sources beyond three times the mean effective radius of the two BCGs. This implies that these excess sources could be a genuine intracluster X-ray population that is not associated with the bulk stellar component. Also, the increased number of excess sources in the fields containing a BCG implies a potential connection between the excess sources and BCGs. The discovery of these sources in the Antlia cluster, together with previous research of similar findings in other two nearby clusters, Virgo and Fornax, indicates that the intracluster X-ray population could be universal in nearby galaxy clusters. Furthermore, we discuss the candidate origins of the excess sources, including low-mass X-ray binaries (LMXBs) associated with intracluster light (ICL-LMXBs), LMXBs in globular clusters (GC-LMXBs) and supernova-kicked LMXBs (SN-kicked LMXBs). We estimate the contribution of ICL-LMXBs, which should include the LMXBs relating with the stellar halo surrounding BCGs, are unlikely to dominate the intracluster X-ray population in Antlia. Meanwhile, GC-LMXBs and SN-kicked LMXBs, each component could contribute $\sim30\%$ to the total excess sources.

astro-ph.HE↗
arXiv2025

Chandra X-ray Measurement of Heavy Element Abundances of Wolf-Rayet Stars in the Galactic Center

Elemental abundances hold important information about the star formation history in the Galactic Center. The thermal X-ray spectra of certain stars can provide a robust probe of elemental abundances, mainly through the presence of K-shell emission lines. In this work, based on deep archival {\it Chandra} observations, we obtain X-ray measurements of five heavy elements (Si, S, Ar, Ca and Fe) for three sources in the Arches cluster, one source in the Quintuplet cluster, as well as a field source known as Edd 1, which are all probable WR stars exhibiting a high quality X-ray spectrum. A two-temperature, non-equilibrium ionization plasma model is employed for the spectral fit, taking into account light element compositions characteristic of WR star winds, which is substantially depleted in hydrogen but enriched in nitrogen and/or carbon. It is found that the Arches and Quintuplet WR stars share similar abundances of Si, S, and Ar, while exhibiting distinct Ca and Fe abundances, which may be understood as due to dust depletion of the latter two elements in Quintuplet. The observed near-solar or sub-solar metallicity of the WR star winds can be naturally understood as the result of nucleosynthesis and internal mixing of the parent star, which have a supersolar initial metallicity as expected for the Galactic center in general. Implications of our findings on the origin of the young star clusters and isolated massive stars in the Galactic center, as well as the elemental composition of the accretion flow onto Sgr A*, are addressed.

astro-ph.GA↗
arXiv2025

A Survey of Retentive Network

Retentive Network (RetNet) represents a significant advancement in neural network architecture, offering an efficient alternative to the Transformer. While Transformers rely on self-attention to model dependencies, they suffer from high memory costs and limited scalability when handling long sequences due to their quadratic complexity. To mitigate these limitations, RetNet introduces a retention mechanism that unifies the inductive bias of recurrence with the global dependency modeling of attention. This mechanism enables linear-time inference, facilitates efficient modeling of extended contexts, and remains compatible with fully parallelizable training pipelines. RetNet has garnered significant research interest due to its consistently demonstrated cross-domain effectiveness, achieving robust performance across machine learning paradigms including natural language processing, speech recognition, and time-series analysis. However, a comprehensive review of RetNet is still missing from the current literature. This paper aims to fill that gap by offering the first detailed survey of the RetNet architecture, its key innovations, and its diverse applications. We also explore the main challenges associated with RetNet and propose future research directions to support its continued advancement in both academic research and practical deployment.

cs.CL↗
arXiv2025

Non-Asymptotic Length Generalization

Length generalization is the ability of a learning algorithm to learn a hypothesis which generalizes to longer inputs than the inputs in the training set. In this paper, we provide provable guarantees of length generalization for various classes of functions in an idealized setting. First, we formalize the framework of non-asymptotic length generalization, which requires a computable upper bound for the minimum input length that guarantees length generalization, as a function of the complexity of ground-truth function under some given complexity measure. We refer to this minimum input length to length generalize as length complexity. We show the Minimum-Complexity Interpolator learning algorithm achieves optimal length complexity. We further show that whether a function class admits non-asymptotic length generalization is equivalent to the decidability of its language equivalence problem, which implies that there is no computable upper bound for the length complexity of Context-Free Grammars. On the positive side, we show that the length complexity of Deterministic Finite Automata is $2n - 2$ where $n$ is the number of states of the ground-truth automaton. Our main results are upper bounds of length complexity for a subset of a transformer-related function class called C-RASP (Yang & Chiang, 2024). We show that the length complexity of 1-layer C-RASP functions is $O(T^2)$ when the ground-truth function has precision $T$, and that the length complexity of 2-layer C-RASP functions is $O(T^{O(K)})$ when the ground-truth function has precision $T$ and $K$ heads.

cs.LG↗
arXiv2025

SegRet: An Efficient Design for Semantic Segmentation with Retentive Network

With the rapid evolution of autonomous driving technology and intelligent transportation systems, semantic segmentation has become increasingly critical. Precise interpretation and analysis of real-world environments are indispensable for these advanced applications. However, traditional semantic segmentation approaches frequently face challenges in balancing model performance with computational efficiency, especially regarding the volume of model parameters. To address these constraints, we propose SegRet, a novel model employing the Retentive Network (RetNet) architecture coupled with a lightweight residual decoder that integrates zero-initialization. SegRet offers three distinctive advantages: (1) Lightweight Residual Decoder: by embedding a zero-initialization layer within the residual network structure, the decoder remains computationally streamlined without sacrificing essential information propagation; (2) Robust Feature Extraction: adopting RetNet as its backbone enables SegRet to effectively capture hierarchical image features, thereby enriching the representation quality of extracted features; (3) Parameter Efficiency: SegRet attains state-of-the-art (SOTA) segmentation performance while markedly decreasing the number of parameters, ensuring high accuracy without imposing additional computational burdens. Comprehensive empirical evaluations on prominent benchmarks, such as ADE20K, Citycapes, and COCO-Stuff, highlight the effectiveness and superiority of our method.

eess.IV↗
arXiv2025

THINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models

Large reasoning models (LRMs) have achieved impressive performance in complex tasks, often outperforming conventional large language models (LLMs). However, the prevalent issue of overthinking severely limits their computational efficiency. Overthinking occurs when models generate excessive and redundant tokens that contribute little to accurate outcomes, especially in simple tasks, resulting in a significant waste of computational resources. To systematically investigate this issue, we introduce Think-Bench, a benchmark designed to evaluate the reasoning efficiency of LRMs. We also propose novel efficiency metrics and conduct a comprehensive evaluation of various LRMs across multiple dimensions, including the reasoning process, outcome quality, and chain-of-thought (CoT) characteristics. Our analysis reveals that most LRMs exhibit overthinking in handling easy questions, generating unnecessarily lengthy reasoning chains. While many LRMs demonstrate high CoT quality, several suffer from low efficiency. We hope that Think-Bench can serve as a robust foundation for advancing research into LRMs.

cs.CL↗
arXiv2025

Multimodal Causal Reasoning Benchmark: Challenging Vision Large Language Models to Discern Causal Links Across Modalities

Multimodal Large Language Models (MLLMs) have showcased exceptional Chain-of-Thought (CoT) reasoning ability in complex textual inference tasks including causal reasoning. However, will these causalities remain straightforward when crucial hints hide in visual details? If not, what factors might influence cross-modal generalization? Whether we can effectively enhance their capacity for robust causal inference across both text and vision? Motivated by these, we introduce MuCR - a novel Multimodal Causal Reasoning benchmark that leverages synthetic siamese images and text pairs to challenge MLLMs. Additionally, we develop tailored metrics from multiple perspectives, including image-level match, phrase-level understanding, and sentence-level explanation, to comprehensively assess MLLMs' comprehension abilities. Our experiments reveal that current MLLMs fall short in multimodal causal reasoning compared to their performance in purely textual settings. Additionally, we find that identifying visual cues across images is key to effective cross-modal generalization. Finally, we propose a VcCoT strategy that better highlights visual cues, and our results confirm its efficacy in enhancing multimodal causal reasoning. The project is available at: https://github.com/Zhiyuan-Li-John/MuCR

cs.CV↗
arXiv2025

RDEIC: Accelerating Diffusion-Based Extreme Image Compression with Relay Residual Diffusion

Diffusion-based extreme image compression methods have achieved impressive performance at extremely low bitrates. However, constrained by the iterative denoising process that starts from pure noise, these methods are limited in both fidelity and efficiency. To address these two issues, we present Relay Residual Diffusion Extreme Image Compression (RDEIC), which leverages compressed feature initialization and residual diffusion. Specifically, we first use the compressed latent features of the image with added noise, instead of pure noise, as the starting point to eliminate the unnecessary initial stages of the denoising process. Second, we directly derive a novel residual diffusion equation from Stable Diffusion's original diffusion equation that reconstructs the raw image by iteratively removing the added noise and the residual between the compressed and target latent features. In this way, we effectively combine the efficiency of residual diffusion with the powerful generative capability of Stable Diffusion. Third, we propose a fixed-step fine-tuning strategy to eliminate the discrepancy between the training and inference phases, thereby further improving the reconstruction quality. Extensive experiments demonstrate that the proposed RDEIC achieves state-of-the-art visual quality and outperforms existing diffusion-based extreme image compression methods in both fidelity and efficiency. The source code and pre-trained models are available at https://github.com/huai-chang/RDEIC.

eess.IV↗
arXiv2025

Measurement of two-neutrino double electron capture half-life of $^{124}$Xe with PandaX-4T

Detailed studies of two-neutrino double electron capture (2$ν$DEC) is a crucial step towards searching for the neutrino-less mode to explore the Majorana nature of neutrinos. We have measured precisely the half-life of the 2$ν$DEC process in $^{124}$Xe, utilizing a total exposure of 1.73 tonne$\cdot$year from the commissioning run and the first science run of the PandaX-4T experiment. A time-dependent background model in the $\mathcal{O}$(10 keV) energy is constructed for the first time in PandaX-4T data. With an unbinned maximum likelihood fit, we determine the half-life of the 2$ν$DEC process to be $(1.03\pm0.15_{\rm stat}\pm0.08_{\rm sys})\times 10^{22}$$\,$yr. Furthermore, we have evaluated the branching ratio for both electrons captured from the $K$ shell ($KK$) to be $(65\pm5)\%$, which aligns with the $^{124}$Xe nuclear model calculations within 1.8$\,$$σ$.

nucl-ex↗
arXiv2025

Learning Progress Driven Multi-Agent Curriculum

The number of agents can be an effective curriculum variable for controlling the difficulty of multi-agent reinforcement learning (MARL) tasks. Existing work typically uses manually defined curricula such as linear schemes. We identify two potential flaws while applying existing reward-based automatic curriculum learning methods in MARL: (1) The expected episode return used to measure task difficulty has high variance; (2) Credit assignment difficulty can be exacerbated in tasks where increasing the number of agents yields higher returns which is common in many MARL tasks. To address these issues, we propose to control the curriculum by using a TD-error based *learning progress* measure and by letting the curriculum proceed from an initial context distribution to the final task specific one. Since our approach maintains a distribution over the number of agents and measures learning progress rather than absolute performance, which often increases with the number of agents, we alleviate problem (2). Moreover, the learning progress measure naturally alleviates problem (1) by aggregating returns. In three challenging sparse-reward MARL benchmarks, our approach outperforms state-of-the-art baselines.

cs.AI↗
arXiv2025

Search for Solar Boosted Dark Matter Particles at the PandaX-4T Experiment

We present a novel constraint on light dark matter utilizing $1.54$ tonne$\cdot$year of data acquired from the PandaX-4T dual-phase xenon time projection chamber. This constraint is derived through detecting electronic recoil signals resulting from the interaction with solar-enhanced dark matter flux. Low-mass dark matter particles, lighter than a few MeV/$c^2$, can scatter with the thermal electrons in the Sun. Consequently, with higher kinetic energy, the boosted dark matter component becomes detectable via contact scattering with xenon electrons, resulting in a few keV energy deposition that exceeds the threshold of PandaX-4T. We calculate the expected recoil energy in PandaX-4T considering the Sun's acceleration and the detection capabilities of the xenon detector. The first experimental search results using the xenon detector yield the most stringent cross-section of $3.51 \times 10^{-39}~\mathrm{cm}^2$ at $0.08~\mathrm{MeV}$/$c^2$ for a solar boosted dark matter mass ranging from $0.02$ to $10~ \mathrm{MeV}$/$c^2$, achieving a 23 fold improvement compared with earlier experimental studies.

hep-ex↗
arXiv2025

Probing triple Higgs production via $4τ2b$ decay channel at a 100 TeV hadron collider

A comprehensive study of triple Higgs boson production in the $4τ2b$ decay final state is performed for the first time at a future 100 TeV hadron collider. The analysis incorporates modified Higgs self-couplings via trilinear Higgs self-coupling $c_3$ and quartic Higgs self-coupling $d_4$, enabling for a model-independent investigation of potential new physics effects. Higgs bosons are reconstructed using both resolved and boosted techniques. To optimize sensitivity across different kinematic regions, we introduce a novel event categorization strategy based on the triple Higgs invariant mass spectrum and the multiplicity of boosted Higgs bosons. In addition to a traditional cut-based analysis, a Boosted Decision Tree (BDT) approach is employed to exploit multivariate correlations among kinematic observables, leading to a significant improvement in sensitivity. Our result demonstrates that the $4τ2b$ channel provides a viable pathway for probing the Higgs quartic coupling, complementing the existing multi-Higgs production studies, and could reach 5 $σ$ in significance for $c_3 \lesssim -1$ and $d_4 \gtrsim 10$ in the scanned range.

hep-ph↗
arXiv2025

A Coefficient Makes SVRG Effective

Stochastic Variance Reduced Gradient (SVRG), introduced by Johnson & Zhang (2013), is a theoretically compelling optimization method. However, as Defazio & Bottou (2019) highlight, its effectiveness in deep learning is yet to be proven. In this work, we demonstrate the potential of SVRG in optimizing real-world neural networks. Our empirical analysis finds that, for deeper neural networks, the strength of the variance reduction term in SVRG should be smaller and decrease as training progresses. Inspired by this, we introduce a multiplicative coefficient $α$ to control the strength and adjust it through a linear decay schedule. We name our method $α$-SVRG. Our results show $α$-SVRG better optimizes models, consistently reducing training loss compared to the baseline and standard SVRG across various model architectures and multiple image classification datasets. We hope our findings encourage further exploration into variance reduction techniques in deep learning. Code is available at github.com/davidyyd/alpha-SVRG.

cs.LG↗
arXiv2025

Ring or no ring -- Revisiting the Multiphase Nuclear Environment in M31

Nuclear rings, prevalent in barred galaxies, are essential to understanding gas transport toward galactic nuclei. However, the peculiar nuclear ring in our neighboring galaxy M31 remains poorly understood. Here we present a comprehensive study of this multiphase gas structure, originally revealed by its dust emission, based on newly acquired CO mappings and archival spectroscopic imaging of atomic hydrogen and warm ionized gas, along with custom numerical simulations. These multi-wavelength data offer an unprecedented view of the surface mass density and kinematics of the nuclear ring, challenging the notion of it being a single coherent structure. In particular, the ring shows significant asymmetry in its azimuthal mass distribution, with neutral gas concentrated in the northeast and ionized gas prominent in the southwest. The observed off-centered and lopsided morphology disfavors an interpretation of gas streamers or resonance rings driven solely by a barred potential known to exist in M31. Furthermore, the ring's line-of-sight velocity distribution suggests circular motion in a plane inclined by $\sim 30^\circ$ relative to M31's outer disk, implying external torque likely from M32's recent close-in passage. Our hydrodynamical simulations tracking the evolution of nuclear gas of M31 influenced by both a barred potential and an oblique collision with M32, reveal the natural formation of asymmetric spiral arms several hundred Myr after the collision, which could appear ring-like under appropriate viewing angles. Therefore, we suggest that M31's nuclear gas structure, instead of being a persisting rotating ring, comprises recently formed, asymmetric spirals with a substantial tilt.

astro-ph.GA↗
arXiv2025

The HASHTAG project II. Giant molecular cloud properties across the M31 disc

We present a study of giant molecular cloud (GMC) properties in the Andromeda galaxy (M31) using CO(3-2) data from the James Clerk Maxwell Telescope (JCMT) in selected regions across the disc and in the nuclear ring, and comparing them with CO(1-0) observations from the IRAM 30m telescope in the same regions. We find that GMCs in the centre of M31 generally exhibit larger velocity dispersions ($σ$) and sizes ($R$) compared to those in the disc, while their average surface density ($Σ$) and turbulent pressure ($P_{\rm turb}$) are lower. This low turbulent pressure in the central region is primarily due to the low density of molecular gas. The estimated GMC properties depend on the choice of CO transitions. Compared to CO(1-0), CO(3-2) exhibits smaller velocity dispersion and equivalent radius but higher surface density. These differences highlight the distinct physical conditions probed by different molecular gas tracers. We estimate the virial parameter $α_{\rm vir}\propto σ^2 R/Σ$ and find that most molecular clouds exhibit high values ($α_{\rm vir} \sim 4-6$) for both CO transitions, indicating that they are unbound. Furthermore, clouds in the nuclear ring display even larger $α_{\rm vir}$ values of $\lesssim 100$, suggesting that they may be highly dynamic, short-lived structures, although they could potentially achieve equilibrium under the external pressure exerted by the surrounding interstellar medium.

astro-ph.GA↗
arXiv2025

Probing the Hot Gaseous Halo of the Low-mass Disk Galaxy NGC 7793 with eROSITA and Chandra

Galaxy formation models predict that local galaxies are surrounded by hot X-ray-emitting halos, which are technically difficult to detect due to their extended and low surface brightness nature. Previous X-ray studies have mostly focused on disk galaxies more massive than the Milky Way, with essentially no consensus on the halo X-ray properties at the lower mass end. We utilize the early-released eROSITA and archival Chandra observations to analyze the diffuse X-ray emission of NGC7793, a nearby spiral galaxy with an estimated stellar mass of only $3.2\times 10^9$ $M_{\odot}$. We find evidence for extraplanar hot gas emission from both the radial and vertical soft X-ray intensity profiles, which spreads up to a galactocentric distance of $\sim$ 6 kpc, nearly 30 $\%$ more extended than its stellar disk. Analysis of the eROSITA spectra indicates that the hot gas can be characterized by a temperature of $0.18^{+0.02}_{-0.03}$ keV, with 0.5--2 keV unabsorbed luminosity of $1.3\times 10^{38}$ erg $s^{-1}$. We compare our results with the IllustrisTNG simulations and find overall consistence on the disk scale, whereas excessive emission at large radii is predicted by TNG50. This work provides the latest detection of hot corona around a low-mass galaxy, putting new constrains on state-of-the-art cosmological simulations. We also verify the detectability of hot circumgalactic medium around even low-mass spirals with future high-resolution X-ray spectrometer such as the Hot Universe Baryon Surveyor.

astro-ph.GA↗
arXiv2025

Polyhedra Encoding Transformers: Enhancing Diffusion MRI Analysis Beyond Voxel and Volumetric Embedding

Diffusion-weighted Magnetic Resonance Imaging (dMRI) is an essential tool in neuroimaging. It is arguably the sole noninvasive technique for examining the microstructural properties and structural connectivity of the brain. Recent years have seen the emergence of machine learning and data-driven approaches that enhance the speed, accuracy, and consistency of dMRI data analysis. However, traditional deep learning models often fell short, as they typically utilize pixel-level or volumetric patch-level embeddings similar to those used in structural MRI, and do not account for the unique distribution of various gradient encodings. In this paper, we propose a novel method called Polyhedra Encoding Transformer (PE-Transformer) for dMRI, designed specifically to handle spherical signals. Our approach involves projecting an icosahedral polygon onto a unit sphere to resample signals from predetermined directions. These resampled signals are then transformed into embeddings, which are processed by a transformer encoder that incorporates orientational information reflective of the icosahedral structure. Through experimental validation with various gradient encoding protocols, our method demonstrates superior accuracy in estimating multi-compartment models and Fiber Orientation Distributions (FOD), outperforming both conventional CNN architectures and standard transformers.

eess.IV↗
arXiv2025

Search for Double Beta Decay of $^{136}$Xe to the $0^+_1$ Excited State of $^{136}$Ba with PandaX-4T

We perform a search of double beta decay of $^{136}$Xe to the excited state, $0^+_1$, of $^{136}$Ba (2$νββ$-0$_1^+$), using the dual-phase xenon detector of PandaX-4T with the first 94.9-day commissioning data. The multi-site events are reconstructed up to the MeV energy scale, which helps to improve the background model significantly. The background contribution from the stainless steel platform outside PandaX-4T cryostat is evaluated for the first time. No significant evidence for 2$νββ$-$0_1^+$ is observed, resulting in a lower limit on half-life of $7.5 \times 10^{22}$ yr at the 90% confidence level. This is the first experimental limit on such a rare decay in a natural xenon-based detector.

nucl-ex↗