arXiv subjects

Xin Zhou

Publications and source records attributed to Xin Zhou.

At least 181 records · Page 10Linked to original sources

arXiv2025

Examining Turbulence in Galactic Molecular Clouds -- I: A Statistical Analysis of Velocity Structures

We present a systematic analysis of the velocity structure functions (VSFs) of 167 molecular clouds with angular sizes greater than $\sim$176 arcmin$^2$ in three sectors of the Galactic mid-plane. We calculated the 1st- to 3rd-order VSFs and found that 60\% of the VSFs exhibit power-law distributions. The relative power-law exponents are consistent with predictions from intermittent turbulence models. Column density weighting reduces the proportion of power-law VSFs and steepens the VSF slopes, implying a reduction of turbulent energy in high-density regions. All clouds show small-scale intermittency, with slightly stronger intermittency in those molecular clouds showing none power-law VSFs. Negative VSF exponents that may indicate gravitational collapse are not observed in our sample. The scaling exponents of the observed VSFs do not correlate with the virial parameters of the molecular clouds. These two observations suggest that gravity-dominated scales in molecular clouds still need further investigation. Consistent VSF scaling exponents for the molecular clouds with significant power-law VSFs suggest large-scale external driving of turbulence in these molecular clouds. However, the driving mechanisms are likely not universal, as the power-law scaling coefficients in our results show relatively large scatter. The fact that nearly 40\% of the VSFs deviate to some extent from power-law distributions suggests that the influence of local environments on the internal turbulence of molecular clouds may not be negligible.

astro-ph.GA↗

arXiv2025

A general design method for ultra-long optical path length multipass matrix cells

For the first time, we propose a general design method for ultra-long optical path length (OPL) multipass matrix cells (MMCs) based on multi-cycle mode of two-sided field mirrors. The design idea of the dual circulation mode with two-sided field mirrors is elaborated in detail with the example of MMC based on dual Pickett Bradley White cell (PBWC), and the simple design methods of the other three MMCs based on the dual circulation mode of PBWC and Bernstein Herzberg White cell (BHWC) are given. Further, we propose a general design method for ultra-long OPL MMCs with multi-cycle mode by adding cyclic elements. The OPL of the MMCs designed by this method can reach the order of kilometers or even tens of kilometers. The novel MMCs have the advantages of simple structure, strong spot formation regularity, easy expansion, high mirror utilization ratio, high reuse times of spot spatial position, good stability and extremely high ratio of the optical path length to the volume (RLV). In order to evaluate the performance of the new MMCs, an open-path methane gas sensor with the MMC based on triple PBWC was constructed, which was used to continuously measure the methane in the laboratory, and the feasibility, effectiveness and practicability of the new design method were verified. The design method proposed in this paper provides a new idea for the design of multipass cell (MPC), and the new MMCs designed have great potential application value in the field of high-precision trace gas monitoring.

physics.optics↗

arXiv2025

Enhanced Masked Image Modeling to Avoid Model Collapse on Multi-modal MRI Datasets

Multi-modal magnetic resonance imaging (MRI) provides information of lesions for computer-aided diagnosis from different views. Deep learning algorithms are suitable for identifying specific anatomical structures, segmenting lesions, and classifying diseases. Manual labels are limited due to the high expense, which hinders further improvement of accuracy. Self-supervised learning, particularly masked image modeling (MIM), has shown promise in utilizing unlabeled data. However, we spot model collapse when applying MIM to multi-modal MRI datasets. The performance of downstream tasks does not see any improvement following the collapsed model. To solve model collapse, we analyze and address it in two types: complete collapse and dimensional collapse. We find complete collapse occurs because the collapsed loss value in multi-modal MRI datasets falls below the normally converged loss value. Based on this, the hybrid mask pattern (HMP) masking strategy is introduced to elevate the collapsed loss above the normally converged loss value and avoid complete collapse. Additionally, we reveal that dimensional collapse stems from insufficient feature uniformity in MIM. We mitigate dimensional collapse by introducing the pyramid barlow twins (PBT) module as an explicit regularization method. Overall, we construct the enhanced MIM (E-MIM) with HMP and PBT module to avoid model collapse multi-modal MRI. Experiments are conducted on three multi-modal MRI datasets to validate the effectiveness of our approach in preventing both types of model collapse. By preventing model collapse, the training of the model becomes more stable, resulting in a decent improvement in performance for segmentation and classification tasks. The code is available at https://github.com/LinxuanHan/E-MIM.

eess.IV↗

arXiv2025

Modeling the Saddle-like GeV-TeV Spectrum of HESS J1809-193: $γ$-Rays Arising from Reverse-Shocked Pulsar Wind Nebula?

Evolution of pulsar wind nebulae (PWNe) could be expected to leave imprints in $γ$-rays. We suggest that intriguing GeV-TeV spectral energy distribution (SED) of HESS J1809$-$193 and Fermi-LAT source J1810.3$-$1925e is very likely to be the $γ$-ray signature of PWN J1809$-$193 in light of the scenario that the PWN was struck by the reverse shock of the parent supernova remnant. Based on evolutionary theory of PWNe, we consider that, when the PWN was disrupted during collision by the reverse shock, some very high-energy electrons escaped impulsively. The remaining electrons stayed in the relic PWN, which was displaced from the pulsar. The very high-energy part of the remaining electrons were depleted by the strong magnetic field that was enhanced by the reverse shock compression in the reverberation stage, leaving the other part of them generating GeV emission. The particles injected from the pulsar after the disruption enter the relic PWN through the newly formed tunnel called the cocoon. The $γ$-ray emission from the escaped electrons can account for the TeV spectrum of component A of HESS J1809$-$193 or the TeV halo, while the electrons remaining after disruption can account for the GeV spectrum of J1810.3$-$1925e. Thus, combination of contributions from these two populations of electrons naturally reproduces the saddle-like SED of HESS J1809$-$193 and J1810.3$-$1925e from 5 GeV to 30 TeV, together with the spectral hardening around 100 GeV. We also show that the post-disruption injection of electrons can explain the spectrum of the relatively faint $γ$-ray emission of component B of HESS J1809$-$193.

astro-ph.HE↗

arXiv2025

Unveiling the Potential of Text in High-Dimensional Time Series Forecasting

Time series forecasting has traditionally focused on univariate and multivariate numerical data, often overlooking the benefits of incorporating multimodal information, particularly textual data. In this paper, we propose a novel framework that integrates time series models with Large Language Models to improve high-dimensional time series forecasting. Inspired by multimodal models, our method combines time series and textual data in the dual-tower structure. This fusion of information creates a comprehensive representation, which is then processed through a linear layer to generate the final forecast. Extensive experiments demonstrate that incorporating text enhances high-dimensional time series forecasting performance. This work paves the way for further research in multimodal time series forecasting.

cs.AI↗

arXiv2025

Critical Current Density and AC Magnetic Susceptibility of High-quality FeTe$_{0.5}$Se$_{0.5}$ Superconducting Tapes

Iron telluride-selenium superconducting materials, known for their non-toxicity, ease of preparation, simple structure, and high upper critical fields, have attracted much research interest in practical application. In this work, we conducted electrical transport measurements, magneto-optical imaging, and AC magnetic susceptibility measurements on FeTe$_{0.5}$Se$_{0.5}$ superconducting long tapes fabricated via reel-to-reel pulsed laser deposition. Our transport measurements revealed a high critical current density that remains relatively stable even with increasing external magnetic fields, reaching over $1\times 10^5$ A/cm$^2$ at 8 K and 9 T. The calculated pinning force density indicates that normal point pinning is the primary mechanism in these tapes. The magneto-optical images demonstrated that the tapes show homogeneous superconductivity and uniform distribution of critical current density. The AC magnetic susceptibility measurements also confirmed their strong flux pinning nature of withstanding high magnetic field. Based on these characteristics, FeTe$_{0.5}$Se$_{0.5}$ superconducting tapes show promising prospects for applications under high magnetic fields.

cond-mat.supr-con↗

arXiv2024

Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models

Large language models (LLMs) demonstrate impressive capabilities to generate accurate code snippets given natural language intents in a zero-shot manner, i.e., without the need for specific fine-tuning. While prior studies have highlighted the advantages of fine-tuning LLMs, this process incurs high computational costs, making it impractical in resource-scarce environments, particularly for models with billions of parameters. To address these challenges, previous research explored in-context learning (ICL) and retrieval-augmented generation (RAG) as strategies to guide the LLM generative process with task-specific prompt examples. However, ICL and RAG introduce inconveniences, such as the need for designing contextually relevant prompts and the absence of learning task-specific parameters, thereby limiting downstream task performance. In this context, we foresee parameter-efficient fine-tuning (PEFT) as a promising approach to efficiently specialize LLMs to task-specific data while maintaining reasonable resource consumption. In this paper, we deliver a comprehensive study of PEFT techniques for LLMs in the context of automated code generation. Our comprehensive investigation of PEFT techniques for LLMs reveals their superiority and potential over ICL and RAG across a diverse set of LLMs and three representative Python code generation datasets: Conala, CodeAlpacaPy, and APPS. Furthermore, our study highlights the potential for tuning larger LLMs and significant reductions in memory usage by combining PEFT with quantization. Therefore, this study opens opportunities for broader applications of PEFT in software engineering scenarios. Our code is available at https://github.com/martin-wey/peft-llm-code/.

cs.SE↗

arXiv2024

CodeUltraFeedback: An LLM-as-a-Judge Dataset for Aligning Large Language Models to Coding Preferences

Evaluating the alignment of large language models (LLMs) with user-defined coding preferences is a challenging endeavour that requires a deep assessment of LLMs' outputs. Existing methods and benchmarks rely primarily on automated metrics and static analysis tools, which often fail to capture the nuances of user instructions and LLM outputs. To address this gap, we propose using the LLM-as-a-Judge methodology to evaluate the alignment of LLMs with coding preferences. Based on this approach, we present CodeUltraFeedback, a comprehensive dataset designed to facilitate the evaluation and improvement of LLM alignment. CodeUltraFeedback consists of 10,000 coding instructions, each annotated with four responses generated from a diverse pool of 14 LLMs. These responses are ranked based on five distinct coding preferences using GPT-3.5 as a judge, providing both numerical scores and detailed textual feedback. Our analysis of CodeUltraFeedback reveals that responses from GPT-3.5 and GPT-4 are generally preferred over those from open-weight LLMs, highlighting significant differences in alignment between closed and open-weight models. In turn, we explore the usage of CodeUltraFeedback as feedback data to fine-tune and align CodeLlama-7B-Instruct using supervised fine-tuning (SFT) and reinforcement learning from AI feedback (RLAIF) with direct preference optimization (DPO). The resulting aligned CodeLlama-7B-Instruct model outperforms larger LLMs in terms of alignment with coding preferences and shows improved functional correctness on the HumanEval+ benchmark compared to the original instruct model. Therefore, our contributions bridge the gap in preference tuning of LLMs for code and set the stage for further advancements in model alignment and RLAIF in automated software engineering.

cs.SE↗

arXiv2024

Large-scale cluster quantum microcombs

An optical frequency comb comprises a cluster of equally spaced, phase-locked spectral lines. Replacing these classical components with correlated quantum light gives rise to cluster quantum frequency combs, providing abundant quantum resources for measurement-based quantum computation and multi-user quantum networks. We propose and generate cluster quantum microcombs within an on-chip optical microresonator driven by multi-frequency lasers. Through resonantly enhanced four-wave mixing processes, continuous-variable cluster states with 60 qumodes are deterministically created. The graph structures can be programmed into one- and two-dimensional lattices by adjusting the configurations of the pump lines, which are confirmed inseparable based on the measured covariance matrices. Our work demonstrates the largest-scale cluster states with unprecedented raw squeezing levels from a photonic chip, offering a compact and scalable platform for computational and communicational tasks with quantum advantages.

physics.optics↗

arXiv2024

Bulk and surface Dirac states accompanied by two superconducting domes in FeSe-based superconductors

Recent investigations of FeSe-based superconductors have revealed the presence of two superconducting domes, and suggest possible distinct pairing mechanisms. Two superconducting domes are commonly found in unconventional superconductors and exhibit unique normal states and electronic structures. In this study, we conducted electromagnetic transport measurements to establish a complete phase diagram, successfully observing the two superconducting domes in FeSe$_{1-x}$S$_x$ (0 $\le x \le$ 0.25) and FeSe$_{1-x}$Te$_x$ (0 $\le x \le$ 1) superconductors. The normal state resistivity on SC1 shows the strange metal state, with a power exponent approximately equal to 1 ($ρ(T)\propto T^n$ with $n\sim 1$), whereas the exponent on SC2 is less than 1. A bulk Dirac state observed on SC1, completely synchronized with the strange metal behavior, indicating a close relationship between them. While a topological surface Dirac state is witnessed on SC2, and undergoes a sign change near the pure nematic quantum critical point. The evolution of the Dirac states indicates that the appearance of the two superconducting domes may originate from the Fermi surface reconstruction. Our findings highlight distinct Dirac states and normal state resistivity across the two superconducting domes, providing convincing evidence for the existence of the two different pairing mechanisms in FeSe-based superconductors.

cond-mat.supr-con↗

arXiv2024

A Unified Framework for 3D Scene Understanding

We propose UniSeg3D, a unified 3D scene understanding framework that achieves panoptic, semantic, instance, interactive, referring, and open-vocabulary segmentation tasks within a single model. Most previous 3D segmentation approaches are typically tailored to a specific task, limiting their understanding of 3D scenes to a task-specific perspective. In contrast, the proposed method unifies six tasks into unified representations processed by the same Transformer. It facilitates inter-task knowledge sharing, thereby promoting comprehensive 3D scene understanding. To take advantage of multi-task unification, we enhance performance by establishing explicit inter-task associations. Specifically, we design knowledge distillation and contrastive learning methods to transfer task-specific knowledge across different tasks. Experiments on three benchmarks, including ScanNet20, ScanRefer, and ScanNet200, demonstrate that the UniSeg3D consistently outperforms current SOTA methods, even those specialized for individual tasks. We hope UniSeg3D can serve as a solid unified baseline and inspire future work. Code and models are available at https://github.com/dk-liang/UniSeg3D.

cs.CV↗

arXiv2024

PointMamba: A Simple State Space Model for Point Cloud Analysis

Transformers have become one of the foundational architectures in point cloud analysis tasks due to their excellent global modeling ability. However, the attention mechanism has quadratic complexity, making the design of a linear complexity method with global modeling appealing. In this paper, we propose PointMamba, transferring the success of Mamba, a recent representative state space model (SSM), from NLP to point cloud analysis tasks. Unlike traditional Transformers, PointMamba employs a linear complexity algorithm, presenting global modeling capacity while significantly reducing computational costs. Specifically, our method leverages space-filling curves for effective point tokenization and adopts an extremely simple, non-hierarchical Mamba encoder as the backbone. Comprehensive evaluations demonstrate that PointMamba achieves superior performance across multiple datasets while significantly reducing GPU memory usage and FLOPs. This work underscores the potential of SSMs in 3D vision-related tasks and presents a simple yet effective Mamba-based baseline for future research. The code will be made available at \url{https://github.com/LMD0311/PointMamba}.

cs.CV↗

arXiv2024

A new view of the Spiral Structure of the Northern Outer Milky Way in Carbon Monoxide

Based on 32162 molecular clouds from the Milky Way Imaging Scroll Painting project, we obtain new face-on molecular gas maps of the northern outer Galaxy. The total molecular gas surface density map reveals three segments of spirals, extending 16-43 kiloparsecs in length. The Perseus and Outer arms stand out prominently, appearing as quasi-continuous structures along most of their length. At the Galactic outskirts, about 1306 clouds connect the two segments of the new spiral arm discovered by Dame & Thaddeus (2011) in the first quadrant and Sun et al. (2015) in the second quadrant, possibly extending the arm into the outer third quadrant. Logarithmic spirals can be fitted to the CO arm segments with pitch angles ranging from 4 to 12 degree. These CO arms extend beyond previous CO studies and the optical radius, reaching a galactic radius of about 22 kiloparsecs, comparable to the HI radial range.

astro-ph.GA↗

arXiv2024

Advancing Sustainability via Recommender Systems: A Survey

Human behavioral patterns and consumption paradigms have emerged as pivotal determinants in environmental degradation and climate change, with quotidian decisions pertaining to transportation, energy utilization, and resource consumption collectively precipitating substantial ecological impacts. Recommender systems, which generate personalized suggestions based on user preferences and historical interaction data, exert considerable influence on individual behavioral trajectories. However, conventional recommender systems predominantly optimize for user engagement and economic metrics, inadvertently neglecting the environmental and societal ramifications of their recommendations, potentially catalyzing over-consumption and reinforcing unsustainable behavioral patterns. Given their instrumental role in shaping user decisions, there exists an imperative need for sustainable recommender systems that incorporate sustainability principles to foster eco-conscious and socially responsible choices. This comprehensive survey addresses this critical research gap by presenting a systematic analysis of sustainable recommender systems. As these systems can simultaneously advance multiple sustainability objectives--including resource conservation, sustainable consumer behavior, and social impact enhancement--examining their implementations across distinct application domains provides a more rigorous analytical framework. Through a methodological analysis of domain-specific implementations encompassing transportation, food, buildings, and auxiliary sectors, we can better elucidate how these systems holistically advance sustainability objectives while addressing sector-specific constraints and opportunities. Moreover, we delineate future research directions for evolving recommender systems beyond sustainability advocacy toward fostering environmental resilience and social consciousness in society.

cs.IR↗

arXiv2024

RetriBooru: Leakage-Free Retrieval of Conditions from Reference Images for Subject-Driven Generation

Diffusion-based methods have demonstrated remarkable capabilities in generating a diverse array of high-quality images, sparking interests for styled avatars, virtual try-on, and more. Previous methods use the same reference image as the target. An overlooked aspect is the leakage of the target's spatial information, style, etc. from the reference, harming the generated diversity and causing shortcuts. However, this approach continues as widely available datasets usually consist of single images not grouped by identities, and it is expensive to recollect large-scale same-identity data. Moreover, existing metrics adopt decoupled evaluation on text alignment and identity preservation, which fail at distinguishing between balanced outputs and those that over-fit to one aspect. In this paper, we propose a multi-level, same-identity dataset RetriBooru, which groups anime characters by both face and cloth identities. RetriBooru enables adopting reference images of the same character and outfits as the target, while keeping flexible gestures and actions. We benchmark previous methods on our dataset, and demonstrate the effectiveness of training with a reference image different from target (but same identity). We introduce a new concept composition task, where the conditioning encoder learns to retrieve different concepts from several reference images, and modify a baseline network RetriNet for the new task. Finally, we introduce a novel class of metrics named Similarity Weighted Diversity (SWD), to measure the overlooked diversity and better evaluate the alignment between similarity and diversity.

cs.CV↗

arXiv2024

Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs

Retrieval-Augmented Generation (RAG) significantly improved the ability of Large Language Models (LLMs) to solve knowledge-intensive tasks. While existing research seeks to enhance RAG performance by retrieving higher-quality documents or designing RAG-specific LLMs, the internal mechanisms within LLMs that contribute to the effectiveness of RAG systems remain underexplored. In this paper, we aim to investigate these internal mechanisms within the popular Mixture-of-Expert (MoE)-based LLMs and demonstrate how to improve RAG by examining expert activations in these LLMs. Our controlled experiments reveal that several core groups of experts are primarily responsible for RAG-related behaviors. The activation of these core experts can signify the model's inclination towards external/internal knowledge and adjust its behavior. For instance, we identify core experts that can (1) indicate the sufficiency of the model's internal knowledge, (2) assess the quality of retrieved documents, and (3) enhance the model's ability to utilize context. Based on these findings, we propose several strategies to enhance RAG's efficiency and effectiveness through expert activation. Experimental results across various datasets and MoE-based LLMs show the effectiveness of our method.

cs.AI↗

arXiv2024

Large Language Model for Vulnerability Detection and Repair: Literature Review and the Road Ahead

The significant advancements in Large Language Models (LLMs) have resulted in their widespread adoption across various tasks within Software Engineering (SE), including vulnerability detection and repair. Numerous studies have investigated the application of LLMs to enhance vulnerability detection and repair tasks. Despite the increasing research interest, there is currently no existing survey that focuses on the utilization of LLMs for vulnerability detection and repair. In this paper, we aim to bridge this gap by offering a systematic literature review of approaches aimed at improving vulnerability detection and repair through the utilization of LLMs. The review encompasses research work from leading SE, AI, and Security conferences and journals, encompassing 43 papers published across 25 distinct venues, along with 15 high-quality preprint papers, bringing the total to 58 papers. By answering three key research questions, we aim to (1) summarize the LLMs employed in the relevant literature, (2) categorize various LLM adaptation techniques in vulnerability detection, and (3) classify various LLM adaptation techniques in vulnerability repair. Based on our findings, we have identified a series of limitations of existing studies. Additionally, we have outlined a roadmap highlighting potential opportunities that we believe are pertinent and crucial for future research endeavors.

cs.SE↗

arXiv2024

Scalable Frame-based Construction of Sociocultural NormBases for Socially-Aware Dialogues

Sociocultural norms serve as guiding principles for personal conduct in social interactions, emphasizing respect, cooperation, and appropriate behavior, which is able to benefit tasks including conversational information retrieval, contextual information retrieval and retrieval-enhanced machine learning. We propose a scalable approach for constructing a Sociocultural Norm (SCN) Base using Large Language Models (LLMs) for socially aware dialogues. We construct a comprehensive and publicly accessible Chinese Sociocultural NormBase. Our approach utilizes socially aware dialogues, enriched with contextual frames, as the primary data source to constrain the generating process and reduce the hallucinations. This enables extracting of high-quality and nuanced natural-language norm statements, leveraging the pragmatic implications of utterances with respect to the situation. As real dialogue annotated with gold frames are not readily available, we propose using synthetic data. Our empirical results show: (i) the quality of the SCNs derived from synthetic data is comparable to that from real dialogues annotated with gold frames, and (ii) the quality of the SCNs extracted from real data, annotated with either silver (predicted) or gold frames, surpasses that without the frame annotations. We further show the effectiveness of the extracted SCNs in a RAG-based (Retrieval-Augmented Generation) model to reason about multiple downstream dialogue tasks.

cs.CL↗