Searcharxiv⌕ Search

arXiv subjects

Xiaodong Liu

Publications and source records attributed to Xiaodong Liu.

At least 73 records · Page 4Linked to original sources

Physical properties of newly active asteroid 2010 LH15

Main-belt asteroid 2010 LH$_{15}$ has been classified as an active asteroid, based on the recent discovery of dust activity from the archival images observed in 2010 and 2019. In this study, we perform measurements and dynamical modeling of the dust tail of the active asteroid 2010 LH$_{15}$ using ZTF archival data from July 26 to August 31, 2019, with the derived physical properties from these relatively independent methods being compatible. The photometric results show that the radius of the nucleus is $1.11\pm0.02$ km with assumed geometric albedo of $p_r = 0.05$, and the color index of the nucleus is relatively close to that of the ejecta around the nucleus, with a value of $H_g - H_r = 0.44\pm0.07$. The effective scattering cross-section increases at an average rate of $0.28\pm0.02$ km$^2$ day$^{-1}$ throughout the observation period, indicating that the activity of LH$_{15}$ is likely driven by mechanisms capable of causing a sustained process like sublimation. Further dust dynamics modeling indicates that the dust activity initiates as early as about 26 June 2019, with the ejected dust particles having a radius ranging from 0.03 mm to 3 mm. The dependence of the terminal velocity on dust size is consistent with a sublimation-driven mechanism. If the orbit of LH$_{15}$ is stable, its sublimation origin will extend the inner boundary of the water-ice-bearing region in the main asteroid belt inward by approximately 0.1 AU.

astro-ph.EP↗

Great comet C/2023 A3 (Tsuchinshan-ATLAS): dust loss before perihelion

In this study, the dust loss of comet C/2023 A3 (Tsuchinshan-ATLAS) is investigated through the analysis of archival images. By measuring the surface brightness profile of the coma, we determined that the comet maintained nearly in a steady state during the observations. Analysis of the dust distribution perpendicular to the orbital plane reveals that the ejection velocity is $v_{\perp}\sim(65\pm5)\,β^{1/2}$ m s$^{-1}$, where $β$ is inversely proportional to the size of the dust grains. From the dust scattering cross-section measurement, we estimated the upper limit of the nucleus radius to be $\sim\!5.9\pm0.2$ km, assuming a geometric albedo of 0.04. Based on the extrapolation of the scattering cross-section over time, the onset time of significant dust activity is estimated to be 25 July 2022, corresponding to a heliocentric distance of 9.1 au, with the activity mechanism at this distance likely being the phase transition from amorphous to crystalline ice. Our simulation reveals that the minimum dust size is \SI{20}{\micro\meter} and the size distribution index is $s = 3.4$ in tail. The dust loss rate is determined to be $(1.7 \pm 0.8) \times 10^2$ kg s$^{-1}$, based on the derived average size of the particles and the rate of change of the scattering cross-section over time. Through a simplistic model, we evaluate that the nucleus of the comet remains stable against tidal effects, sublimation, and rotational instability, and disfavour the fate of disintegration. The result is consistent with observations that the nucleus has survived.

astro-ph.EP↗

Generalized Rellich's lemmas, uniqueness theorem and inside-out duality for scattering poles

Scattering poles correspond to non-trivial scattered fields in the absence of incident waves and play a crucial role in the study of wave phenomena. These poles are complex wavenumbers with negative imaginary parts. In this paper, we prove two generalized Rellich's lemmas for scattered fields associated with complex wavenumbers. These lemmas are then used to establish uniqueness results for inverse scattering problems. We further explore the inside-out duality, which characterizes scattering poles through the linear sampling method applied to interior scattering problems. Notably, we demonstrate that exterior Dirichlet/Neumann poles can be identified without prior knowledge of the actual sound-soft or sound-hard obstacles. Numerical examples are provided to validate the theoretical results.

math.NA↗

A deep-learning model for predicting daily PM2.5 concentration in response to emission reduction

Air pollution remains a leading global health threat, with fine particulate matter (PM2.5) contributing to millions of premature deaths annually. Chemical transport models (CTMs) are essential tools for evaluating how emission controls improve air quality and save lives, but they are computationally intensive. Reduced form models accelerate simulations but sacrifice spatial-temporal granularity, accuracy, and flexibility. Here we present CleanAir, a deep-learning-based model developed as an efficient alternative to CTMs in simulating daily PM2.5 and its chemical compositions in response to precursor emission reductions at 36 km resolution, which could predict PM2.5 concentration for a full year within 10 seconds on a single GPU, a speed five orders of magnitude faster. Built on a Residual Symmetric 3D U-Net architecture and trained on more than 2,400 emission reduction scenarios generated by a well-validated Community Multiscale Air Quality (CMAQ) model, CleanAir generalizes well across unseen meteorological years and emission patterns. It produces results comparable to CMAQ in both absolute concentrations and emission-induced changes, enabling efficient, full-coverage simulations across short-term interventions and long-term planning horizons. This advance empowers researchers and policymakers to rapidly evaluate a wide range of air quality strategies and assess the associated health impacts, thereby supporting more responsive and informed environmental decision-making.

physics.ao-ph↗

Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts

By increasing model parameters but activating them sparsely when performing a task, the use of Mixture-of-Experts (MoE) architecture significantly improves the performance of Large Language Models (LLMs) without increasing the inference cost. However, the memory consumption due to the growing number of experts presents a challenge to the deployment of these models in many real world settings. Our empirical study reveals that some experts encode redundant knowledge during pre-training. We thus propose a method of grouping and pruning similar experts to improve the model's parameter efficiency. We validate the effectiveness of our method by pruning three state-of-the-art MoE architectures, including Mixtral, Deepseek-MoE, and Qwen. The evaluation shows that our method outperforms other model pruning methods on a range of natural language tasks. We will release our code to facilitate future research.

cs.CL↗

The high resolution sampling methods for acoustic sources from multi-frequency far field patterns at sparse observation directions

This work is dedicated to novel uniqueness results and high resolution sampling methods for source support from multi-frequency sparse far field patterns. With a single pair of observation directions $\pm\hat{x}$, we prove that the lines $\{z\in\mathbb R^2|\, \hat{x}\cdot z = \hat{x}\cdot y, \,y\in A_{\hat{x}}\}$ can be determined by multi-frequency far field patterns at the directions $\pm\hat{x}$, where $A_{\hat{x}}$ denotes a set containing the corners of the boundary and points whose normal vector to the boundary is parallel to $\hat{x}$. Furthermore, if the source support is composed of polygons and annuluses, then we prove that the support can be determined by multi-frequency far field patterns at sparse directions. Precisely, the lowest number of the observation directions is given in terms of the number of the corners and the annuluses. Inspired by the uniqueness arguments, we introduce two novel indicators to determine the source support. Numerical examples in two dimensions are presented to show the validity and robustness of the two indicators for reconstructing the boundaries of the source support with a high resolution. The second indicator also shows its powerful ability to determine the unknown source function.

math.NA↗

LSAQ: Layer-Specific Adaptive Quantization for Large Language Model Deployment

As Large Language Models (LLMs) demonstrate exceptional performance across various domains, deploying LLMs on edge devices has emerged as a new trend. Quantization techniques, which reduce the size and memory requirements of LLMs, are effective for deploying LLMs on resource-limited edge devices. However, existing one-size-fits-all quantization methods often fail to dynamically adjust the memory requirements of LLMs, limiting their applications to practical edge devices with various computation resources. To tackle this issue, we propose Layer-Specific Adaptive Quantization (LSAQ), a system for adaptive quantization and dynamic deployment of LLMs based on layer importance. Specifically, LSAQ evaluates the importance of LLMs' neural layers by constructing top-k token sets from the inputs and outputs of each layer and calculating their Jaccard similarity. Based on layer importance, our system adaptively adjusts quantization strategies in real time according to the computation resource of edge devices, which applies higher quantization precision to layers with higher importance, and vice versa. {Experimental results show that LSAQ consistently outperforms the selected quantization baselines in terms of perplexity and zero-shot tasks. Additionally, it can devise appropriate quantization schemes for different usage scenarios to facilitate the deployment of LLMs.

cs.CL↗

Dependence of the Radical Dynamics on the Beam Temporal Profile in FLASH Radiotherapy

Purpose: This study aims to investigate the impact of the beam temporal profile on the radical dynamics and inter-track interactions of FLASH radiotherapy, supporting parameter optimization for the equipment development and clinical implementation. Methods: MonteCarlo simulations based on the IRT method were performed to analyze the dynamics after irradiation, including single-pulse or multi-pulses irradiation, pulse repetition rate, width and dose. The physicochemical experiments were performed to measure the eaq-lifetimes for validation. The generation and recombination of OH and eaq-radicals were recorded under 6 MeV electron irradiation with varying beam temporal profiles. The radial distributions of the radicals were statistically analyzed, and the corresponding LETd and LETt were calculated. The inter-track interactions were assessed through a mathematical model. Results: The spatial distribution and temporal evolution of radicals were significantly affected by the beam time profiles. Compared with multi-pulses irradiation, single-pulse mode with a width less than 1/10 of the radical lifetime, a repetition interval longer than the radical lifetime, and a dose exceeding 1 Gy/pulse can lead to radicals rapid consumption, reducing the residual content. Instantaneous high dose rates induced radical tracks overlaps. When the single-pulse dose exceeded 1 Gy, the overlap probability approached 100%, aligning with the threshold for radical instantaneous combination. Conclusion: Under a low-duty cycle and high instantaneous dose-rate time profile, the radicals were rapidly consumed through track overlap hence reduced damage to normal tissues, inducing FLASH effect. The optimized time profile can be used to guide the development of equipment and parameter settings in clinical practice to maximize the FLASH effect, such as the laser accelerators and superconducting photocathode guns.

physics.med-ph↗

Identifying point sources for biharmonic wave equation from the scattered fields at sparse sensors

This work is dedicated to uniqueness and numerical algorithms for determining the point sources of the biharmonic wave equation using scattered fields at sparse sensors. We first show that the point sources in both $\mathbb{R}^2$ and $\mathbb{R}^3$ can be uniquely determined from the multifrequency sparse scattered fields. In particular, to deal with the challenges arising from the fundamental solution of the biharmonic wave equation in $\mathbb{R}^2$, we present an innovative approach that leverages the Fourier transform and Funk-Hecke formula. Such a technique can also be applied for identifying the point sources of the Helmholtz equation. Moreover, we present the uniqueness results for identifying multiple point sources in $\mathbb{R}^3$ from the scattered fields at sparse sensors with finitely many frequencies. Based on the constructive uniqueness proofs, we propose three numerical algorithms for identifying the point sources by using multifrequency sparse scattered fields. The numerical experiments are presented to verify the effectiveness and robustness of the algorithms.

math.AP↗

A quantitative sampling method for elastic and electromagnetic sources

This work is dedicated to a novel sampling method for accurately reconstructing elastic and electromagnetic sources from the far field patterns. We show that the proposed indicators in the form of integrals with full far field patterns are exactly the source functions. These facts not only give constructive uniqueness proofs of the inverse source problems, but also establish the theoretical basis of the proposed sampling methods. Furthermore, we derive the stability estimates for the corresponding discrete indicators using the far field patterns with finitely many observations and frequencies. We have also proposed the indicators with partial far field patterns and proved their validity for providing the derivative information of the unknown sources. Numerical examples are presented to verify the accuracy and stability of the proposed quantitative sampling method.

math.NA↗

SWEA: Updating Factual Knowledge in Large Language Models via Subject Word Embedding Altering

The general capabilities of large language models (LLMs) make them the infrastructure for various AI applications, but updating their inner knowledge requires significant resources. Recent model editing is a promising technique for efficiently updating a small amount of knowledge of LLMs and has attracted much attention. In particular, local editing methods, which directly update model parameters, are proven suitable for updating small amounts of knowledge. Local editing methods update weights by computing least squares closed-form solutions and identify edited knowledge by vector-level matching in inference, which achieve promising results. However, these methods still require a lot of time and resources to complete the computation. Moreover, vector-level matching lacks reliability, and such updates disrupt the original organization of the model's parameters. To address these issues, we propose a detachable and expandable Subject Word Embedding Altering (SWEA) framework, which finds the editing embeddings through token-level matching and adds them to the subject word embeddings in Transformer input. To get these editing embeddings, we propose optimizing then suppressing fusion method, which first optimizes learnable embedding vectors for the editing target and then suppresses the Knowledge Embedding Dimensions (KEDs) to obtain final editing embeddings. We thus propose SWEA$\oplus$OS method for editing factual knowledge in LLMs. We demonstrate the overall state-of-the-art (SOTA) performance of SWEA$\oplus$OS on the CounterFact and zsRE datasets. To further validate the reasoning ability of SWEA$\oplus$OS in editing knowledge, we evaluate it on the more complex RippleEdits benchmark. The results demonstrate that SWEA$\oplus$OS possesses SOTA reasoning ability.

cs.CL↗

How to Alleviate Catastrophic Forgetting in LLMs Finetuning? Hierarchical Layer-Wise and Element-Wise Regularization

Large Language Models (LLMs) exhibit strong general language capabilities. However, fine-tuning these models on domain-specific tasks often leads to catastrophic forgetting, where the model overwrites or loses essential knowledge acquired during pretraining. This phenomenon significantly limits the broader applicability of LLMs. To address this challenge, we propose a novel approach to compute the element-wise importance of model parameters crucial for preserving general knowledge during fine-tuning. Our method utilizes a dual-objective optimization strategy: (1) regularization loss based on element-wise parameter importance, which constrains the updates to parameters crucial for general knowledge; (2) cross-entropy loss to adapt to domain-specific tasks. Additionally, we introduce layer-wise coefficients to account for the varying contributions of different layers, dynamically balancing the dual-objective optimization. Extensive experiments on scientific, medical, and physical tasks using GPT-J and LLaMA-3 demonstrate that our approach mitigates catastrophic forgetting while enhancing model adaptability. Compared to previous methods, our solution is approximately 20 times faster and requires only 10-15% of the storage, highlighting the practical efficiency. The code will be released.

cs.CL↗

Data-and-Semantic Dual-Driven Spectrum Map Construction for 6G Spectrum Management

Spectrum maps reflect the utilization and distribution of spectrum resources in the electromagnetic environment, serving as an effective approach to support spectrum management. However, the construction of spectrum maps in urban environments is challenging because of high-density connection and complex terrain. Moreover, the existing spectrum map construction methods are typically applied to a fixed frequency, which cannot cover the entire frequency band. To address the aforementioned challenges, a UNet-based data-and-semantic dual-driven method is proposed by introducing the semantic knowledge of binary city maps and binary sampling location maps to enhance the accuracy of spectrum map construction in complex urban environments with dense communications. Moreover, a joint frequency-space reasoning model is exploited to capture the correlation of spectrum data in terms of space and frequency, enabling the realization of complete spectrum map construction without sampling all frequencies of spectrum data. The simulation results demonstrate that the proposed method can infer the spectrum utilization status of missing frequencies and improve the completeness of the spectrum map construction. Furthermore, the accuracy of spectrum map construction achieved by the proposed data-and-semantic dual-driven method outperforms the benchmark schemes, especially in scenarios with low sampling density.

cs.LG↗

SWSC: Shared Weight for Similar Channel in LLM

Large language models (LLMs) have spurred development in multiple industries. However, the growing number of their parameters brings substantial storage and computing burdens, making it essential to explore model compression techniques for parameter reduction and easier deployment. We propose SWSC, an LLM compression method based on the concept of Shared Weight for Similar Channel. It uses the K-Means clustering algorithm to cluster model weights channel-by-channel, generating clusters with highly similar vectors within each. A representative vector from each cluster is selected to approximately replace all vectors in the cluster, significantly reducing the number of model weight parameters. However, approximate restoration will inevitably cause damage to the performance of the model. To tackle this issue, we perform singular value decomposition on the weight error values before and after compression and retain the larger singular values and their corresponding singular vectors to compensate for the accuracy. The experimental results show that our method can effectively ensure the performance of the compressed LLM even under low-precision conditions.

cs.LG↗

BayLing 2: A Multilingual Large Language Model with Efficient Language Alignment

Large language models (LLMs), with their powerful generative capabilities and vast knowledge, empower various tasks in everyday life. However, these abilities are primarily concentrated in high-resource languages, leaving low-resource languages with weaker generative capabilities and relatively limited knowledge. Enhancing the multilingual capabilities of LLMs is therefore crucial for serving over 100 linguistic communities worldwide. An intuitive approach to enhance the multilingual capabilities would be to construct instruction data for various languages, but constructing instruction data for over 100 languages is prohibitively costly. In this paper, we introduce BayLing 2, which efficiently transfers generative capabilities and knowledge from high-resource languages to low-resource languages through language alignment. To achieve this, we constructed a dataset of 3.2 million instructions, comprising high-resource language instructions (Chinese and English) and cross-lingual instructions for 100+ languages and performed instruction tuning based on the dataset to facilitate the capability transfer between languages. Using Llama as the foundation model, we developed BayLing-2-7B, BayLing-2-13B, and BayLing-2-8B, and conducted a comprehensive evaluation of BayLing. For multilingual translation across 100+ languages, BayLing shows superior performance compared to open-source models of similar scale. For multilingual knowledge and understanding benchmarks, BayLing achieves significant improvements across over 20 low-resource languages, demonstrating its capability of effective knowledge transfer from high-resource to low-resource languages. Furthermore, results on English benchmarks indicate that BayLing maintains high performance in highresource languages while enhancing the performance in low-resource languages. Demo, homepage, code and models of BayLing are available.

cs.CL↗

Model Editing for LLMs4Code: How Far are We?

Large Language Models for Code (LLMs4Code) have been found to exhibit outstanding performance in the software engineering domain, especially the remarkable performance in coding tasks. However, even the most advanced LLMs4Code can inevitably contain incorrect or outdated code knowledge. Due to the high cost of training LLMs4Code, it is impractical to re-train the models for fixing these problematic code knowledge. Model editing is a new technical field for effectively and efficiently correcting erroneous knowledge in LLMs, where various model editing techniques and benchmarks have been proposed recently. Despite that, a comprehensive study that thoroughly compares and analyzes the performance of the state-of-the-art model editing techniques for adapting the knowledge within LLMs4Code across various code-related tasks is notably absent. To bridge this gap, we perform the first systematic study on applying state-of-the-art model editing approaches to repair the inaccuracy of LLMs4Code. To that end, we introduce a benchmark named CLMEEval, which consists of two datasets, i.e., CoNaLa-Edit (CNLE) with 21K+ code generation samples and CodeSearchNet-Edit (CSNE) with 16K+ code summarization samples. With the help of CLMEEval, we evaluate six advanced model editing techniques on three LLMs4Code: CodeLlama (7B), CodeQwen1.5 (7B), and Stable-Code (3B). Our findings include that the external memorization-based GRACE approach achieves the best knowledge editing effectiveness and specificity (the editing does not influence untargeted knowledge), while generalization (whether the editing can generalize to other semantically-identical inputs) is a universal challenge for existing techniques. Furthermore, building on in-depth case analysis, we introduce an enhanced version of GRACE called A-GRACE, which incorporates contrastive learning to better capture the semantics of the inputs.

cs.SE↗

A facile route to synthesize cubic gauche polymeric nitrogen

In this work, the long-sought cg-N with N-N single bond has been synthesized for the first time by a thermal-driven-only chemical route at ambient conditions. The successful synthesis of cg-N was achieved by first creating a solution of azides, which was then pretreated under vacuum conditions. Following the pretreatment, the resultant concentrated azide was heated at temperatures ranging from 260°C to 330°C for a reaction time of 3 hours, ultimately leading to the formation of cg-N. The emergent intense Raman peak characterized of cg-N provides solid evidence that the double bonded nitrogen-nitrogen transforms into a single bond form, which agrees well with cg-N structure. To date, this is the only work achieving the quantity of cg-N synthesized at ambient conditions by a facile route that can be further developed for the scalable synthesis and applications of polymerized nitrogen-based materials as high energy density materials.

cond-mat.mtrl-sci↗

Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding

Reliable motion forecasting of surrounding agents is essential for ensuring the safe operation of autonomous vehicles. Many existing trajectory prediction methods rely heavily on high-definition (HD) maps as strong driving priors. However, the availability and accuracy of these priors are not guaranteed due to substantial costs to build, localization errors of vehicles, or ongoing road constructions. In this paper, we introduce MFTP, a Map-Free Trajectory Prediction method that offers several advantages. First, it eliminates the need for HD maps during inference while still benefiting from map priors during training via knowledge distillation. Second, we present a novel hierarchical encoder that effectively extracts spatial-temporal agent features and aggregates them into multiple trajectory queries. Additionally, we introduce an iterative decoder that sequentially decodes trajectory queries to generate the final predictions. Extensive experiments show that our approach achieves state-of-the-art performance on the Argoverse dataset under the map-free setting.

cs.CV↗