Searcharxiv⌕ Search

arXiv subjects

Cong Liu

Publications and source records attributed to Cong Liu.

At least 73 records · Page 4Linked to original sources

Dependence of halo properties on central-satellite magnitude gaps through weak lensing measurements

The magnitude gap between the central and satellite galaxies encodes information about the mass accretion history of a dark matter halo, and serves as a useful observational probe for the mass distribution in a halo. In this work, we perform the first weak lensing test of the connections between the magnitude gap and the halo profile. We measure the halo profiles of isolated central galaxies (ICGs) selected primarily from the SDSS Main Galaxy Sample. Halo mass and concentration are inferred by fitting stacked lensing profiles in bins of central luminosity, $L_\mathrm{c}$, and the central-satellite magnitude gap, $L_\mathrm{gap}$. We detect dependence on the magnitude gap in both halo properties. The dependence is the strongest in the ICG luminosity range of $10^{10.3}<L_\mathrm{c}[h^{-2}L_\odot]\leq 10^{10.7}$, where halos with smaller gaps have higher masses and lower concentrations. When $10^{10.7} <L_c[h^{-2}L_\odot] \leq 10^{11.1}$, however, no significant gap dependence is detected. In the range of $10^{9.9}<L_\mathrm{c}[h^{-2}L_\odot] \leq 10^{10.3}$, a disordering of the gap dependence is marginally observable. We compare the observational results with predictions by two lightcone catalogs built from the Illustris TNG300 and the Millennium simulations. The gap dependence in the two mock samples show overall consistency with observations, but neither matches them in all $L_\mathrm{c}$ bins to a quantitative level. We also compare the significance of the gap dependence on halo mass and concentration and find that our measurement prefers gap dependence in both parameters, while the halo mass dependence is preferred over the concentration if only one of the two dependencies is allowed.

astro-ph.CO↗

LeMix: Unified Scheduling for LLM Training and Inference on Multi-GPU Systems

Modern deployment of large language models (LLMs) frequently involves both inference serving and continuous retraining to stay aligned with evolving data and user feedback. Common practices separate these workloads onto distinct servers in isolated phases, causing substantial inefficiencies (e.g., GPU idleness) and delayed adaptation to new data in distributed settings. Our empirical analysis reveals that these inefficiencies stem from dynamic request arrivals during serving and workload heterogeneity in pipeline-parallel training. To address these challenges, we propose LeMix, a system for co-locating and managing concurrent LLM serving and training workloads. LeMix integrates offline profiling, execution prediction mechanisms, and runtime scheduling to dynamically adapt resource allocation based on workload characteristics and system conditions. By understanding task-specific behaviors and co-execution interference across shared nodes, LeMix improves utilization and serving quality without compromising serving responsiveness. Our evaluation shows that LeMix improves throughput by up to 3.53x, reduces inference loss by up to 0.61x, and delivers up to 2.12x higher response time SLO attainment over traditional separate setups. To our knowledge, this is the first work to uncover and exploit the opportunities of joint LLM inference and training, paving the way for more resource-efficient deployment of LLMs in production environments.

cs.AI↗

TACOS: Open Tagging and Comparative Scoring for Instruction Fine-Tuning Data Selection

Instruction Fine-Tuning (IFT) is crucial for aligning large language models (LLMs) with human preferences, and selecting a small yet representative subset from massive data significantly facilitates IFT in terms of both efficiency and effectiveness. Nevertheless, existing approaches suffer from two limitations: the use of simple heuristics restricts data diversity, while the singleton data quality evaluation accounts for inconsistent criteria between independent samples. To address the issues, we present TACOS, an innovative method that integrates Open Tagging and Comparative Scoring for IFT data selection. To capture data diversity, we leverage LLMs to assign open-domain tags to human queries, followed by a normalization stage to denoise the open tags and enable efficient clustering. Additionally, we suggest a comparative scoring method that allows the relative quality evaluation of samples within a cluster, avoiding inconsistent criteria seen in singleton-based evaluations. Extensive experiments across diverse datasets and LLM architectures demonstrate that TACOS outperforms existing approaches by a large margin. Notably, it achieves superior instruction-following performance on MT-Bench and ranks 1st among LLaMA2-7B-Based models on AlpacaEval 2.0, illustrating its efficacy for IFT data selection.

cs.CL↗

The Dependence of Dark Matter Halo Properties on the Morphology of Their Central Galaxies from Weak Lensing

Xu \& Jing reported a monotonic relationship between host halo mass $M_h$ and the morphology of massive central galaxies, characterized by the Sérsic index $n$, at fixed stellar mass, suggesting that morphology could serve as a good secondary proxy for halo mass. Since their results were derived using the indirect abundance matching method, we further investigate the connection between halo properties and central galaxy morphology using weak gravitational lensing. We apply galaxy-galaxy lensing to measure the excess surface density around CMASS central galaxies with stellar masses in the range of $11.3 < \log M_*/{\rm M_\odot} < 11.7$, using the HSC shear catalog processed through the Fourier\_Quad pipeline. By dividing the sample based on $n$, we confirm a positive correlation between $n$ and $M_h$, and observe a possible evidence of the positive correlation of $n$ and halo concentration. After accounting for color, we find that neither color nor morphology alone can determine halo mass, suggesting that a combination of both may serve as a better secondary proxy. In comparison to hydrodynamic simulations, we find that TNG300 produce much weaker correlations between $M_h$ and $n$. Furthermore, using SIMBA simulations with different feedback mode, we find jet-mode active galactic nuclei feedback might be related to the relationship of Sérsic index and halo mass.

astro-ph.GA↗

Cool-Fusion: Fuse Large Language Models without Training

We focus on the problem of fusing two or more heterogeneous large language models (LLMs) to leverage their complementary strengths. One of the challenges of model fusion is high computational load, specifically in fine-tuning or aligning vocabularies. To address this, we propose Cool-Fusion, a simple yet effective approach that fuses the knowledge of source LLMs, which does not require training. Unlike ensemble methods, Cool-Fusion is applicable to any set of source LLMs that have different vocabularies. To overcome the vocabulary discrepancies among LLMs, we ensemble LLMs on text level, allowing them to rerank the generated texts by each other with different granularities. Extensive experiments have been conducted across a variety of benchmark datasets. On GSM8K, Cool-Fusion increases accuracy from three strong source LLMs by a significant margin of 17.4\%.

cs.CL↗

Chain of Methodologies: Scaling Test Time Computation without Training

Large Language Models (LLMs) often struggle with complex reasoning tasks due to insufficient in-depth insights in their training data, which are typically absent in publicly available documents. This paper introduces the Chain of Methodologies (CoM), an innovative and intuitive prompting framework that enhances structured thinking by integrating human methodological insights, enabling LLMs to tackle complex tasks with extended reasoning. CoM leverages the metacognitive abilities of advanced LLMs, activating systematic reasoning throught user-defined methodologies without explicit fine-tuning. Experiments show that CoM surpasses competitive baselines, demonstrating the potential of training-free prompting methods as robust solutions for complex reasoning tasks and bridging the gap toward human-level reasoning through human-like methodological insights.

cs.CL↗

Understanding and Mitigating Network Latency Effect on Teleoperated-Robot with Extended Reality

Robot teleoperation with extended reality (XR teleoperation) enables intuitive interaction by allowing remote robots to mimic user motions with real-time 3D feedback. However, existing systems face significant motion-to-motion (M2M) latency--the delay between the user's latest motion and the corresponding robot feedback--leading to high teleoperation error and mission completion time. This issue stems from the system's exclusive reliance on network communication, making it highly vulnerable to network degradation. To address these challenges, we introduce TeleXR, the first end-to-end, fully open-sourced XR teleoperation framework that decouples robot control and XR visualization from network dependencies. TeleXR leverages local sensing data to reconstruct delayed or missing information of the counterpart, thereby significantly reducing network-induced issues. This approach allows both the XR and robot to run concurrently with network transmission while maintaining high robot planning accuracy. TeleXR also features contention-aware scheduling to mitigate GPU contention and bandwidth-adaptive point cloud scaling to cope with limited bandwidth.

cs.RO↗

A Silicon Microstrip Detector for Power-Limited and Large Sensitive Area Applications

A silicon microstrip detector (SSD) has been developed to have state of the art spatial resolution and a large sensitive area under stringent power constraints. The design incorporates three floating strips with their bias resistors inserted between two aluminum readout strips. Beam test measurements with the single sensor confirmed that this configuration achieves a total detection efficiency of $99.8 \, \%$ and spatial resolution $7.6 \, \mathrm{μm}$ for MIPs. A double-$η$ algorithm was developed to optimize hit position reconstruction for this SSD. The design can be adapted for large area silicon detectors.

physics.ins-det↗

Simulation of radiation damage effect on silicon detectors using RASER

Silicon detectors play a crucial role in high energy physics experiments. In future high energy physics experiments, silicon detectors will be exposed to extremely high fluence environment, which can significantly affect their performance. It is important to understand the electrical behavior of detectors after irradiation. In this study, an irradiation simulation framework is constructed in RASER to simulate leakage current and charge collection effciency. The defect parameters are obtained from the Hamburg penta trap model (HPTM). Based on this work, we predict the similar silicon inner tracker which under a ten-year CEPC Higgs mode run can still maintain over 90% charge collection efficiency.

physics.ins-det↗

Clifford Group Equivariant Diffusion Models for 3D Molecular Generation

This paper explores leveraging the Clifford algebra's expressive power for $\E(n)$-equivariant diffusion models. We utilize the geometric products between Clifford multivectors and the rich geometric information encoded in Clifford subspaces in \emph{Clifford Diffusion Models} (CDMs). We extend the diffusion process beyond just Clifford one-vectors to incorporate all higher-grade multivector subspaces. The data is embedded in grade-$k$ subspaces, allowing us to apply latent diffusion across complete multivectors. This enables CDMs to capture the joint distribution across different subspaces of the algebra, incorporating richer geometric information through higher-order features. We provide empirical results for unconditional molecular generation on the QM9 dataset, showing that CDMs provide a promising avenue for generative modeling.

cs.LG↗

Enabling Multireference Calculations on Multi-Metallic Systems with Graphic Processing Units

Modeling multimetallic systems efficiently enables faster prediction of desirable chemical properties and design of new materials. This work describes an initial implementation for performing multireference wave function method localized active space self-consistent field (LASSCF) calculations through the use of multiple graphics processing units (GPUs) to accelerate time-to-solution. Density fitting is leveraged to reduce memory requirements, and we demonstrate the ability to fully utilize multi-GPU compute nodes. Performance improvements of 5-10x in total application runtime were observed in LASSCF calculations for multimetallic catalyst systems up to 1200 AOs and an active space of (22e,40o) using up to four NVIDIA A100 GPUs. Written with performance portability in mind, comparable performance is also observed in early runs on the Aurora exascale system using Intel Max Series GPUs.

physics.comp-ph↗

Exploring Part-Informed Visual-Language Learning for Person Re-Identification

Recently, visual-language learning (VLL) has shown great potential in enhancing visual-based person re-identification (ReID). Existing VLL-based ReID methods typically focus on image-text feature alignment at the whole-body level, while neglecting supervision on fine-grained part features, thus lacking constraints for local feature semantic consistency. To this end, we propose Part-Informed Visual-language Learning ($π$-VL) to enhance fine-grained visual features with part-informed language supervisions for ReID tasks. Specifically, $π$-VL introduces a human parsing-guided prompt tuning strategy and a hierarchical visual-language alignment paradigm to ensure within-part feature semantic consistency. The former combines both identity labels and human parsing maps to constitute pixel-level text prompts, and the latter fuses multi-scale visual features with a light-weight auxiliary head to perform fine-grained image-text alignment. As a plug-and-play and inference-free solution, our $π$-VL achieves performance comparable to or better than state-of-the-art methods on four commonly used ReID benchmarks. Notably, it reports 91.0% Rank-1 and 76.9% mAP on the challenging MSMT17 database, without bells and whistles.

cs.CV↗

Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting

Generic text rewriting is a prevalent large language model (LLM) application that covers diverse real-world tasks, such as style transfer, fact correction, and email editing. These tasks vary in rewriting objectives (e.g., factual consistency vs. semantic preservation), making it challenging to develop a unified model that excels across all dimensions. Existing methods often specialize in either a single task or a specific objective, limiting their generalizability. In this work, we introduce a generic model proficient in factuality, stylistic, and conversational rewriting tasks. To simulate real-world user rewrite requests, we construct a conversational rewrite dataset, ChatRewrite, that presents ``natural''-sounding instructions, from raw emails using LLMs. Combined with other popular rewrite datasets, including LongFact for the factuality rewrite task and RewriteLM for the stylistic rewrite task, this forms a broad benchmark for training and evaluating generic rewrite models. To align with task-specific objectives, we propose Dr Genre, a Decoupled-reward learning framework for Generic rewriting, that utilizes objective-oriented reward models with a task-specific weighting. Evaluation shows that \approach delivers higher-quality rewrites across all targeted tasks, improving objectives including instruction following (agreement), internal consistency (coherence), and minimal unnecessary edits (conciseness).

cs.CL↗

Mixtraining: A Better Trade-Off Between Compute and Performance

Incorporating self-supervised learning (SSL) before standard supervised learning (SL) has become a widely used strategy to enhance model performance, particularly in data-limited scenarios. However, this approach introduces a trade-off between computation and performance: while SSL helps with representation learning, it requires a separate, often time-consuming training phase, increasing computational overhead and limiting efficiency in resource-constrained settings. To address these challenges, we propose MixTraining, a novel framework that interleaves several SSL and SL epochs within a unified mixtraining training phase, featuring a smooth transition between two learning objectives. MixTraining enhances synergy between SSL and SL for improved accuracy and consolidates shared computation steps to reduce computation overhead. MixTraining is versatile and applicable to both single-task and multi-task learning scenarios. Extensive experiments demonstrate that MixTraining offers a superior compute-performance trade-off compared to conventional pipelines, achieving an 8.81% absolute accuracy gain (18.89% relative accuracy gain) on the TinyImageNet dataset while accelerating training by up to 1.29x with the ViT-Tiny model.

cs.LG↗

Unified signal response for stochastic resonance in bistable systems

The phenomenon of stochastic resonance, wherein the stimulus-response of a system can be maximized by an intermediate level of noise, has been extensively investigated through linear response theory. As yet a unified response-noise or response-frequency formula embracing diverse factors, such as noise color, damping coefficients, and coupling, is still lacking. In the present work, we theoretically investigate the benefit roles of Gaussian white noise and Ornstein- Uhlenbeck noise on the signal amplification of systems ranging from a single overdamped bistable particle to the mean-field coupled underdamped Duffing oscillators and severally deduce their signal response expressions. We find that the formulas of signal response in these different cases can be reduced to a uniform Lorentz function form. Furthermore, based on the general expression, we explain explicitly the role of driving frequency, coupling and the noise color on stochastic resonance. Our results contribute to a deep theoretical understanding of stochastic resonance in bistable systems.

nlin.AO↗

Electrical resistivity, thermal conductivity, and viscosity of Fe-H alloys at Earth's core conditions

The transport properties (electrical resistivity, thermal conductivity, and viscosity) of iron-hydrogen alloys are of great significance in the stability and evolution of planetary magnetic fields. Here, we investigate the thermal transport properties of iron doped with varying hydrogen content as functions of pressure (P) and temperature (T) for the top and bottom of Earth's outer core and beyond, corresponding to pressures of about 130 to 300 GPa and temperatures of 4000 to 7000 K. Using first-principles density functional theory molecular dynamic simulations (FPMD), we verify that crystalline FeH$_x$ is superionic with H diffusing freely. We find a low frequency viscosity of 10-11 mPa$\cdot$s for liquid Fe-H alloys at Earth's outer core conditions. We find saturation of electrical resistivity with increasing temperatures in liquid iron at outer core conditions. The effect of H on electrical and thermal transport we find is small, so that the exact H content of the core is not needed. The primary effect of H is on the equation of state, decreasing the density at constant P and T. We find the Lorenz number is smaller than the ideal value, and obtain for X(H)= 0.20, or 0.45 wt% H , thermal conductivity $κ$ of $\sim$105 and $\sim$190 $Wm^{-1}K^{-1}$, respectively, at conditions near the core-mantle and inner-outer core boundary.

cond-mat.mtrl-sci↗

Optimizing and reducing stochastic resonance by noise color in globally coupled bistable systems

We investigate the collective signal response of two typical nonlinear dynamical models, the mean-field coupled overdamped bistable oscillators and the underdamped Duffing oscillators, with respect to both the additive Ornstein-Uhlenbeck noise and the weak periodical stimulus. Based on the linear response theory, we theoretically derive the dependences of the ensemble signal response on the noise intensity and driving frequency of both systems. Furthermore, we theoretically demonstrate that the noise color monotonically weakens the strength of stochastic resonance in the overdamped situation, but nonmonotonically strengthens it in the underdamped counterpart. Such a result goes against the conventional wisdom that the color of the additive noise impairs the magnitude of stochastic resonance. Finally, we perform the numerical integration to verify our theoretical results and discuss potential connections with the functional significance of 1/f noise.

physics.bio-ph↗

PsyPlay: Personality-Infused Role-Playing Conversational Agents

The current research on Role-Playing Conversational Agents (RPCAs) with Large Language Models (LLMs) primarily focuses on imitating specific speaking styles and utilizing character backgrounds, neglecting the depiction of deeper personality traits.~In this study, we introduce personality-infused role-playing for LLM agents, which encourages agents to accurately portray their designated personality traits during dialogues. We then propose PsyPlay, a dialogue generation framework that facilitates the expression of rich personalities among multiple LLM agents. Specifically, PsyPlay enables agents to assume roles with distinct personality traits and engage in discussions centered around specific topics, consistently exhibiting their designated personality traits throughout the interactions. Validation on generated dialogue data demonstrates that PsyPlay can accurately portray the intended personality traits, achieving an overall success rate of 80.31% on GPT-3.5. Notably, we observe that LLMs aligned with positive values are more successful in portraying positive personality roles compared to negative ones. Moreover, we construct a dialogue corpus for personality-infused role-playing, called PsyPlay-Bench. The corpus, which consists of 4745 instances of correctly portrayed dialogues using PsyPlay, aims to further facilitate research in personalized role-playing and dialogue personality detection.

cs.CL↗