Searcharxiv⌕ Search

arXiv subjects

Xin Zhang

Publications and source records attributed to Xin Zhang.

At least 199 records · Page 11Linked to original sources

EnergyLens: Predictive Energy-Aware Exploration for Multi-GPU LLM Inference Optimization

We present EnergyLens, an end-to-end framework for energy-aware large language model (LLM) inference optimization. As LLMs scale, predicting and reducing their energy footprint has become critical for sustainability and datacenter operations, yet existing approaches either require production-level code and expensive profiling or fail to accurately capture multi-GPU energy behavior. As a result, practitioners lack tools for deciding which optimizations to prioritize and for selecting among existing deployment configurations when exhaustive profiling is impractical. EnergyLens addresses this gap with an intuitive einsum-based interface that captures LLM specifications including fusion, parallelism, and compute-communication overlap, combined with load-imbalance-aware MoE modeling and an empirically driven communication energy model for multi-GPU settings. We validate EnergyLens on Llama3 and Qwen3-MoE across tensor-parallel and expert-parallel configurations, achieving mean absolute percentage errors (MAPEs) between 9.25% and 13.19% for multi-GPU prefill and decode energy, and 12.97% across SM allocations for Megatron-style overlap. Our energy-driven exploration reveals up to 1.47x and 52.9x energy variation across configurations in prefill and decode efficiency and motivates distributed serving. We further show that compute-communication overlap is difficult to optimize with intuition alone, but EnergyLens correctly identifies Pareto-optimal overlap configurations.

cs.LG↗

Comparative analysis of missing data imputation methods for CSST survey: Impact on photometric redshift estimation performance

Improving the accuracy of photometric redshifts (photo-$z$) is essential for reliable statistical studies of cosmology and galaxy evolution. However, missing photometric bands are a common observational challenge that can significantly degrade photo-$z$ estimation accuracy. In this work, we present a systematic evaluation of data imputation methods aimed at improving photo-$z$ performance. We benchmark a range of representative machine learning (ML) and deep learning (DL) architectures, identifying k-nearest neighbors (KNN) and the attention-based SAITS model as the leading performers. These models are then applied to China Space Station Survey Telescope (CSST) mock data to assess their performance under realistic observational conditions. Our results show that KNN yields the highest accuracy under idealized missing completely at random (MCAR) conditions with complete training sets, whereas robustness tests reveal that SAITS significantly outperforms KNN when training data is incomplete or when applied to realistic mixed-mechanism scenarios. We find that domain consistency between training and testing missingness patterns is a prerequisite for optimal performance, highlighting the risks of domain shift in supervised regression tasks. Furthermore, our analysis demonstrates that while general imputation models are highly effective for MCAR and missing at random (MAR) data, they are detrimental when applied to missing not at random (MNAR) data arising from flux limits, as statistical models fail to capture the physical information inherent in these non-detections. Consequently, we advocate for more sophisticated architectures capable of disentangling stochastic missingness from physical non-detections to address these distinct mechanisms individually.

astro-ph.GA↗

On Privacy-Preserving Image Transmission in Low-Altitude Networks: A Swin Transformer-Based Framework with Federated Learning

The rapid development of low-altitude economy has driven the proliferation of Unmanned Aerial Vehicle (UAV) applications, including logistics, inspection, and emergency response. However, transmitting high-volume image data from UAVs to ground stations faces significant challenges due to limited bandwidth and stringent privacy requirements. To address these issues, a Semantic Communication (SC) framework based on Federated Learning (FL) is proposed for efficient and privacy-preserving image transmission. A Swin Transformer-based Semantic Communication (STSC) architecture is designed to extract multi-scale semantic features under constrained bandwidth conditions. Dedicated communication and computing nodes are deployed on UAVs to enhance real-time coverage and flexibility. Meanwhile, a FL mechanism enables global model training across distributed devices without sharing raw data, thus preserving user privacy. Simulation experiments conducted on the CIFAR-10 dataset demonstrate that the proposed STSC framework achieves at least 5.7 dB improvement in Peak Signal-to-Noise Ratio (PSNR) compared to DeepJSCC baselines, while also showing superior convergence and generalization performance. The framework effectively integrates UAV-assisted deployment with SC and privacy protection, offering a practical solution for bandwidth-constrained image transmission in low-altitude networks.

eess.IV↗

Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Values

Autonomous agents have rapidly matured as task executors and seen widespread deployment via harnesses such as OpenClaw. Safety concerns have rightly drawn growing research attention, and beneath them lie the values silently steering agent behavior. Existing value benchmarks, however, remain confined to LLMs, leaving agent values largely uncharted. From intuitive, empirical, and theoretical vantage points, we show that an agent's values diverge from those of its underlying LLM, and the agentic modality further introduces dataset-, evaluation-, and system-level challenges absent from text-only protocols. We close this gap with Agent-ValueBench, the first benchmark dedicated to agent values. It features 394 executable environments across 16 domains, offering 4,335 value-conflict tasks that cover 28 value systems and 332 dimensions. Every instance is co-synthesized through our purpose-built end-to-end pipeline and curated per-instance by professional psychologists. Each task ships with two pole-aligned golden trajectories whose checkpoints anchor a trajectory-level rubric-based judge. Benchmarking 14 frontier proprietary and open-weights models across 4 mainstream harnesses, we uncover three concerted findings. Agent values first manifest as a Value Tide of cross-model homogeneity beneath interpretable counter-currents. This tide bends non-additively under harness pull, and yet more decisively under deliberate steering via embedded skills. Together these results signal that the agent-alignment lever is shifting from classical model alignment and prompt steering toward harness alignment and skill steering.

cs.AI↗

Parameter inference of millilensed gravitational waves using neural spline flows

When gravitational waves (GWs) propagate near massive objects, they undergo gravitational lensing that imprints lens model dependent modulations on the waveform. This effect provides a powerful tool for cosmological and astrophysical studies. Due to the added parameters of lenses and the uncertainty of lens models, parameter inference for lensed GW events using traditional methods is extremely time-consuming, thus requiring more efficient parameter inference methods. In this work, we explore the use of neural spline flows (NSFs) for posterior inference of millilensed GWs, and successfully apply NSFs to the inference of 11-dimensional lens parameters. Our results demonstrate that compared with traditional methods like Bilby dynesty that rely on Bayesian inference, the NSF network we built not only achieves inference accuracy comparable to traditional methods for most parameters, but also can reduce the inference time from approximately 3 days to 0.8 s on average. Additionally, the network exhibits strong generalization for the spin parameters of GW sources. It is anticipated to become a powerful tool for future low-latency searches for lensed GW signals.

gr-qc↗

Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs

Continuous latent-space reasoning offers a compact alternative to textual chain-of-thought for multimodal models, enabling high-dimensional visual evidence to be integrated without explicit reasoning tokens. However, we identify a previously overlooked optimization pathology in existing latent visual reasoning methods: although visual latents become semantically enriched during training, their contribution to final answer prediction is systematically suppressed. Within the shared parameter space, the autoregressive objective favors shortcut reliance on direct visual input, driving latent tokens toward transition-like states rather than informative reasoning content. We term this phenomenon Silenced Visual Latents. To address it, we disentangle the two conflicting objectives by directly optimizing the latent reasoning at inference time, keeping backbone parameters frozen. In Stage I, visual latents are warmed up via query-guided contrastive latent--visual alignment, improving semantic quality while preventing latent collapse. In Stage II, the latent reasoning is further optimized via a confidence-progression reward, which incentivizes predicted token distributions along the latent span to become progressively more concentrated, routing predictions through the latent reasoning rather than bypassing it. Experiments across eight benchmarks and four model backbones show that inference-time latent optimization, without any parameter updates, effectively unleashes the suppressed reasoning capacity of visual latents.

cs.LG↗

Super approximation for $\text{SL}_2\times \text{SL}_2$ and $\text{ASL}_2$

Let $S\subset \text{SL}_2(\mathbb Z)\times \text{SL}_2(\mathbb Z)$ or $\text{SL}_2(\mathbb Z)\ltimes \mathbb Z^2$ be finite symmetric and assume $S$ generates a group $G$ which is a Zariski-dense subgroup $\text{SL}_2(\mathbb Z)\times \text{SL}_2(\mathbb Z)$ or $\text{SL}_2(\mathbb Z)\ltimes \mathbb Z^2$. We prove that the Cayley graphs $$\{\mathcal Cay(G(\text{mod } q), S (\text{mod } q))\}_{q\in \mathbb Z}$$ form a family of expanders.

math.GR↗

Evidence for deviation in gravitational light deflection from general relativity at cosmological scales with KiDS-Legacy and CMB lensing

General relativity (GR) faces challenges from cosmic acceleration and observational tensions, necessitating stringent tests at cosmological scales. In this work, we probe GR deviations via a $μ$--$Σ$ modified gravity parameterization, integrating KiDS-Legacy weak lensing (WL) data (1347 deg$^2$, $z\leq 2.0$), joint cosmic microwave background (CMB) data from Planck, ACT, and SPT, DESI DR2 baryon acoustic oscillation, and DES-Dovekie supernova data. KiDS-Legacy significantly improves constraint precision: $μ_0$ (matter clustering) by $\sim 60\%$ and $Σ_0$ (gravitational light deflection) by $\sim 43\%$ relative to CMB alone. In the $Λ$CDM background, $μ_0 = 0.21\pm 0.21$ is consistent with GR, while $Σ_0 = 0.149\pm 0.051$ deviates from GR at the 3.0$σ$ level. Furthermore, within the observationally preferred $w_0w_a$CDM background, this deviation in gravitational light deflection persists at the 2.2$σ$ level. This deviation is likely driven by the higher amplitudes in the large-scale CMB lensing measurements. This precise separation of GR-consistent matter clustering and deviant light deflection provides key observational clues for new physics or data systematics. Our work underscores the critical role of synergizing high-precision CMB and WL data in advancing GR tests.

astro-ph.CO↗

Spectral Signatures of Third-Order Pseudo-Transitions in Finite Systems: An Eigen-Microstate Approach

Third-order pseudo-transitions in finite systems reflect reorganization beyond conventional criticality, yet their identification usually relies on microcanonical entropy, which is often inaccessible in practice. Here we introduce a spectral generalized response within the eigen-microstate framework. From the distribution of normalized spectral weights, we construct the third-order ratio $R_3=K_3/(K_2)^3$, which probes asymmetric redistribution among fluctuation modes beyond leading-mode condensation. Across Ising and Potts models on regular lattices and random regular networks, extrema of $R_3$ consistently track higher-order anomalies. Combined with spectral projection, the method further distinguishes dependent and independent branches: the former remain tied to the dominant ordering channel, whereas the latter arise from redistribution within the subleading fluctuation subspace. The effective spectral dimension $R_{\mathrm{eff}}$ provides the participation background in which these anomalies develop. These results establish a geometric characterization of third-order pseudo-transitions as reorganizations of statistical weight in configuration space and provide an order-parameter-free route to finite-size structural criticality.

cond-mat.stat-mech↗

EnergAIzer: Fast and Accurate GPU Power Estimation Framework for AI Workloads

As AI workloads drive increases in datacenter power consumption, accurate GPU power estimation is critical for proactive power management. However, existing power models face a scalability bottleneck not in the modeling techniques themselves, but in obtaining the hardware utilization inputs they require. Conventional approaches rely on either costly simulation or hardware profiling, which makes them impractical when rapid predictions are required. This work presents EnergAIzer, which addresses this scalability bottleneck by developing a lightweight solution to predict utilization inputs, reducing the estimation walltime from hours to seconds. Our key insight is that kernels in AI workloads commonly employ optimizations that create structured patterns, which analytically determine memory traffic and execution timeline. We construct a performance model using these patterns as an analytical scaffold for empirical data fitting, which also naturally exposes module-level utilization. This predicted utilization is then fed into our power model to estimate dynamic power consumption. EnergAIzer achieves 8% power errors on NVIDIA Ampere GPUs, competitive with traditional power models with elaborate cycle-level simulation or hardware profiling. We demonstrate EnergAIzer's exploration capabilities for frequency scaling and architectural configurations, including forecasting the power of NVIDIA H100 with just 7% error. In summary, EnergAIzer provides fast and accurate power prediction for AI workloads, paving the way for power-aware design explorations.

cs.AR↗

KANMixer: a minimal KAN-centered mixer for long-term time series forecasting

Long-term time series forecasting (LTSF) underpins critical applications from energy management to weather prediction, yet achieving reliable multi-step-ahead accuracy remains challenging. Existing LTSF approaches, dominated by MLP- and Transformer-based architectures, either rely on simple linear mappings or introduce increasingly complex hand-crafted inductive biases, raising the question of whether a more expressive and principled nonlinear core could offer a better alternative. Therefore, we investigate whether Kolmogorov-Arnold Networks (KANs), a recently proposed model featuring adaptive basis functions capable of granular modulation of nonlinearities, can improve LTSF performance, and under which design choices they are most effective. Specifically, we propose KANMixer, a minimal KAN-centered architecture consisting of a multi-scale pooling frontend, a KAN-based temporal mixing backbone, and prediction heads. By avoiding heavy auxiliary modules, KANMixer enables a clear assessment of KAN components in LTSF. Across 28 benchmark-horizon settings against nine baselines, KANMixer achieves the best MSE in 16 settings and the best MAE in 11. Furthermore, extensive ablations on three representative datasets show that KAN effectiveness depends strongly on the choice of edge function; B-spline bases outperform Fourier and Wavelet alternatives; the prediction head contributes most to the gains; moderate depth is preferred over deeper unstable stacks; and decomposition priors help MLP but harm KAN. Beyond practical guidance for integrating KAN into LTSF, these results reveal an underexplored dependency between structural priors and backbone nonlinearity: design choices that benefit MLP can degrade KAN.

cs.LG↗

Stripping Symmetry: Electrochemical Oxidation to a Superconducting Polar Metal in Au2Pb0.914P2

Polar metals and noncentrosymmetric superconductors are exceptionally rare, yet their broken inversion symmetry can give rise to emergent electronic phenomena including mixed singlet-triplet superconducting pairing. As only a few such materials have been found among known compounds, accessing new examples requires synthetic strategies that go beyond conventional crystal growth. Here, we use electrochemical topotactic deintercalation to remove Pb from the centrosymmetric parent compound Au$_2$PbP$_2$, producing the polar metal Au$_2$Pb$_{0.914}$P$_2$. Unlike conventional chemical doping, this transformation actively drives structural symmetry-breaking: the partial removal of Pb triggers a cooperative electronic and geometric rearrangement, mediated by a second-order Jahn-Teller effect and stereochemically active lone pairs, that locks the product into a polar, noncentrosymmetric superspace group Ama2(01g)ss0. We solve the complete (3+1)D modulated structure by synchrotron single-crystal X-ray diffraction and confirm the polar assignment through nonlinear electronic transport. Below T$_c$ = 1.52 K, Au$_2$Pb$_{0.914}$P$_2$ becomes a type-II superconductor whose heat capacity and AC susceptibility both exhibit power-law behavior, suggestive of a gap structure governed by the broken inversion symmetry of the host lattice. This work establishes electrochemical oxidation as a rational route to metastable noncentrosymmetric superconductors through chemically directed symmetry-breaking.

cond-mat.supr-con↗

Are Emotion and Rhetoric Neurons in LLM? Neuron Recognition and Adaptive Masking for Emotion-Rhetoric Prediction Steering

Accurate comprehension and controllable generation of emotion and rhetoric are pivotal for enhancing the reasoning capabilities of large language models (LLMs). Existing studies mostly rely on external optimizations, lacking in-depth exploration of internal representation mechanisms, thus failing to achieve fine-grained steering at the neuron level. A handful of works on neurons are confined to emotions, neglecting rhetoric neurons and their intrinsic connections. Traditional neuron masking also exhibits counterintuitive phenomena, making reliable verification of neuron functionality infeasible. To address these issues, we systematically investigate the neurons representation mechanisms and inherent associations of 6 emotion categories and 4 core rhetorical devices. We propose a neuron identification framework that integrates multi-dimensional screening, and design an adaptive masking method incorporating dynamic filtering, attenuation masking, and feedback optimization, enabling reliable causal validation of neuron functionality.Through neuron regulation, we achieve directed induction of non-target sentences and enhancement of emotion tasks via rhetoric neurons. Experiments on 5 commonly used datasets validate the effectiveness of our method, providing a novel paradigm for the fine-grained steering of emotion and rhetoric expressions in LLMs.

cs.CL↗

TRIDENT: Enhancing Large Language Model Safety with Tri-Dimensional Diversified Red-Teaming Data Synthesis

Large Language Models (LLMs) excel in various natural language processing tasks but remain vulnerable to generating harmful content or being exploited for malicious purposes. Although safety alignment datasets have been introduced to mitigate such risks through supervised fine-tuning (SFT), these datasets often lack comprehensive risk coverage. Most existing datasets focus primarily on lexical diversity while neglecting other critical dimensions. To address this limitation, we propose a novel analysis framework to systematically measure the risk coverage of alignment datasets across three essential dimensions: Lexical Diversity, Malicious Intent, and Jailbreak Tactics. We further introduce TRIDENT, an automated pipeline that leverages persona-based, zero-shot LLM generation to produce diverse and comprehensive instructions spanning these dimensions. Each harmful instruction is paired with an ethically aligned response, resulting in two datasets: TRIDENT-Core, comprising 26,311 examples, and TRIDENT-Edge, with 18,773 examples. Fine-tuning Llama 3.1-8B on TRIDENT-Edge demonstrates substantial improvements, achieving an average 14.29% reduction in Harm Score, and a 20% decrease in Attack Success Rate compared to the best-performing baseline model fine-tuned on the WildBreak dataset.

cs.CL↗

Identification and Structural Characterization of Twisted Atomically Thin Bilayer Materials by Deep Learning

Two-dimensional materials are expected to play an important role in next-generation electronics and optoelectronic devices. Recently, twisted bilayer graphene and transition metal dichalcogenides have attracted significant attention due to their unique physical properties and potential applications. In this study we describe the use of optical microscopy to collect the color space of chemical vapor deposition (CVD) molybdenum disulfide ($\mbox{MoS}_2$), and the application of a semantic segmentation convolutional neural network (CNN) to accurately and rapidly identify thicknesses of $\mbox{MoS}_2$ flakes. A second CNN model is trained to provide precise predictions on the twist angle of CVD-grown bilayer flakes. This model harnessed a dataset comprising over 10,000 synthetic images, encompassing geometries spanning from hexagonal to triangular shapes. Subsequent validation of the deep learning predictions on twist angles was executed through the second harmonic generation and Raman spectroscopy. Our results introduce a scalable methodology for automated inspection of twisted atomically thin CVD-grown bilayer.

cond-mat.mtrl-sci↗

Scalarizations of magnetized Reissner-Nordström black holes induced by parity-violating and parity-preserving interactions

We study spontaneous scalarization of a scalar field in the magnetized Reissner--Nordström spacetime induced by parity-violating and parity-preserving interactions, represented by couplings to the electromagnetic Chern--Simons, gravitational Chern--Simons, and Gauss--Bonnet invariants, respectively. Working in the decoupling limit, we evolve scalar perturbations in the time domain and determine the critical coupling for the onset of tachyonic instability. This allows us to compare, within the same magnetized background, how the external magnetic field affects scalarization induced by parity-violating and parity-preserving interactions. We find that the magnetic field lowers the scalarization threshold in the electromagnetic and gravitational Chern--Simons channels. In the Gauss--Bonnet channel, by contrast, the effect divided into two branches: on the negative-$α$ branch in our convention, corresponding to the standard GB$^{+}$ branch, the magnitude of the critical coupling increases with the magnetic field, whereas on the positive-$α$ branch, corresponding to GB$^{-}$, the critical coupling decreases with the magnetic field but diverges in the limit of vanishing field. The magnetic field also modifies the late-time dynamics and gives rise to Melvin-like modes. When nonlinear couplings are included, the unbounded growth of the linearized theory is replaced by bounded oscillatory evolution. These results show that external magnetic fields affect scalarization induced by parity-violating and parity-preserving interactions in qualitatively different ways, and reveal a pronounced asymmetry between the two Gauss--Bonnet branches.

gr-qc↗

Robust parameter inference for Taiji via time-frequency contrastive learning and normalizing flows

Transient noise artifacts, commonly referred to as glitches, pose a major challenge to parameter inference for space-based gravitational-wave (GW) observations. We develop a glitch-robust amortized inference framework for massive black hole binaries in the Taiji detector configuration by combining conditional normalizing flows, a time-frequency multimodal fusion encoder, and contrastive learning. To enable large-scale training on contaminated data, we further introduce a neural glitch generator that produces high-fidelity synthetic transients at substantially reduced computational cost. Systematic experiments show that, under glitch contamination, the proposed method yields more accurate and better-calibrated posteriors than a conventional Markov Chain Monte Carlo baseline. In ablation studies, the full time-frequency model with contrastive learning performs best overall and remains robust to variations in glitch duration and merger-relative timing. We further show that standard coverage diagnostics alone are insufficient to fully assess posterior fidelity. We therefore complement them with the continuous ranked probability score, which provides a stricter assessment of global distributional agreement in non-ideal GW data. Taken together, these results establish deep-learning-based amortized inference as a promising framework for fast and robust Bayesian parameter estimation in future space-based GW observations.

gr-qc↗