Searcharxiv⌕ Search

arXiv subjects

Hui Chen

Publications and source records attributed to Hui Chen.

At least 73 records · Page 4Linked to original sources

Cross-Band Channel Impulse Response Prediction: Leveraging 3.5 GHz Channels for Upper Mid-Band

Accurate cross-band channel prediction is essential for 6G networks, particularly in the upper mid-band (FR3, 7-24 GHz), where penetration loss and blockage are severe. Although ray tracing (RT) provides high-fidelity modeling, it remains computationally intensive, and high-frequency data acquisition is costly. To address these challenges, we propose CIR-UNext, a deep learning framework designed to predict 7 GHz channel impulse responses (CIRs) by leveraging abundant 3.5 GHz CIRs. The framework integrates an RT-based dataset pipeline with attention U-Net (AU-Net) variants for gain and phase prediction. The proposed AU-Net-Aux model achieves a median gain error of 0.58 dB and a phase prediction error of 0.27 rad on unseen complex environments. Furthermore, we extend CIR-UNext into a foundation model, Channel2ComMap, for throughput prediction in MIMO-OFDM systems, demonstrating superior performance compared with existing approaches. Overall, CIR-UNext provides an efficient and scalable solution for cross-band prediction, enabling applications such as localization, beam management, digital twins, and intelligent resource allocation in 6G networks.

cs.IT↗

Vehicular Wireless Positioning -- A Survey

The rapid advancement of connected and autonomous vehicles has driven a growing demand for precise and reliable positioning systems capable of operating in complex environments. Meeting these demands requires an integrated approach that combines multiple positioning technologies, including wireless-based systems, perception-based technologies, and motion-based sensors. This paper presents a comprehensive survey of wireless-based positioning for vehicular applications, with a focus on satellite-based positioning (such as global navigation satellite systems (GNSS) and low-Earth-orbit (LEO) satellites), cellular-based positioning (5G and beyond), and IEEE-based technologies (including Wi-Fi, ultrawideband (UWB), Bluetooth, and vehicle-to-vehicle (V2V) communications). First, the survey reviews a wide range of vehicular positioning use cases, outlining their specific performance requirements. Next, it explores the historical development, standardization, and evolution of each wireless positioning technology, providing an in-depth categorization of existing positioning solutions and algorithms, and identifying open challenges and contemporary trends. Finally, the paper examines sensor fusion techniques that integrate these wireless systems with onboard perception and motion sensors to enhance positioning accuracy and resilience in real-world conditions. This survey thus offers a holistic perspective on the historical foundations, current advancements, and future directions of wireless-based positioning for vehicular applications, addressing a critical gap in the literature.

eess.SP↗

UniAttn: Reducing Inference Costs via Softmax Unification for Post-Training LLMs

Post-training is essential for adapting Large Language Models (LLMs) to real-world applications. Deploying post-trained models faces significant challenges due to substantial memory overhead and noticeable inference latency. Existing work has identified significant redundancies in LLMs and proposed efficient architectures, namely intra-layer KV sharing and cross-layer KV sharing. However, these methods still result in high inference time overhead, remaining suboptimal for post-training pre-trained LLMs. In this paper, we identify that the \texttt{Softmax} operation is a primary bottleneck for LLM inference and discover that it is actually highly redundant during post-training. We propose Softmax \textbf{Uni}fication in \textbf{Att}e\textbf{n}tion (\textbf{UniAttn}), a novel post-training method that unifies Softmax activations across transformer blocks to reduce LLM inference costs. Additionally, UniAttn adopts a linear projection to compensate for the errors induced by Softmax unification. Experiments show that UniAttn matches the performance of standard post-training while significantly reducing inference costs, outperforming existing efficient architectures during post-training.

cs.CL↗

MiLe Loss: a New Entropy-Weighed Loss for Mitigating the Bias of Learning Difficulties in Large Language Models

Generative language models are usually pretrained on large text corpus via predicting the next token (i.e., sub-word/word/phrase) given the previous ones. Recent works have demonstrated the impressive performance of large generative language models on downstream tasks. However, existing generative language models generally neglect an inherent challenge in text corpus during training, i.e., the imbalance between frequent tokens and infrequent ones. It can lead a language model to be dominated by common and easy-to-learn tokens, thereby overlooking the infrequent and difficult-to-learn ones. To alleviate that, we propose a MiLe Loss function for mitigating the bias of learning difficulties with tokens. During training, it can dynamically assess the learning difficulty of a to-be-learned token, according to the information entropy of the corresponding predicted probability distribution over the vocabulary. Then it scales the training loss adaptively, trying to lead the model to focus more on the difficult-to-learn tokens. On the Pile dataset, we train generative language models at different scales of 468M, 1.2B, and 6.7B parameters. Experiments reveal that models incorporating the proposed MiLe Loss can gain consistent performance improvement on downstream benchmarks.

cs.CL↗

RSATalker: Realistic Socially-Aware Talking Head Generation for Multi-Turn Conversation

Talking head generation is increasingly important in virtual reality (VR), especially for social scenarios involving multi-turn conversation. Existing approaches face notable limitations: mesh-based 3D methods can model dual-person dialogue but lack realistic textures, while large-model-based 2D methods produce natural appearances but incur prohibitive computational costs. Recently, 3D Gaussian Splatting (3DGS) based methods achieve efficient and realistic rendering but remain speaker-only and ignore social relationships. We introduce RSATalker, the first framework that leverages 3DGS for realistic and socially-aware talking head generation with support for multi-turn conversation. Our method first drives mesh-based 3D facial motion from speech, then binds 3D Gaussians to mesh facets to render high-fidelity 2D avatar videos. To capture interpersonal dynamics, we propose a socially-aware module that encodes social relationships, including blood and non-blood as well as equal and unequal, into high-level embeddings through a learnable query mechanism. We design a three-stage training paradigm and construct the RSATalker dataset with speech-mesh-image triplets annotated with social relationships. Extensive experiments demonstrate that RSATalker achieves state-of-the-art performance in both realism and social awareness. The code and dataset will be released.

cs.CV↗

Electronic procrystalline state in moire structures

Solid state materials can display varieties of atomic structural orders ranging from crystalline to amorphous, underlying their properties and diverse functionalities. Procrystal has emerged as a new category of solids, featuring a long-range ordered lattice framework tiled with disordered atomic or molecular structures on the lattice sites, arousing great interest due to its novel structural and physical properties. However, the electronic analogue of a procrystal, dubbed as an electronic procrystalline (EPC) state, has never been experimentally observed. Here, we report the observation of an EPC state in a moire superstructure formed between a monolayer metallic NiTe2 and a superconductor NbSe2 with incommensurate lattice wavevectors. The observed EPC state exhibits a long-range periodic charge modulation at the moire scale inlaid with short-range irregular orders within each moire cell. Strikingly, the short-range charge orders inside the moire unit cells have proximately root3*root3 quasi-period, which is absent in pristine NiTe2. Intriguingly, the EPC order is also observed in the superconducting state of the moire superstructure. Furthermore, the emergent EPC state and short-range charge order, coexisting with the proximity induced superconductivity, can be precisely modulated with the thickness of NiTe2. Our findings uncover the potential of moire platform for understanding and tuning novel correlated quantum phases with this exotic procrystalline order.

cond-mat.mtrl-sci↗

Evolution from three-dimensional charge density wave to one-dimensional stripe order in CsV$_{3-x}$Ti$_x$Sb$_5$

Understanding intertwined phases near quantum criticality is a central challenge in correlated electron systems. The kagome metal CsV$_{3-x}$Ti$_x$Sb$_5$ provides a fertile platform to investigate the interplay between charge-density-wave (CDW) and superconductivity. Here, combining x-ray diffraction (XRD) and scanning tunneling microscopy (STM), we uncover a dimensional evolution of the CDW upon Ti substitution. We find that even infinitesimal Ti doping (x = 0.009) completely suppresses the three-dimensional 2 $\times$ 2 $\times$ 4 CDW present in pristine CsV3Sb5, while reducing the remaining 2 $\times$ 2 $\times$ 2 CDW to a quasi-two-dimensional order. With further Ti substitution, although no CDW transition is discernible in resistivity measurements, our XRD and STM data reveal the emergence of a (quasi-)one-dimensional CDW with a short correlation length of $\sim$ 20 $Å$ at x = 0.2. The stripelike CDW undergoes a continuous second-order phase transition, characterized by a gradual increase in intensity and correlation length below $\sim$ 56 K. Our results elucidate the dimensional evolution of CDW order in CsV$_{3-x}$Ti$_x$Sb$_5$ and provide new insight into understanding the unconventional CDWs and their role in kagome superconductors.

cond-mat.str-el↗

Efficient Deep Learning Infrastructures for Embedded Computing Systems: A Comprehensive Survey and Future Envision

Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object detection, tracking, and segmentation. However, previous well-established DNNs, despite being able to maintain superior accuracy, have also been evolving to be deeper and wider and thus inevitably necessitate prohibitive computational resources for both training and inference. This trend further enlarges the computational gap between computation-intensive DNNs and resource-constrained embedded computing systems, making it challenging to deploy powerful DNNs upon real-world embedded computing systems towards ubiquitous embedded intelligence. To alleviate the above computational gap and enable ubiquitous embedded intelligence, we, in this survey, focus on discussing recent efficient deep learning infrastructures for embedded computing systems, spanning from training to inference, from manual to automated, from convolutional neural networks to transformers, from transformers to vision transformers, from vision models to large language models, from software to hardware, and from algorithms to applications. Specifically, we discuss recent efficient deep learning infrastructures for embedded computing systems from the lens of (1) efficient manual network design for embedded computing systems, (2) efficient automated network design for embedded computing systems, (3) efficient network compression for embedded computing systems, (4) efficient on-device learning for embedded computing systems, (5) efficient large language models for embedded computing systems, (6) efficient deep learning software and hardware for embedded computing systems, and (7) efficient intelligent applications for embedded computing systems.

cs.LG↗

OOCO: Latency-disaggregated Architecture for Online-Offline Co-locate LLM Serving

Large Language Models (LLMs) are increasingly deployed in both latency-sensitive online services and cost-sensitive offline workloads. Co-locating these workloads on shared serving instances can improve resource utilization, but directly applying this approach to Prefill/Decode (P/D) disaggregated systems introduces severe load imbalance, as fluctuating request mixes alter the intrinsic P/D ratio. Existing dynamic adjustment techniques cannot keep up with the bursty traffic patterns of online services. We propose a latency-constraint disaggregated architecture, which separates cluster resources into latency-strict and latency-relaxed pools based on task latency requirements. This design enables flexible placement of offline decode tasks, mitigating P/D imbalance while preserving online performance. To fully exploit this flexibility, we propose (1) a bottleneck-based scheduler guided by a Roofline-based performance model for performance bottleneck based scheduling, and (2) a fast preemption mechanism that strictly enforces Service Level Objectives (SLOs) for online requests. Experiments on real-world traces show that compared to existing offline system approaches, our method improves offline throughput by up to 3x, while maintaining online request SLOs.

cs.DC↗

Digital Twin-Assisted High-Precision Massive MIMO Localization in Urban Canyons

High-precision wireless localization in urban canyons is challenged by noisy measurements and severe non-line-of-sight (NLOS) propagation. This paper proposes a robust three-stage algorithm synergizing a digital twin (DT) model with the random sample consensus (RANSAC) algorithm to overcome these limitations. The method leverages the DT for geometric path association and employs RANSAC to identify reliable line-of-sight (LOS) and single-bounce NLOS paths while rejecting multi-bounce outliers. A final optimization on the resulting inlier set estimates the user's position and clock bias. Simulations validate that by effectively turning NLOS paths into valuable geometric information via the DT, the approach enables accurate localization, reduces reliance on direct LOS, and significantly lowers system deployment costs, making it suitable for practical deployment.

eess.SP↗

The parent state in kagome metals and superconductors: Chiral-nematic Fermi liquid state

The kagome metals and superconductors hosting rich correlated and topological electronic states have captivated quantum materials research. These states are triggered by an unconventional chiral charge density wave (CDW) wherein a chiral superconductivity emerges at low temperatures, yet the origin of this chiral CDW order, the parent state, is unresolved. Here, we report the discovery of a parent chiral-nematic Fermi liquid state in kagome metals and superconductors. We use spectroscopic-imaging scanning tunneling microscopy to study Ti-doped CsV3Sb5 where the CDW is suppressed, and find that multiorbital Fermi surfaces break all mirror reflections and exhibit handedness. We observe the chiral low-energy quasiparticle dispersions, providing direct evidence for a chiral-nematic electronic structure. We further observe the direct transition from the parent state to a chiral-nematic superconducting state. Moreover, in the samples with chiral CDW, we also observe the residual chiral-nematic QPI features, demonstrating that the CDW-triggered exotic states descend from the chiral-nematic Fermi liquid. Our findings not only provide a plausible chiral-nematic parent state, but also establish a new conceptual framework for exploring the emergence and consequences of such exotic quantum phases.

cond-mat.supr-con↗

Tuning Bound States of Symmetry-Breaking Vortices via Unidirectional Charge Density Wave in a Transition-Metal Dichalcogenide Superconductor

The interplay between charge density wave (CDW) and superconducting vortex bound states are crucial for fundamental physics of superconductivity and advancing quantum nanotechnologies. However, the CDW-mediated modulation of vortex bound states, which opens up a new platform for vortex engineering, remains unexplored. Here, we report spatially anisotropic vortex states modulated by the unidirectional CDWs in a transition-metal dichalcogenide superconductor 1T''-NbTe2 using ultra-low-temperature scanning tunneling microscopy/spectroscopy. The stripe-like 3x1x3 CDW order exhibits a robust three-dimensional character across step edges and coexists with superconductivity below a critical temperature of 0.4 K. Under out-of-plane magnetic fields, we observe elliptical vortices whose elongation aligns with the CDW stripes, indicating strong coupling between vortex morphology and underlying electronic order. Remarkably, CDW domain boundaries induce abrupt changes in vortex orientation and vortex bound states, enabling controllable vortex states across CDW nanodomains. These findings establish a new pathway for manipulating superconducting vortex bound states via CDW coupling.

cond-mat.supr-con↗

Atomic Visualization of Bulk and Surface Superconductivity in Weyl Semimetal γ-PtBi2

A bulk superconductor hosting intrinsic surface superconductivity provides a unique platform to study Majorana bound states. The superconductor, trigonal γ-PtBi2, is a promising candidate, as surface superconducting gaps and topological surface states have been observed. However, the simultaneous presence of bulk and surface superconductivity has not been resolved. Here, we directly visualize coexisting bulk and surface superconducting gaps in trigonal PtBi2 by using ultra-low-temperature scanning tunneling microscopy/spectroscopy. The bulk gap is Δ ~ 0.053 meV with a critical temperature (Tc) ~ 0.5 K and a critical field below 0.01 T, accompanied by a vortex lattice and bound states, yielding a coherence length of ~200 nm. Remarkably, certain surface regions show a much larger gap of Δ ~ 0.42 meV, persisting up to Tc ~ 3 K and surviving magnetic fields up to 2 T, yet lacking a static vortex lattice. This coexistence of robust surface and bulk superconductivity establishes γ-PtBi2 as a unique platform for investigating the interplay between bulk and surface Cooper pairings in superconducting topological materials.

cond-mat.supr-con↗

Recent progress of scanning tunneling microscopy/spectroscopy study of pair density wave in superconductors

A pair density wave (PDW) is a superconducting state characterized by an order parameter with finite center-of-mass momentum in the absence of an external magnetic field, thereby breaking the conventional translational symmetry in homogeneous superconductors. It is proposed that PDW emerges from magnetic interactions, strong electron-electron correlations, and their interplay with competing orders. In this review, we highlight recent advances in the detection and study of PDWs using scanning tunneling microscopy and spectroscopy (STM/STS). We focus on how the signatures of PDW have been experimentally visualized across a variety of extraordinary superconductors, including iron-based superconductors, cuprate superconductors, spin-triplet superconductors, kagome-lattice superconductors, and transition metal dichalcogenides. Beginning with an introduction to the fundamental concept of PDWs and the unique capabilities of STM/STS, particularly its atomic-scale spatial resolution and advanced data analysis techniques, we discuss key experimental findings, including the direct visualization of charge density modulations associated with PDWs. Finally, we discuss emerging challenges and future directions, aiming to inspire future research into the nature of PDWs in superconductors.

cond-mat.supr-con↗

Prevailing orbital excitations in paramagnetic kagome superconductor Cs(V$_{0.95}$Ti$_{0.05}$)$_3$Sb$_5$

Using the muon as a sensitive local magnetic probe, we investigated the layered kagome superconductor Cs(V$_{0.95}$Ti$_{0.05}$)$_3$Sb$_5$, a material notably devoid of both static magnetic moments and long-range charge order. Our transverse-field $μ$SR measurements reveal that the local magnetic susceptibility, obtained via the muon Knight shift, is dominated by orbital excitations with a split energy levels around 20 meV. Meanwhile, the persistence of itinerant electron paramagnetism down to 5 K and 7 T confirms the absence of static magnetism within this regime. In addition, zero-field (ZF) $μ$SR experiments detect a significant increase in the inhomogeneous nuclear dipolar field distribution below a featured temperature at 70 K. We attribute this ZF-$μ$SR feature to the emergence of local lattice distortions at low temperatures, potentially arising from orbital ordering. Significantly, our study establishes that orbital excitations constitute an intrinsic property of the layered V-Sb kagome lattice. Despite its small magnitude, spin-orbit coupling plays a crucial role in governing the lattice dynamics, potentially driving the emergence of novel phenomena such as phonon carrying angular momentum in crystals with non-chiral point groups.

cond-mat.str-el↗

ClaimGen-CN: A Large-scale Chinese Dataset for Legal Claim Generation

Legal claims refer to the plaintiff's demands in a case and are essential to guiding judicial reasoning and case resolution. While many works have focused on improving the efficiency of legal professionals, the research on helping non-professionals (e.g., plaintiffs) remains unexplored. This paper explores the problem of legal claim generation based on the given case's facts. First, we construct ClaimGen-CN, the first dataset for Chinese legal claim generation task, from various real-world legal disputes. Additionally, we design an evaluation metric tailored for assessing the generated claims, which encompasses two essential dimensions: factuality and clarity. Building on this, we conduct a comprehensive zero-shot evaluation of state-of-the-art general and legal-domain large language models. Our findings highlight the limitations of the current models in factual precision and expressive clarity, pointing to the need for more targeted development in this domain. To encourage further exploration of this important task, we will make the dataset publicly available.

cs.CL↗

MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research

Recent advancements in AI agents have demonstrated their growing potential to drive and support scientific discovery. In this work, we introduce MLR-Bench, a comprehensive benchmark for evaluating AI agents on open-ended machine learning research. MLR-Bench includes three key components: (1) 201 research tasks sourced from NeurIPS, ICLR, and ICML workshops covering diverse ML topics; (2) MLR-Judge, an automated evaluation framework combining LLM-based reviewers with carefully designed review rubrics to assess research quality; and (3) MLR-Agent, a modular agent scaffold capable of completing research tasks through four stages: idea generation, proposal formulation, experimentation, and paper writing. Our framework supports both stepwise assessment across these distinct research stages, and end-to-end evaluation of the final research paper. We then use MLR-Bench to evaluate six frontier LLMs and an advanced coding agent, finding that while LLMs are effective at generating coherent ideas and well-structured papers, current coding agents frequently (e.g., in 80% of the cases) produce fabricated or invalidated experimental results--posing a major barrier to scientific reliability. We validate MLR-Judge through human evaluation, showing high agreement with expert reviewers, supporting its potential as a scalable tool for research evaluation. We open-source MLR-Bench to help the community benchmark, diagnose, and improve AI research agents toward trustworthy and transparent scientific discovery.

cs.LG↗

PruneHal: Reducing Hallucinations in Multi-modal Large Language Models through Adaptive KV Cache Pruning

While multi-modal large language models (MLLMs) have made significant progress in recent years, the issue of hallucinations remains a major challenge. To mitigate this phenomenon, existing solutions either introduce additional data for further training or incorporate external or internal information during inference. However, these approaches inevitably introduce extra computational costs. In this paper, we observe that hallucinations in MLLMs are strongly associated with insufficient attention allocated to visual tokens. In particular, the presence of redundant visual tokens disperses the model's attention, preventing it from focusing on the most informative ones. As a result, critical visual cues are often under-attended, which in turn exacerbates the occurrence of hallucinations. Building on this observation, we propose \textbf{PruneHal}, a training-free, simple yet effective method that leverages adaptive KV cache pruning to enhance the model's focus on critical visual information, thereby mitigating hallucinations. To the best of our knowledge, we are the first to apply token pruning for hallucination mitigation in MLLMs. Notably, our method don't require additional training and incurs nearly no extra inference cost. Moreover, PruneHal is model-agnostic and can be seamlessly integrated with different decoding strategies, including those specifically designed for hallucination mitigation. We evaluate PruneHal on several widely used hallucination evaluation benchmarks using four mainstream MLLMs, achieving robust and outstanding results that highlight the effectiveness and superiority of our method. Our code will be publicly available.

cs.CV↗