SearcharxivSearch

arXiv subjects

Zihua Yang

Publications and source records attributed to Zihua Yang.

5 recordsLinked to original sources

GRACE: LLM-Grounded Semantic Metric Spaces for Scalable Mixed-Data Clustering

Clustering mixed tabular data requires a unified metric space to bridge the inherent heterogeneity between continuous numerical measurements and discrete categorical symbols. Traditionally, algorithms rely entirely on dataset-internal statistics to estimate categorical relationships, which confines the learned metric to empirical co-occurrences and ignores conceptually obvious yet statistically unobserved affinities. Although LLMs offer external world knowledge, applying their text-centric reasoning to highly abstract tabular concepts presents significant challenges. Bridging this modality gap to construct a semantically complete metric typically requires embedding LLMs into iterative metric learning loops to dynamically optimize cross-modality representations. This incurs intractable computational overhead, forcing a compromise between semantic enrichment and scalability. Therefore, we propose GRACE, an LLM-grounded framework for scalable mixed-data clustering. GRACE shifts semantic acquisition to the attribute-value level via a multi-perspective LLM querying strategy, mapping heterogeneous values into knowledge-informed descriptions. Crucially, this one-shot grounding extracts general-purpose semantic representations that embed heterogeneous attributes into a unified space, decoupling expensive LLM invocation from iterative optimization. Furthermore, GRACE cross-validates these external semantics against dataset-internal statistical evidence to ensure alignment with the dataset-specific cluster structure. Ultimately, GRACE matches the scalability of conventional statistics-driven baselines while achieving superior clustering accuracy and conceptual interpretability over 11 competing methods. The source code is available at https://github.com/develop-yang/GRACE-GRACE-A

cs.AI

Two-loop Six-point Planar Massless Feynman Integrals to Higher $\epsilon$ Orders

In this work, we calculate two-loop six-point planar massless Feynman integrals at higher orders in the dimensional regulator $\epsilon$, corresponding to higher transcendental weights. In previous works, these integrals were calculated up to weight four for the purpose of two-loop gauge theory amplitudes. Using modern rational reconstruction methods, we identify the complete alphabet with $269$ letters relevant to all weights, derive the analytic canonical differential equation and obtain the symbols up to weight six. As a proof of concept, using a new method with Chebyshev pseudospectral transport, we show that the corresponding pure basis can be efficiently evaluated up to weight six, i.e., to $ \mathcal{O}(\epsilon^2)$ in a physical scattering region. The results of this work can be applied to future three-loop amplitudes and provide new data for the formal study of symbols and cluster algebras.

hep-ph

One-Shot Federated Clustering of Non-Independent Completely Distributed Data

Federated Learning (FL) that extracts data knowledge while protecting the privacy of multiple clients has achieved remarkable results in distributed privacy-preserving IoT systems, including smart traffic flow monitoring, smart grid load balancing, and so on. Since most data collected from edge devices are unlabeled, unsupervised Federated Clustering (FC) is becoming increasingly popular for exploring pattern knowledge from complex distributed data. However, due to the lack of label guidance, the common Non-Independent and Identically Distributed (Non-IID) issue of clients have greatly challenged FC by posing the following problems: How to fuse pattern knowledge (i.e., cluster distribution) from Non-IID clients; How are the cluster distributions among clients related; and How does this relationship connect with the global knowledge fusion? In this paper, a more tricky but overlooked phenomenon in Non-IID is revealed, which bottlenecks the clustering performance of the existing FC approaches. That is, different clients could fragment a cluster, and accordingly, a more generalized Non-IID concept, i.e., Non-ICD (Non-Independent Completely Distributed), is derived. To tackle the above FC challenges, a new framework named GOLD (Global Oriented Local Distribution Learning) is proposed. GOLD first finely explores the potential incomplete local cluster distributions of clients, then uploads the distribution summarization to the server for global fusion, and finally performs local cluster enhancement under the guidance of the global distribution. Extensive experiments, including significance tests, ablation studies, scalability evaluations, qualitative results, etc., have been conducted to show the superiority of GOLD.

cs.LG

Stitch the Fragments: One-Shot Hierarchical Federated Clustering

Federated Clustering (FC) faces a critical bottleneck in real-world scenarios, i.e., global clusters are rarely intact, often fragmenting into incomplete, multi-granular unlabeled ``clusterlets'' distributed across Non-IID clients. Although hierarchical clustering is theoretically well-suited to model such nested distributions, its recursive nature strictly relies on multi-round communication, introducing prohibitive computational overhead and severe privacy vulnerabilities. This paper, therefore, proposes a novel one-shot hierarchical federated clustering framework designed to seamlessly ``stitch'' the fragmented local clusterlets into a holistic global distribution. Our approach enables clients to perform autonomous fine-grained distribution exploration, uploading prototype-level knowledge via a dynamic parameter-interleaving mechanism to scramble transmission trajectories, which effectively prevents the server from tracing individual client data distributions. Subsequently, a multi-granular learning mechanism at the server fuses these granularly inconsistent local clusterlets, reconstructing a coherent global hierarchy for ultimate clustering. Extensive experiments on real benchmark datasets illustrate the superiority of the proposed approach, which effectively bridges the granularity gap among heterogeneous clients while minimizing privacy exposure risks via anonymized informative one-shot communication.

cs.LG

Bridging the Semantic Gap for Categorical Data Clustering via Large Language Models

Qualitative data are widespread in domains such as healthcare, marketing, and bioinformatics, where clustering offers a fundamental tool for pattern discovery. A core difficulty of qualitative-data clustering lies in measuring similarity among attribute values that carry no inherent ordering or distance. To recover such relationships, existing studies typically rely on within-dataset co-occurrence statistics. This statistical route, however, becomes unreliable once the sample size is small, and the semantic context of each value is therefore left underexploited. Motivated by this limitation, this paper proposes BREVE (Balanced Representation via External Value Enrichment), a clustering framework that enriches each qualitative value with extra semantic dimensions drawn from an external knowledge base. That is, every unique value is expanded by a dense embedding that encodes its semantic content. To prevent the original value identity from being diluted by the added dimensions, a lightweight one-hot component is further appended. An adaptive weight, guided by cluster compactness, then determines how strongly the enrichment dimensions enter the final representation. With this design, experiments on eight benchmark datasets yield an average ARI rank of 1.3 against seven representative competitors.

cs.LG