arXiv subjects

Chenghai Li

Publications and source records attributed to Chenghai Li.

4 recordsLinked to original sources

arXiv2026

Bunraku: Turning a Single Illustration into an Editable Live2D Character

Live2D is the dominant 2D character-animation format for anime characters and virtual avatars, representing each character as a stack of RGBA layers driven by per-layer mesh deformation. Despite its wide use in virtual streaming, mobile games, and interactive characters, authoring a Live2D model still demands weeks of manual layer separation, occlusion completion, mesh placement, and keyframing, and no prior generative method produces such a structured asset end-to-end. We present the first system that, from a single illustration, generates all the structured information a Live2D runtime consumes: ordered RGBA layers, a deformation mesh per layer, and the parameter-driven keypose vertex offsets that make the character move. Stage 1 casts layered decomposition as a layered diffusion process under a Live2D-aware organ-level taxonomy, producing an ordered RGBA stack with hidden-region completion. Stage 2 builds a content-conforming triangle mesh for each layer from its alpha channel alone, then predicts the keypose displacement field of all layers jointly: every vertex of every layer is one token, self-attention spans layer boundaries, and each displacement is factorised into a bounded direction and a log-magnitude. Joint rather than independent prediction is what makes the result a coherent character instead of separately plausible parts, and is our largest gain; scaling the network 112x yields none. On 50 held-out characters, under true generation with no teacher forcing, Stage 2 attains a per-vertex direction cosine of 0.768 (median 0.828). Because a layer's mesh derives from its alpha channel, a clothing layer can be re-textured from a natural-language instruction while the mesh and predicted animation are reused byte-for-byte. We further contribute Live2D-Bench, the first standardized benchmark for the task, and an 8,884-model Live2D corpus with layer and animation supervision.

cs.CV↗

arXiv2024

The Information of Large Language Model Geometry

This paper investigates the information encoded in the embeddings of large language models (LLMs). We conduct simulations to analyze the representation entropy and discover a power law relationship with model sizes. Building upon this observation, we propose a theory based on (conditional) entropy to elucidate the scaling law phenomenon. Furthermore, we delve into the auto-regressive structure of LLMs and examine the relationship between the last token and previous context tokens using information theory and regression techniques. Specifically, we establish a theoretical connection between the information gain of new tokens and ridge regression. Additionally, we explore the effectiveness of Lasso regression in selecting meaningful tokens, which sometimes outperforms the closely related attention weights. Finally, we conduct controlled experiments, and find that information is distributed across tokens, rather than being concentrated in specific "meaningful" tokens alone.

cs.LG↗

arXiv2024

Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models

Large Language Models (LLMs) have transformed natural language processing and extended their powerful capabilities to multi-modal domains. As LLMs continue to advance, it is crucial to develop diverse and appropriate metrics for their evaluation. In this paper, we introduce a novel rank-based metric, Diff-eRank, grounded in information theory and geometry principles. Diff-eRank assesses LLMs by analyzing their hidden representations, providing a quantitative measure of how efficiently they eliminate redundant information during training. We demonstrate the applicability of Diff-eRank in both single-modal (e.g., language) and multi-modal settings. For language models, our results show that Diff-eRank increases with model size and correlates well with conventional metrics such as loss and accuracy. In the multi-modal context, we propose an alignment evaluation method based on the eRank, and verify that contemporary multi-modal LLMs exhibit strong alignment performance based on our method. Our code is publicly available at https://github.com/waltonfuture/Diff-eRank.

cs.LG↗

arXiv2022

Local Nonlinear Elastic Response of Extracellular Matrices

Nonlinear stiffening is a ubiquitous property of major types of biopolymers that make up the extracellular matrices (ECM) including collagen, fibrin and basement membrane. Within the ECM, many types of cells such as fibroblasts and cancer cells are known to mechanically stretch their surroundings that locally stiffens the matrix. Although the bulk nonlinear elastic behaviors of these biopolymer networks are well studied, their local mechanical responses remain poorly characterized. Here, to understand how a living cell feels the nonlinear mechanical resistance from the ECM, we mimic the cell-applied local force using optical tweezers; we report that the local stiffening responses in highly nonlinear ECM are significantly weaker than responses found in bulk rheology, across two orders of magnitude of the locally applied force since the onset of stiffening. With a minimal model, we show that a local point force application can induce a stiffened region in the matrix, which expands with increasing magnitude of the point force. Furthermore, we show that this stiffened region behaves as an effective probe upon local loading. The local nonlinear elastic response can be attributed to the nonlinear growth of this effective probe that linearly deforms an increasing portion of the matrix.

cond-mat.soft↗