Searcharxiv⌕ Search

arXiv subjects

Zhangqi Pan

Publications and source records attributed to Zhangqi Pan.

2 recordsLinked to original sources

A Note on n-Representations of Simplicial Groups

For $n\ge1$, we study representations of a simplicial group $G$ in the full $\infty$-subcategory of simplicial vector spaces whose normalized homology is concentrated in degrees $0,\ldots,n-1$, retaining its full mapping spaces. The resulting functor category depends only on the $n$-truncated homotopy type of $\mathbf{B}G$ and admits projectively bifibrant strict diagram and simplicial group-algebra module models. If restriction along a specified map $f:G\to H$ is an equivalence, then $π_0(f)$ is a group isomorphism; the proof uses ordinary extension and restriction of scalars. Yet for every $n\ge2$ and prime $q$ invertible in $k$, the nontrivial source $K(\mathbb Z/q,n-1)$ has the same $n$-representation category with vertex evaluation as the trivial group. The group-algebra augmentation is a weak equivalence, so the constant functor is also an equivalence for untruncated representations. Thus $n$-representations depend only on the $n$-truncation of $\mathbf{B}G$, but need not determine that truncation, even together with vertex evaluation.

math.AT↗

ChainLoRA: Geometry-Preserving Task Vector Merging for Continual Learning in LLMs

Continual parameter-efficient fine-tuning for large language models (LLMs) must balance retention of previously acquired knowledge, adaptation to new tasks, and strict parameter budgets. We present \textbf{ChainLoRA}, a replay-free continual merging framework built on chain-updated task-vector geometry. From a parameter-merging perspective, we formulate a geometric view of forgetting through a measurable interaction between task updates, separating directional overlap from coefficient coupling. Building on this view, ChainLoRA combines chain-updated training with post-stream adaptive SVD merging. During training, initialization and a one-sided orthogonality proxy use only the last carrier, keeping their historical-state footprint and regularization overhead constant as the task stream grows. At merging time, Adaptive SVD extracts a shared carrier and aligns it to the latest task through Procrustes adaptation. Our theoretical analysis shows that Procrustes adaptation facilitates geometric approximate separation of shared and task-specific components. The one-sided proxy further bounds inter-task interference. An effective-rank penalty additionally promotes efficient utilization of the task subspace during continual learning. Experiments show that ChainLoRA achieves state-of-the-art performance among the evaluated replay-free methods on the Large and SuperNI benchmarks, while remaining competitive on Standard CL and attaining almost the closest average scores to the evaluated replay-based method across all three benchmarks.

stat.ML↗