arXiv · 2611.21310
Can AI Mature a Model's Geometry? Training-Free Weight Baking in LLMs
Abstract
Can an AI make a trained language model more mature, in the sense of a better organized latent space, by looking only at the geometry of that space? An analyst model reads a fixed-size digest of topological descriptors of the layers of a frozen target and proposes a transformation, which closed-form ridge regression writes into the feed-forward weights without gradient training. Using lightweight models, 126 runs show that category purity rose on unseen words and sentences, benchmark accuracy stayed within sampling error, and the analyst matched a category-aware heuristic with gentler edits. In a five-model round robin approach, 16 pairs raised purity and four left the target unchanged. The results provide a baseline for future work on LLM-guided, training-free model editing without using raw weights.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Amin Golnari, Saeid Sanei. 2026-11-16. Can AI Mature a Model's Geometry? Training-Free Weight Baking in LLMs. https://searcharxiv.com/abs/2611.21310
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Searcharxiv by Indiciae: BibTeX · RIS.