arXiv · 2601.05560
ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging
Abstract
Large Reasoning Models (LRMs) with long chain-of-thought reasoning have recently achieved remarkable success. Yet, equipping domain-specialized models with such reasoning capabilities, referred to as "Reasoning + X", remains a significant challenge. While model merging offers a promising training-free solution, existing methods often suffer from a destructive performance collapse: existing methods tend to both weaken reasoning depth and compromise domain-specific utility. Interestingly, we identify a counter-intuitive phenomenon underlying this failure: reasoning ability predominantly resides in parameter regions with low gradient sensitivity, contrary to the common assumption that domain capabilities correspond to high-magnitude parameters. Motivated by this insight, we propose ReasonAny, a novel merging framework that resolves the reasoning-domain performance collapse through Contrastive Gradient Identification. Experiments across safety, biomedicine, and finance domains show that ReasonAny effectively synthesizes "Reasoning + X" capabilities, significantly outperforming state-of-the-art baselines while retaining robust reasoning performance.
Explore related subjects
Keep this discovery
Junyao Yang, Chen Qian, Dongrui Liu, Wen Shen, Yong Liu, Jing Shao. 2026-01-09. ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging. https://arxiv.org/abs/2601.05560
Cite the original work for its findings. Save a collection to share your selection of sources.