TY  - RPRT
TI  - How Does Sequence Modeling Architecture Influence Base Capabilities of Pre-trained Language Models? Exploring Key Architecture Design Principles to Avoid Base Capabilities Degradation
AU  - Xin Lu
AU  - Yanyan Zhao
AU  - Si Wei
AU  - Shijin Wang
AU  - Bing Qin
AU  - Ting Liu
PY  - 2025
UR  - https://arxiv.org/abs/2505.18522
ID  - 2505.18522
ER  -