TY  - RPRT
TI  - How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers
AU  - Xin Lu
AU  - Yanyan Zhao
AU  - Bing Qin
AU  - Liangyu Huo
AU  - Qing Yang
AU  - Dongliang Xu
PY  - 2024
UR  - https://arxiv.org/abs/2403.02436
ID  - 2403.02436
ER  -