TY  - RPRT
TI  - Most Transformer Modifications Still Do Not Transfer at 1-3B: A 2020-2026 Update to Narang et al. (2021) with Downstream Evaluation and a Noise Floor
AU  - Yang Zhao
AU  - Jiahao Lu
AU  - Bin Huang
AU  - Guhua Zhang
AU  - Jie Zhou
PY  - 2026
UR  - https://arxiv.org/abs/2605.20798
ID  - 2605.20798
ER  -