TY  - RPRT
TI  - Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers
AU  - Xiuying Wei
AU  - Skander Moalla
AU  - Razvan Pascanu
AU  - Caglar Gulcehre
PY  - 2024
UR  - https://arxiv.org/abs/2406.16450
ID  - 2406.16450
ER  -