TY - RPRT TI - Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Transformers AU - Vukasin Bozic AU - Danilo Dordevic AU - Daniele Coppola AU - Joseph Thommes AU - Sidak Pal Singh PY - 2024 UR - https://arxiv.org/abs/2311.10642 ID - 2311.10642 ER -