TY - RPRT TI - Mixture-of-Depths: Dynamically allocating compute in transformer-based language models AU - David Raposo AU - Sam Ritter AU - Blake Richards AU - Timothy Lillicrap AU - Peter Conway Humphreys AU - Adam Santoro PY - 2024 UR - https://arxiv.org/abs/2404.02258 ID - 2404.02258 ER -