TY - RPRT TI - Mixed Sparsity Training: Achieving 4$\times$ FLOP Reduction for Transformer Pretraining AU - Pihe Hu AU - Shaolong Li AU - Longbo Huang PY - 2024 UR - https://arxiv.org/abs/2408.11746 ID - 2408.11746 ER -