TY  - RPRT
TI  - DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models
AU  - Sam Ade Jacobs
AU  - Masahiro Tanaka
AU  - Chengming Zhang
AU  - Minjia Zhang
AU  - Shuaiwen Leon Song
AU  - Samyam Rajbhandari
AU  - Yuxiong He
PY  - 2023
UR  - https://arxiv.org/abs/2309.14509
ID  - 2309.14509
ER  -