TY - RPRT TI - Escaping the Gradient Vanishing: Periodic Alternatives of Softmax in Attention Mechanism AU - Shulun Wang AU - Bin Liu AU - Feng Liu PY - 2021 UR - https://arxiv.org/abs/2108.07153 ID - 2108.07153 ER -