TY  - RPRT
TI  - CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending
AU  - Shiyi Zhu
AU  - Jing Ye
AU  - Wei Jiang
AU  - Siqiao Xue
AU  - Qi Zhang
AU  - Yifan Wu
AU  - Jianguo Li
PY  - 2024
UR  - https://arxiv.org/abs/2309.08646
ID  - 2309.08646
ER  -