TY  - RPRT
TI  - Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models
AU  - Zhisong Zhang
AU  - Yan Wang
AU  - Xinting Huang
AU  - Tianqing Fang
AU  - Hongming Zhang
AU  - Chenlong Deng
AU  - Shuaiyi Li
AU  - Dong Yu
PY  - 2025
UR  - https://arxiv.org/abs/2412.16545
ID  - 2412.16545
ER  -