TY  - RPRT
TI  - Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition
AU  - Jiyeon Kim
AU  - Hyunji Lee
AU  - Hyowon Cho
AU  - Joel Jang
AU  - Hyeonbin Hwang
AU  - Seungpil Won
AU  - Youbin Ahn
AU  - Dohaeng Lee
AU  - Minjoon Seo
PY  - 2025
UR  - https://arxiv.org/abs/2410.01380
ID  - 2410.01380
ER  -