TY  - RPRT
TI  - Long Context Pre-Training with Lighthouse Attention
AU  - Bowen Peng
AU  - Subho Ghosh
AU  - Jeffrey Quesnelle
PY  - 2026
UR  - https://arxiv.org/abs/2605.06554
ID  - 2605.06554
ER  -