TY  - RPRT
TI  - Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance
AU  - Omer Goldman
AU  - Avi Caciularu
AU  - Matan Eyal
AU  - Kris Cao
AU  - Idan Szpektor
AU  - Reut Tsarfaty
PY  - 2024
UR  - https://arxiv.org/abs/2403.06265
ID  - 2403.06265
ER  -