TY  - RPRT
TI  - Evaluating Subword Tokenization: Alien Subword Composition and OOV Generalization Challenge
AU  - Khuyagbaatar Batsuren
AU  - Ekaterina Vylomova
AU  - Verna Dankers
AU  - Tsetsuukhei Delgerbaatar
AU  - Omri Uzan
AU  - Yuval Pinter
AU  - Gábor Bella
PY  - 2024
UR  - https://arxiv.org/abs/2404.13292
ID  - 2404.13292
ER  -