TY  - RPRT
TI  - How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese
AU  - Takuro Fujii
AU  - Koki Shibata
AU  - Atsuki Yamaguchi
AU  - Terufumi Morishita
AU  - Yasuhiro Sogawa
PY  - 2023
UR  - https://arxiv.org/abs/2306.09572
ID  - 2306.09572
ER  -