TY - RPRT TI - Tokenization as Finite-State Transduction AU - Marco Cognetta AU - Naoaki Okazaki PY - 2024 UR - https://arxiv.org/abs/2410.15696 ID - 2410.15696 ER -