TY - RPRT TI - When Does Metadata Conditioning (NOT) Work for Language Model Pre-Training? A Study with Context-Free Grammars AU - Rei Higuchi AU - Ryotaro Kawata AU - Naoki Nishikawa AU - Kazusato Oko AU - Shoichiro Yamaguchi AU - Sosuke Kobayashi AU - Seiya Tokui AU - Kohei Hayashi AU - Daisuke Okanohara AU - Taiji Suzuki PY - 2025 UR - https://arxiv.org/abs/2504.17562 ID - 2504.17562 ER -