arXiv · 2012.06143
Document-aligned Japanese-English Conversation Parallel Corpus
Abstract
Sentence-level (SL) machine translation (MT) has reached acceptable quality for many high-resourced languages, but not document-level (DL) MT, which is difficult to 1) train with little amount of DL data; and 2) evaluate, as the main methods and data sets focus on SL evaluation. To address the first issue, we present a document-aligned Japanese-English conversation corpus, including balanced, high-quality business conversation data for tuning and testing. As for the second issue, we manually identify the main areas where SL MT fails to produce adequate translations in lack of context. We then create an evaluation set where these phenomena are annotated to alleviate automatic evaluation of DL systems. We train MT models using our corpus to demonstrate how using context leads to improvements.
Explore related subjects
Keep this discovery
Matīss Rikters, Ryokan Ri, Tong Li, Toshiaki Nakazawa. 2020-12-11. Document-aligned Japanese-English Conversation Parallel Corpus. https://arxiv.org/abs/2012.06143
Cite the original work for its findings. Save a collection to share your selection of sources.