arXiv · 2412.05708
On the effective transfer of knowledge from English to Hindi Wikipedia
Abstract
Although Wikipedia is the largest multilingual encyclopedia, it remains inherently incomplete. There is a significant disparity in the quality of content between high-resource languages (HRLs, e.g., English) and low-resource languages (LRLs, e.g., Hindi), with many LRL articles lacking adequate information. To bridge these content gaps, we propose a lightweight framework to enhance knowledge equity between English and Hindi. In case the English Wikipedia page is not up-to-date, our framework extracts relevant information from external resources readily available (such as English books) and adapts it to align with Wikipedia's distinctive style, including its \textit{neutral point of view} (NPOV) policy, using in-context learning capabilities of large language models. The adapted content is then machine-translated into Hindi for integration into the corresponding Wikipedia articles. On the other hand, if the English version is comprehensive and up-to-date, the framework directly transfers knowledge from English to Hindi. Our framework effectively generates new content for Hindi Wikipedia sections, enhancing Hindi Wikipedia articles respectively by 65% and 62% according to automatic and human judgment-based evaluations.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Paramita Das, Amartya Roy, Ritabrata Chakraborty, Animesh Mukherjee. 2024-12-07. On the effective transfer of knowledge from English to Hindi Wikipedia. https://arxiv.org/abs/2412.05708
Cite the original work for its findings. Save a collection to share your selection of sources.