Kreyòl-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages
Authors:
Nathaniel R. Robinson,
Raj Dabre,
Ammon Shurtz,
Rasul Dent,
Onenamiyi Onesi,
Claire Bizon Monroc,
Loïc Grobol,
Hasan Muhammad,
Ashi Garg,
Naome A. Etori,
Vijay Murari Tiyyala,
Olanrewaju Samuel,
Matthew Dean Stutzman,
Bismarck Bamfo Odoom,
Sanjeev Khudanpur,
Stephen D. Richardson,
Kenton Murray
Abstract:
A majority of language technologies are tailored for a small number of high-resource languages, while relatively many low-resource languages are neglected. One such group, Creole languages, have long been marginalized in academic study, though their speakers could benefit from machine translation (MT). These languages are predominantly used in much of Latin America, Africa and the Caribbean. We pr…
▽ More
A majority of language technologies are tailored for a small number of high-resource languages, while relatively many low-resource languages are neglected. One such group, Creole languages, have long been marginalized in academic study, though their speakers could benefit from machine translation (MT). These languages are predominantly used in much of Latin America, Africa and the Caribbean. We present the largest cumulative dataset to date for Creole language MT, including 14.5M unique Creole sentences with parallel translations -- 11.6M of which we release publicly, and the largest bitexts gathered to date for 41 languages -- the first ever for 21. In addition, we provide MT models supporting all 41 Creole languages in 172 translation directions. Given our diverse dataset, we produce a model for Creole language MT exposed to more genre diversity than ever before, which outperforms a genre-specific Creole MT model on its own benchmark for 26 of 34 translation directions.
△ Less
Submitted 13 May, 2024; v1 submitted 8 May, 2024;
originally announced May 2024.
Fast Population-Based Reinforcement Learning on a Single Machine
Authors:
Arthur Flajolet,
Claire Bizon Monroc,
Karim Beguir,
Thomas Pierrot
Abstract:
Training populations of agents has demonstrated great promise in Reinforcement Learning for stabilizing training, improving exploration and asymptotic performance, and generating a diverse set of solutions. However, population-based training is often not considered by practitioners as it is perceived to be either prohibitively slow (when implemented sequentially), or computationally expensive (if…
▽ More
Training populations of agents has demonstrated great promise in Reinforcement Learning for stabilizing training, improving exploration and asymptotic performance, and generating a diverse set of solutions. However, population-based training is often not considered by practitioners as it is perceived to be either prohibitively slow (when implemented sequentially), or computationally expensive (if agents are trained in parallel on independent accelerators). In this work, we compare implementations and revisit previous studies to show that the judicious use of compilation and vectorization allows population-based training to be performed on a single machine with one accelerator with minimal overhead compared to training a single agent. We also show that, when provided with a few accelerators, our protocols extend to large population sizes for applications such as hyperparameter tuning. We hope that this work and the public release of our code will encourage practitioners to use population-based learning more frequently for their research and applications.
△ Less
Submitted 17 June, 2022;
originally announced June 2022.