-
Low-Resource Machine Translation Training Curriculum Fit for Low-Resource Languages
Authors:
Garry Kuwanto,
Afra Feyza Akyürek,
Isidora Chara Tourni,
Siyang Li,
Alexander Gregory Jones,
Derry Wijaya
Abstract:
We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of most of the world's languages and the researchers working on these languages. Previously, unsupervised NMT, which employs back-translation (BT) and auto-encodi…
▽ More
We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of most of the world's languages and the researchers working on these languages. Previously, unsupervised NMT, which employs back-translation (BT) and auto-encoding (AE) tasks has been shown barren for low-resource languages. We demonstrate that leveraging comparable data and code-switching as weak supervision, combined with BT and AE objectives, result in remarkable improvements for low-resource languages even when using only modest compute resources. The training curriculum proposed in this work achieves BLEU scores that improve over supervised NMT trained on the same backbone architecture by +12.2 BLEU for English to Gujarati and +3.7 BLEU for English to Kazakh, showcasing the potential of weakly-supervised NMT for the low-resource languages. When trained on supervised data, our training curriculum achieves a new state-of-the-art result on the Somali dataset (BLEU of 29.3 for Somali to English). We also observe that adding more time and GPUs to training can further improve performance, which underscores the importance of reporting compute resource usage in MT research.
△ Less
Submitted 29 November, 2021; v1 submitted 24 March, 2021;
originally announced March 2021.
-
Geomagnetically Induced Currents in the Irish Power Network during Geomagnetic Storms
Authors:
Seán P. Blake,
Peter T. Gallagher,
Alan G. Jones,
Colin Hogg,
Joan Campanyà,
Ciarán Beggan,
Alan W. P. Thomson,
Gemma S. Kelly,
David Bell
Abstract:
Geomagnetically induced currents (GICs) are a well-known terrestrial space weather hazard. They occur in power transmission networks and are known to have adverse effects in both high and mid-latitude countries. Here, we study GICs in the Irish power transmission network (geomagnetic latitude 54.7--58.5$^{\circ}$ N) during five geomagnetic storms (06-07 March 2016, 20-21 December 2015, 17-18 March…
▽ More
Geomagnetically induced currents (GICs) are a well-known terrestrial space weather hazard. They occur in power transmission networks and are known to have adverse effects in both high and mid-latitude countries. Here, we study GICs in the Irish power transmission network (geomagnetic latitude 54.7--58.5$^{\circ}$ N) during five geomagnetic storms (06-07 March 2016, 20-21 December 2015, 17-18 March 2015, 29-31 October 2003 and 13-14 March 1989). We simulate electric fields using a plane wave method together with two ground resistivity models, one of which is derived from magnetotelluric measurements (MT model). We then calculate GICs in the 220, 275 and 400~kV transmission network. During the largest of the storm periods studied, the peak electric field was calculated to be as large as 3.8~V~km\textsuperscript{-1}, with associated GICs of up to 23~A using our MT model. Using our homogenous resistivity model, those peak values were 1.46~V~km\textsuperscript{-1} and 25.8~A. We find that three 400 and 275~kV substations are the most likely locations for the Irish transformers to experience large GICs.
△ Less
Submitted 23 November, 2016;
originally announced November 2016.
-
The relationship between polycyclic aromatic hydrocarbon emission and far-infrared dust emission from NGC 2403 and M83
Authors:
A. G. Jones,
G. J. Bendo,
M. Baes,
M. Boquien,
A. Boselli,
I. De Looze,
J. Fritz,
F. Galliano,
T. M. Hughes,
V. Lebouteiller,
N. Lu,
S. C. Madden,
A. Remy-Ruyer,
M. W. L. Smith,
L. Spinoglio,
A. A. Zijlstra
Abstract:
We examine the relation between polycyclic aromatic hydrocarbon (PAH) emission at 8 microns and far-infrared emission from hot dust grains at 24 microns and from large dust grains at 160 and 250 microns in the nearby spiral galaxies NGC 2403 and M83 using data from the Spitzer Space Telescope and Herschel Space Observatory. We find that the PAH emission in NGC 2403 is better correlated with emissi…
▽ More
We examine the relation between polycyclic aromatic hydrocarbon (PAH) emission at 8 microns and far-infrared emission from hot dust grains at 24 microns and from large dust grains at 160 and 250 microns in the nearby spiral galaxies NGC 2403 and M83 using data from the Spitzer Space Telescope and Herschel Space Observatory. We find that the PAH emission in NGC 2403 is better correlated with emission at 250 microns from dust heated by the diffuse interstellar radiation field (ISRF) and that the 8/250 micron surface brightness ratio is well-correlated with the stellar surface brightness as measured at 3.6 microns. This implies that the PAHs in NGC 2403 are intermixed with cold large dust grains in the diffuse interstellar medium (ISM) and that the PAHs are excited by the diffuse ISRF. In M83, the PAH emission appears more strongly correlated with 160 micron emission originating from large dust grains heated by star forming regions. However, the PAH emission in M83 is low where the 24 micron emission peaks within star forming regions, and enhancements in the 8/160 micron surface brightness ratios appear offset relative to the dust and the star forming regions within the spiral arms. This suggests that the PAHs observed in the 8 micron band are not excited locally within star forming regions but either by light esca** non-axisymmetrically from star forming regions or locally by young, non-photoionising stars that have migrated downstream from the spiral density waves. The results from just these two galaxies show that PAHs may be excited by different stellar populations in different spiral galaxies.
△ Less
Submitted 23 December, 2014;
originally announced December 2014.
-
Direct optical excitation of a fullerene-incarcerated metal ion
Authors:
Mark A G Jones,
Kyriakos Porfyrakis,
G Andrew D Briggs,
Robert A Taylor,
Arzhang Ardavan
Abstract:
The endohedral fullerene Er3N@C80 shows characteristic 1.5 micron photoluminescence at cryogenic temperatures associated with radiative relaxation from the crystal-field split Er3+ 4I13/2 manifold to the 4I15/2 manifold. Previous observations of this luminescence were carried out by photoexcitation of the fullerene cage states leading to relaxation via the ionic states. We present direct non-cag…
▽ More
The endohedral fullerene Er3N@C80 shows characteristic 1.5 micron photoluminescence at cryogenic temperatures associated with radiative relaxation from the crystal-field split Er3+ 4I13/2 manifold to the 4I15/2 manifold. Previous observations of this luminescence were carried out by photoexcitation of the fullerene cage states leading to relaxation via the ionic states. We present direct non-cage-mediated optical interaction with the erbium ion. We have used this interaction to complete a photoluminescence-excitation map of the Er3+ 4I13/2 manifold. This ability to interact directly with the states of an incarcerated ion suggests the possibility of coherently manipulating fullerene qubit states with light.
△ Less
Submitted 20 April, 2006; v1 submitted 18 April, 2006;
originally announced April 2006.
-
Towards a fullerene-based quantum computer
Authors:
Simon C Benjamin,
Arzhang Ardavan,
G Andrew D Briggs,
David A Britz,
Daniel Gunlycke,
John Jefferson,
Mark A G Jones,
David F Leigh,
Brendon W Lovett,
Andrei N Khlobystov,
S A Lyon,
John J L Morton,
Kyriakos Porfyrakis,
Mark R Sambrook,
Alexei M Tyryshkin
Abstract:
Molecular structures appear to be natural candidates for a quantum technology: individual atoms can support quantum superpositions for long periods, and such atoms can in principle be embedded in a permanent molecular scaffolding to form an array. This would be true nanotechnology, with dimensions of order of a nanometre. However, the challenges of realising such a vision are immense. One must i…
▽ More
Molecular structures appear to be natural candidates for a quantum technology: individual atoms can support quantum superpositions for long periods, and such atoms can in principle be embedded in a permanent molecular scaffolding to form an array. This would be true nanotechnology, with dimensions of order of a nanometre. However, the challenges of realising such a vision are immense. One must identify a suitable elementary unit and demonstrate its merits for qubit storage and manipulation, including input / output. These units must then be formed into large arrays corresponding to an functional quantum architecture, including a mechanism for gate operations. Here we report our efforts, both experimental and theoretical, to create such a technology based on endohedral fullerenes or 'buckyballs'. We describe our successes with respect to these criteria, along with the obstacles we are currently facing and the questions that remain to be addressed.
△ Less
Submitted 21 November, 2005;
originally announced November 2005.
