Showing 1–2 of 2 results for author: Khvalchik, M
-
El Departamento de Nosotros: How Machine Translated Corpora Affects Language Models in MRC Tasks
Authors:
Maria Khvalchik,
Mikhail Galkin
Abstract:
Pre-training large-scale language models (LMs) requires huge amounts of text corpora. LMs for English enjoy ever growing corpora of diverse language resources. However, less resourced languages and their mono- and multilingual LMs often struggle to obtain bigger datasets. A typical approach in this case implies using machine translation of English corpora to a target language. In this work, we stu…
▽ More
Pre-training large-scale language models (LMs) requires huge amounts of text corpora. LMs for English enjoy ever growing corpora of diverse language resources. However, less resourced languages and their mono- and multilingual LMs often struggle to obtain bigger datasets. A typical approach in this case implies using machine translation of English corpora to a target language. In this work, we study the caveats of applying directly translated corpora for fine-tuning LMs for downstream natural language processing tasks and demonstrate that careful curation along with post-processing lead to improved performance and overall LMs robustness. In the empirical evaluation, we perform a comparison of directly translated against curated Spanish SQuAD datasets on both user and system levels. Further experimental results on XQuAD and MLQA transfer-learning evaluation question answering tasks show that presumably multilingual LMs exhibit more resilience to machine translation artifacts in terms of the exact match score.
△ Less
Submitted 3 July, 2020;
originally announced July 2020.
-
Orchestrating NLP Services for the Legal Domain
Authors:
Julián Moreno-Schneider,
Georg Rehm,
Elena Montiel-Ponsoda,
Víctor Rodriguez-Doncel,
Artem Revenko,
Sotirios Karampatakis,
Maria Khvalchik,
Christian Sageder,
Jorge Gracia,
Filippo Maganza
Abstract:
Legal technology is currently receiving a lot of attention from various angles. In this contribution we describe the main technical components of a system that is currently under development in the European innovation project Lynx, which includes partners from industry and research. The key contribution of this paper is a workflow manager that enables the flexible orchestration of workflows based…
▽ More
Legal technology is currently receiving a lot of attention from various angles. In this contribution we describe the main technical components of a system that is currently under development in the European innovation project Lynx, which includes partners from industry and research. The key contribution of this paper is a workflow manager that enables the flexible orchestration of workflows based on a portfolio of Natural Language Processing and Content Curation services as well as a Multilingual Legal Knowledge Graph that contains semantic information and meaningful references to legal documents. We also describe different use cases with which we experiment and develop prototypical solutions.
△ Less
Submitted 28 March, 2020;
originally announced March 2020.
