Showing 1–3 of 3 results for author: Biesialska, K

Continual Lifelong Learning in Natural Language Processing: A Survey

Authors: Magdalena Biesialska, Katarzyna Biesialska, Marta R. Costa-jussà

Abstract: Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously acquired knowledge. Furthermore, CL is particularly challenging for language learning, as natural language is ambiguous: it is discrete, compositional, and its meani… ▽ More Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously acquired knowledge. Furthermore, CL is particularly challenging for language learning, as natural language is ambiguous: it is discrete, compositional, and its meaning is context-dependent. In this work, we look at the problem of CL through the lens of various NLP tasks. Our survey discusses major challenges in CL and current methods applied in neural network models. We also provide a critical review of the existing CL evaluation methods and datasets in NLP. Finally, we present our outlook on future research directions. △ Less

Submitted 17 December, 2020; originally announced December 2020.

Comments: COLING 2020

Journal ref: Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020), Barcelona, Spain (Online), pp. 6523--6541

Sentiment Analysis with Contextual Embeddings and Self-Attention

Authors: Katarzyna Biesialska, Magdalena Biesialska, Henryk Rybinski

Abstract: In natural language the intended meaning of a word or phrase is often implicit and depends on the context. In this work, we propose a simple yet effective method for sentiment analysis using contextual embeddings and a self-attention mechanism. The experimental results for three languages, including morphologically rich Polish and German, show that our model is comparable to or even outperforms st… ▽ More In natural language the intended meaning of a word or phrase is often implicit and depends on the context. In this work, we propose a simple yet effective method for sentiment analysis using contextual embeddings and a self-attention mechanism. The experimental results for three languages, including morphologically rich Polish and German, show that our model is comparable to or even outperforms state-of-the-art models. In all cases the superiority of models leveraging contextual embeddings is demonstrated. Finally, this work is intended as a step towards introducing a universal, multilingual sentiment classifier. △ Less

Submitted 5 October, 2020; v1 submitted 11 March, 2020; originally announced March 2020.

Comments: Accepted at the 25th International Symposium on Methodologies for Intelligent Systems (ISMIS 2020)

Protocol and Tools for Conducting Agile Software Engineering Research in an Industrial-Academic Setting: A Preliminary Study

Authors: Katarzyna Biesialska, Xavier Franch, Victor Muntés-Mulero

Abstract: Conducting empirical research in software engineering industry is a process, and as such, it should be generalizable. The aim of this paper is to discuss how academic researchers may address some of the challenges they encounter during conducting empirical research in the software industry by means of a systematic and structured approach. The protocol developed in this paper should serve as a prac… ▽ More Conducting empirical research in software engineering industry is a process, and as such, it should be generalizable. The aim of this paper is to discuss how academic researchers may address some of the challenges they encounter during conducting empirical research in the software industry by means of a systematic and structured approach. The protocol developed in this paper should serve as a practical guide for researchers and help them with conducting empirical research in this complex environment. △ Less

Submitted 10 April, 2018; originally announced April 2018.

Comments: Accepted to CESI 2018 - International Workshop on Conducting Empirical Studies in Industry (in conjunction with ICSE 2018)

Journal ref: 2018 IEEE/ACM 6th International Workshop on Conducting Empirical Studies in Industry (CESI), Gothenburg, 2018, pp. 29-32