-
SpokesBiz -- an Open Corpus of Conversational Polish
Authors:
Piotr Pęzik,
Sylwia Karasińska,
Anna Cichosz,
Łukasz Jałowiecki,
Konrad Kaczyński,
Małgorzata Krawentek,
Karolina Walkusz,
Paweł Wilk,
Mariusz Kleć,
Krzysztof Szklanny,
Szymon Marszałkowski
Abstract:
This paper announces the early release of SpokesBiz, a freely available corpus of conversational Polish developed within the CLARIN-BIZ project and comprising over 650 hours of recordings. The transcribed recordings have been diarized and manually annotated for punctuation and casing. We outline the general structure and content of the corpus, showcasing selected applications in linguistic researc…
▽ More
This paper announces the early release of SpokesBiz, a freely available corpus of conversational Polish developed within the CLARIN-BIZ project and comprising over 650 hours of recordings. The transcribed recordings have been diarized and manually annotated for punctuation and casing. We outline the general structure and content of the corpus, showcasing selected applications in linguistic research, evaluation and improvement of automatic speech recognition (ASR) systems
△ Less
Submitted 19 December, 2023;
originally announced December 2023.
-
Keyword Extraction from Short Texts with a Text-To-Text Transfer Transformer
Authors:
Piotr Pęzik,
Agnieszka Mikołajczyk-Bareła,
Adam Wawrzyński,
Bartłomiej Nitoń,
Maciej Ogrodniczuk
Abstract:
The paper explores the relevance of the Text-To-Text Transfer Transformer language model (T5) for Polish (plT5) to the task of intrinsic and extrinsic keyword extraction from short text passages. The evaluation is carried out on the new Polish Open Science Metadata Corpus (POSMAC), which is released with this paper: a collection of 216,214 abstracts of scientific publications compiled in the CURLI…
▽ More
The paper explores the relevance of the Text-To-Text Transfer Transformer language model (T5) for Polish (plT5) to the task of intrinsic and extrinsic keyword extraction from short text passages. The evaluation is carried out on the new Polish Open Science Metadata Corpus (POSMAC), which is released with this paper: a collection of 216,214 abstracts of scientific publications compiled in the CURLICAT project. We compare the results obtained by four different methods, i.e. plT5kw, extremeText, TermoPL, KeyBERT and conclude that the plT5kw model yields particularly promising results for both frequent and sparsely represented keywords. Furthermore, a plT5kw keyword generation model trained on the POSMAC also seems to produce highly useful results in cross-domain text labelling scenarios. We discuss the performance of the model on news stories and phone-based dialog transcripts which represent text genres and domains extrinsic to the dataset of scientific abstracts. Finally, we also attempt to characterize the challenges of evaluating a text-to-text model on both intrinsic and extrinsic keyword extraction.
△ Less
Submitted 17 October, 2022; v1 submitted 28 September, 2022;
originally announced September 2022.
-
Joint prediction of truecasing and punctuation for conversational speech in low-resource scenarios
Authors:
Raghavendra Pappagari,
Piotr Żelasko,
Agnieszka Mikołajczyk,
Piotr Pęzik,
Najim Dehak
Abstract:
Capitalization and punctuation are important cues for comprehending written texts and conversational transcripts. Yet, many ASR systems do not produce punctuated and case-formatted speech transcripts. We propose to use a multi-task system that can exploit the relations between casing and punctuation to improve their prediction performance. Whereas text data for predicting punctuation and truecasin…
▽ More
Capitalization and punctuation are important cues for comprehending written texts and conversational transcripts. Yet, many ASR systems do not produce punctuated and case-formatted speech transcripts. We propose to use a multi-task system that can exploit the relations between casing and punctuation to improve their prediction performance. Whereas text data for predicting punctuation and truecasing is seemingly abundant, we argue that written text resources are inadequate as training data for conversational models. We quantify the mismatch between written and conversational text domains by comparing the joint distributions of punctuation and word cases, and by testing our model cross-domain. Further, we show that by training the model in the written text domain and then transfer learning to conversations, we can achieve reasonable performance with less data.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
