Showing 1–1 of 1 results for author: Bartley, T M
-
Accidental Learners: Spoken Language Identification in Multilingual Self-Supervised Models
Authors:
Travis M. Bartley,
Fei Jia,
Krishna C. Puvvada,
Samuel Kriman,
Boris Ginsburg
Abstract:
In this paper, we extend previous self-supervised approaches for language identification by experimenting with Conformer based architecture in a multilingual pre-training paradigm. We find that pre-trained speech models optimally encode language discriminatory information in lower layers. Further, we demonstrate that the embeddings obtained from these layers are significantly robust to classify un…
▽ More
In this paper, we extend previous self-supervised approaches for language identification by experimenting with Conformer based architecture in a multilingual pre-training paradigm. We find that pre-trained speech models optimally encode language discriminatory information in lower layers. Further, we demonstrate that the embeddings obtained from these layers are significantly robust to classify unseen languages and different acoustic environments without additional training. After fine-tuning a pre-trained Conformer model on the VoxLingua107 dataset, we achieve results similar to current state-of-the-art systems for language identification. More, our model accomplishes this with 5x less parameters. We open-source the model through the NVIDIA NeMo toolkit.
△ Less
Submitted 13 March, 2023; v1 submitted 9 November, 2022;
originally announced November 2022.
