Showing 1–1 of 1 results for author: Sabelja, J
-
Estimating class separability of text embeddings with persistent homology
Authors:
Kostis Gourgoulias,
Najah Ghalyan,
Maxime Labonne,
Yash Satsangi,
Sean Moran,
Joseph Sabelja
Abstract:
This paper introduces an unsupervised method to estimate the class separability of text datasets from a topological point of view. Using persistent homology, we demonstrate how tracking the evolution of embedding manifolds during training can inform about class separability. More specifically, we show how this technique can be applied to detect when the training process stops improving the separab…
▽ More
This paper introduces an unsupervised method to estimate the class separability of text datasets from a topological point of view. Using persistent homology, we demonstrate how tracking the evolution of embedding manifolds during training can inform about class separability. More specifically, we show how this technique can be applied to detect when the training process stops improving the separability of the embeddings. Our results, validated across binary and multi-class text classification tasks, show that the proposed method's estimates of class separability align with those obtained from supervised methods. This approach offers a novel perspective on monitoring and improving the fine-tuning of sentence transformers for classification tasks, particularly in scenarios where labeled data is scarce. We also discuss how tracking these quantities can provide additional insights into the properties of the trained classifier.
△ Less
Submitted 18 June, 2024; v1 submitted 24 May, 2023;
originally announced May 2023.
