-
Représentation graphique de la langue des signes française et édition logicielle
Authors:
Michael Filhol,
Thomas von Ascheberg
Abstract:
Cet article propose une méthode pour définir une forme graphique éditable standardisée pour les langues des signes, ainsi qu'une proposition "AZVD" et un éditeur logiciel associé. Inspirée d'une part par les régularités observées dans les pratiques spontanées de locuteurs pratiquant la schématisation, la démarche tente garantir un système qualifié d'adoptable. Liée d'autre part au modèle formel de…
▽ More
Cet article propose une méthode pour définir une forme graphique éditable standardisée pour les langues des signes, ainsi qu'une proposition "AZVD" et un éditeur logiciel associé. Inspirée d'une part par les régularités observées dans les pratiques spontanées de locuteurs pratiquant la schématisation, la démarche tente garantir un système qualifié d'adoptable. Liée d'autre part au modèle formel de représentation AZee, elle vise également à spécifier un système dont toutes les productions ont une lecture déterminée au point où elles sont automatiquement synthétisables par un avatar.
--
This paper proposes a definition method for an editable standard graphical form of Sign Language discourse representation. It also puts forward a tentative system "AZVD", and presents an associated software editor. The system is inspired by the regularities observed in spontaneous diagrams produced by some language users, in order to make it as adoptable as possible. Moreover, it is built upon the formal representation model AZee, so that any graphical instance produced by the system determines its own read-out form, to the point that they can be automatically synthesised by an avatar.
△ Less
Submitted 26 June, 2023;
originally announced June 2023.
-
Example-Based Machine Translation from Text to a Hierarchical Representation of Sign Language
Authors:
Élise Bertin-Lemée,
Annelies Braffort,
Camille Challant,
Claire Danet,
Michael Filhol
Abstract:
This article presents an original method for Text-to-Sign Translation. It compensates data scarcity using a domain-specific parallel corpus of alignments between text and hierarchical formal descriptions of Sign Language videos in AZee. Based on the detection of similarities present in the source text, the proposed algorithm recursively exploits matches and substitutions of aligned segments to bui…
▽ More
This article presents an original method for Text-to-Sign Translation. It compensates data scarcity using a domain-specific parallel corpus of alignments between text and hierarchical formal descriptions of Sign Language videos in AZee. Based on the detection of similarities present in the source text, the proposed algorithm recursively exploits matches and substitutions of aligned segments to build multiple candidate translations for a novel statement. This helps preserving Sign Language structures as much as possible before falling back on literal translations too quickly, in a generative way. The resulting translations are in the form of AZee expressions, designed to be used as input to avatar synthesis systems. We present a test set tailored to showcase its potential for expressiveness and generation of idiomatic target language, and observed limitations. This work finally opens prospects on how to evaluate translation and linguistic aspects, such as accuracy and grammatical fluency.
△ Less
Submitted 6 May, 2022;
originally announced May 2022.
-
A human-editable Sign Language representation for software editing---and a writing system?
Authors:
Michael Filhol
Abstract:
To equip SL with software properly, we need an input system to represent and manipulate signed contents in the same way that every day software allows to process written text. Refuting the claim that video is good enough a medium to serve the purpose, we propose to build a representation that is: editable, queryable, synthesisable and user-friendly---we define those terms upfront. The issue being…
▽ More
To equip SL with software properly, we need an input system to represent and manipulate signed contents in the same way that every day software allows to process written text. Refuting the claim that video is good enough a medium to serve the purpose, we propose to build a representation that is: editable, queryable, synthesisable and user-friendly---we define those terms upfront. The issue being functionally and conceptually linked to that of writing, we study existing writing systems, namely those in use for vocal languages, those designed and proposed for SLs, and more spontaneous ways in which SL users put their language in writing. Observing each paradigm in turn, we move on to propose a new approach to satisfy our goals of integration in software. We finally open the prospect of our proposition being used outside of this restricted scope, as a writing system in itself, and compare its properties to the other writing systems presented.
△ Less
Submitted 5 November, 2018;
originally announced November 2018.
-
Synthesising Sign Language from semantics, approaching "from the target and back"
Authors:
Michael Filhol,
Gilles Falquet
Abstract:
We present a Sign Language modelling approach allowing to build grammars and create linguistic input for Sign synthesis through avatars. We comment on the type of grammar it allows to build, and observe a resemblance between the resulting expressions and traditional semantic representations. Comparing the ways in which the paradigms are designed, we name and contrast two essentially different stra…
▽ More
We present a Sign Language modelling approach allowing to build grammars and create linguistic input for Sign synthesis through avatars. We comment on the type of grammar it allows to build, and observe a resemblance between the resulting expressions and traditional semantic representations. Comparing the ways in which the paradigms are designed, we name and contrast two essentially different strategies for building higher-level linguistic input: "source-and-forward" vs. "target-and-back". We conclude by favouring the latter, acknowledging the power of being able to automatically generate output from semantically relevant input straight into articulations of the target language.
△ Less
Submitted 25 July, 2017;
originally announced July 2017.