-
SignAvatar: Sign Language 3D Motion Reconstruction and Generation
Authors:
Lu Dong,
Lipisha Chaudhary,
Fei Xu,
Xiao Wang,
Mason Lary,
Ifeoma Nwogu
Abstract:
Achieving expressive 3D motion reconstruction and automatic generation for isolated sign words can be challenging, due to the lack of real-world 3D sign-word data, the complex nuances of signing motions, and the cross-modal understanding of sign language semantics. To address these challenges, we introduce SignAvatar, a framework capable of both word-level sign language reconstruction and generati…
▽ More
Achieving expressive 3D motion reconstruction and automatic generation for isolated sign words can be challenging, due to the lack of real-world 3D sign-word data, the complex nuances of signing motions, and the cross-modal understanding of sign language semantics. To address these challenges, we introduce SignAvatar, a framework capable of both word-level sign language reconstruction and generation. SignAvatar employs a transformer-based conditional variational autoencoder architecture, effectively establishing relationships across different semantic modalities. Additionally, this approach incorporates a curriculum learning strategy to enhance the model's robustness and generalization, resulting in more realistic motions. Furthermore, we contribute the ASL3DWord dataset, composed of 3D joint rotation data for the body, hands, and face, for unique sign words. We demonstrate the effectiveness of SignAvatar through extensive experiments, showcasing its superior reconstruction and automatic generation capabilities. The code and dataset are available on the project page.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
SignNet: Single Channel Sign Generation using Metric Embedded Learning
Authors:
Tejaswini Ananthanarayana,
Lipisha Chaudhary,
Ifeoma Nwogu
Abstract:
A true interpreting agent not only understands sign language and translates to text, but also understands text and translates to signs. Much of the AI work in sign language translation to date has focused mainly on translating from signs to text. Towards the latter goal, we propose a text-to-sign translation model, SignNet, which exploits the notion of similarity (and dissimilarity) of visual sign…
▽ More
A true interpreting agent not only understands sign language and translates to text, but also understands text and translates to signs. Much of the AI work in sign language translation to date has focused mainly on translating from signs to text. Towards the latter goal, we propose a text-to-sign translation model, SignNet, which exploits the notion of similarity (and dissimilarity) of visual signs in translating. This module presented is only one part of a dual-learning two task process involving text-to-sign (T2S) as well as sign-to-text (S2T). We currently implement SignNet as a single channel architecture so that the output of the T2S task can be fed into S2T in a continuous dual learning framework. By single channel, we refer to a single modality, the body pose joints.
In this work, we present SignNet, a T2S task using a novel metric embedding learning process, to preserve the distances between sign embeddings relative to their dissimilarity. We also describe how to choose positive and negative examples of signs for similarity testing. From our analysis, we observe that metric embedding learning-based model perform significantly better than the other models with traditional losses, when evaluated using BLEU scores. In the task of gloss to pose, SignNet performed as well as its state-of-the-art (SoTA) counterparts and outperformed them in the task of text to pose, by showing noteworthy enhancements in BLEU 1 - BLEU 4 scores (BLEU 1: 31->39; ~26% improvement and BLEU 4: 10.43->11.84; ~14\% improvement) when tested on the popular RWTH PHOENIX-Weather-2014T benchmark dataset
△ Less
Submitted 6 December, 2022;
originally announced December 2022.
-
Reduce The Wastage of Data During Movement in Data Warehouse
Authors:
Ahmed Mateen,
Lareab Chaudhary
Abstract:
In this research paper so as to handle Data in warehousing as well as reduce the wastage of data and provide a better results which takes more and more turn into a focal point of the data source business. Data warehousing and on-line analytical processing (OLAP) are vital fundamentals of resolution hold, which has more and more become a focal point of the database manufacturing. Lots of marketable…
▽ More
In this research paper so as to handle Data in warehousing as well as reduce the wastage of data and provide a better results which takes more and more turn into a focal point of the data source business. Data warehousing and on-line analytical processing (OLAP) are vital fundamentals of resolution hold, which has more and more become a focal point of the database manufacturing. Lots of marketable yield and services be at the present accessible, and the entire primary database management organization vendor nowadays have contributions in the area assessment hold up spaces some quite dissimilar necessities on record technology compare to conventional on-line transaction giving out application. This article gives a general idea of data warehousing and OLAP technologies, with the highlighting on top of their latest necessities. So tools which is used for extract, clean-up and load information into back end of a information warehouse; multidimensional data model usual of OLAP; front end client tools for querying and data analysis; server extension for proficient query processing; and tools for data managing and for administration the warehouse. In adding to survey the circumstances of the art, this article also identify a number of capable research issue, a few which are interrelated to data wastage troubles. In this paper use some new techniques to reduce the wastage of data, provide better results. In this paper take some values, put in anova table and give results through graphs which shows performance.
△ Less
Submitted 27 December, 2016;
originally announced December 2016.
-
A Peta-Scale Data Movement and Analysis in Data Warehouse (APSDMADW)
Authors:
Ahmed Mateen,
Lareab Chaudhary
Abstract:
In this research paper so as to handle Information warehousing as well as online synthetic dispensation OLAP are necessary aspects of conclusion support which takes more and more turn into a focal point of the data source business.This paper offers an outline of information warehousing also OLAP systems with a highlighting on their latest necessities.All of us explain backside end tackle for extra…
▽ More
In this research paper so as to handle Information warehousing as well as online synthetic dispensation OLAP are necessary aspects of conclusion support which takes more and more turn into a focal point of the data source business.This paper offers an outline of information warehousing also OLAP systems with a highlighting on their latest necessities.All of us explain backside end tackle for extract clean-up and load information into an Data warehouse multi dimensional data model usual of OLAP frontend user tools for query and facts evaluation server extension for useful query dispensation and apparatus for metadata managing and for supervision the stockroom. Insights centered on complete data on customer actions manufactured goods act and souk performance are powerful advance and opposition in the internet gap .In this research conclude the company inspiration and the program and efficiency of servers working in a data warehouse through use of some new techniques and get better and efficient results. Data in petabyte scale. This test shows the data drop** rate in data warehouse. The locomotive is in creation at Yahoo! since 2007 and presently manages more than half a dozen peta bytes of data.
△ Less
Submitted 27 December, 2016;
originally announced December 2016.
