-
Towards Enhanced RAC Accessibility: Leveraging Datasets and LLMs
Authors:
Edison Jair Bejarano Sepulveda,
Nicolai Potes Hector,
Santiago Pineda Montoya,
Felipe Ivan Rodriguez,
Jaime Enrique Orduy,
Alec Rosales Cabezas,
Danny Traslaviña Navarrete,
Sergio Madrid Farfan
Abstract:
This paper explores the potential of large language models (LLMs) to make the Aeronautical Regulations of Colombia (RAC) more accessible. Given the complexity and extensive technicality of the RAC, this study introduces a novel approach to simplifying these regulations for broader understanding. By develo** the first-ever RAC database, which contains 24,478 expertly labeled question-and-answer p…
▽ More
This paper explores the potential of large language models (LLMs) to make the Aeronautical Regulations of Colombia (RAC) more accessible. Given the complexity and extensive technicality of the RAC, this study introduces a novel approach to simplifying these regulations for broader understanding. By develo** the first-ever RAC database, which contains 24,478 expertly labeled question-and-answer pairs, and fine-tuning LLMs specifically for RAC applications, the paper outlines the methodology for dataset assembly, expert-led annotation, and model training. Utilizing the Gemma1.1 2b model along with advanced techniques like Unsloth for efficient VRAM usage and flash attention mechanisms, the research aims to expedite training processes. This initiative establishes a foundation to enhance the comprehensibility and accessibility of RAC, potentially benefiting novices and reducing dependence on expert consultations for navigating the aviation industry's regulatory landscape.
You can visit the dataset (https://huggingface.co/somosnlp/gemma-1.1-2b-it_ColombiaRAC_FullyCurated_format_chatML_V1) and the model (https://huggingface.co/datasets/somosnlp/ColombiaRAC_FullyCurated) here.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
UmeTrack: Unified multi-view end-to-end hand tracking for VR
Authors:
Shangchen Han,
Po-chen Wu,
Yubo Zhang,
Beibei Liu,
Linguang Zhang,
Zheng Wang,
Weiguang Si,
Peizhao Zhang,
Yujun Cai,
Tomas Hodan,
Randi Cabezas,
Luan Tran,
Muzaffer Akbay,
Tsz-Ho Yu,
Cem Keskin,
Robert Wang
Abstract:
Real-time tracking of 3D hand pose in world space is a challenging problem and plays an important role in VR interaction. Existing work in this space are limited to either producing root-relative (versus world space) 3D pose or rely on multiple stages such as generating heatmaps and kinematic optimization to obtain 3D pose. Moreover, the typical VR scenario, which involves multi-view tracking from…
▽ More
Real-time tracking of 3D hand pose in world space is a challenging problem and plays an important role in VR interaction. Existing work in this space are limited to either producing root-relative (versus world space) 3D pose or rely on multiple stages such as generating heatmaps and kinematic optimization to obtain 3D pose. Moreover, the typical VR scenario, which involves multi-view tracking from wide \ac{fov} cameras is seldom addressed by these methods. In this paper, we present a unified end-to-end differentiable framework for multi-view, multi-frame hand tracking that directly predicts 3D hand pose in world space. We demonstrate the benefits of end-to-end differentiabilty by extending our framework with downstream tasks such as jitter reduction and pinch prediction. To demonstrate the efficacy of our model, we further present a new large-scale egocentric hand pose dataset that consists of both real and synthetic data. Experiments show that our system trained on this dataset handles various challenging interactive motions, and has been successfully applied to real-time VR applications.
△ Less
Submitted 31 October, 2022;
originally announced November 2022.
-
Direction-Aware Semi-Dense SLAM
Authors:
Julian Straub,
Randi Cabezas,
John Leonard,
John W. Fisher III
Abstract:
To aide simultaneous localization and map** (SLAM), future perception systems will incorporate forms of scene understanding. In a step towards fully integrated probabilistic geometric scene understanding, localization and map** we propose the first direction-aware semi-dense SLAM system. It jointly infers the directional Stata Center World (SCW) segmentation and a surfel-based semi-dense map w…
▽ More
To aide simultaneous localization and map** (SLAM), future perception systems will incorporate forms of scene understanding. In a step towards fully integrated probabilistic geometric scene understanding, localization and map** we propose the first direction-aware semi-dense SLAM system. It jointly infers the directional Stata Center World (SCW) segmentation and a surfel-based semi-dense map while performing real-time camera tracking. The joint SCW map model connects a scene-wide Bayesian nonparametric Dirichlet Process von-Mises-Fisher mixture model (DP-vMF) prior on surfel orientations with the local surfel locations via a conditional random field (CRF). Camera tracking leverages the SCW segmentation to improve efficiency via guided observation selection. Results demonstrate improved SLAM accuracy and tracking efficiency at state of the art performance.
△ Less
Submitted 18 September, 2017;
originally announced September 2017.
