-
SALAD: Smart AI Language Assistant Daily
Authors:
Ragib Amin Nihal,
Tran Dong Huu Quoc,
Lin Zirui,
Xu Yimimg,
Liu Haoran,
An Zhaoyi,
Kyou Ma
Abstract:
SALAD is an AI-driven language-learning application designed to help foreigners learn Japanese. It offers translations in Kanji-Kana-Romaji, speech recognition, translated audio, vocabulary tracking, grammar explanations, and songs generated from newly learned words. The app targets beginners and intermediate learners, aiming to make language acquisition more accessible and enjoyable. SALAD uses d…
▽ More
SALAD is an AI-driven language-learning application designed to help foreigners learn Japanese. It offers translations in Kanji-Kana-Romaji, speech recognition, translated audio, vocabulary tracking, grammar explanations, and songs generated from newly learned words. The app targets beginners and intermediate learners, aiming to make language acquisition more accessible and enjoyable. SALAD uses daily translations to enhance fluency and comfort in communication with native speakers. The primary objectives include effective Japanese language learning, user engagement, and progress tracking. A survey by us found that 39% of foreigners in Japan face discomfort in conversations with Japanese speakers. Over 60% of foreigners expressed confidence in SALAD's ability to enhance their Japanese language skills. The app uses large language models, speech recognition, and diffusion models to bridge the language gap and foster a more inclusive community in Japan.
△ Less
Submitted 13 February, 2024; v1 submitted 12 February, 2024;
originally announced February 2024.
-
NeuronsGym: A Hybrid Framework and Benchmark for Robot Tasks with Sim2Real Policy Learning
Authors:
Li Haoran,
Liu Shasha,
Ma Mingjun,
Hu Guangzheng,
Chen Yaran,
Zhao Dongbin
Abstract:
The rise of embodied AI has greatly improved the possibility of general mobile agent systems. At present, many evaluation platforms with rich scenes, high visual fidelity and various application scenarios have been developed. In this paper, we present a hybrid framework named NeuronsGym that can be used for policy learning of robot tasks, covering a simulation platform for training policy, and a p…
▽ More
The rise of embodied AI has greatly improved the possibility of general mobile agent systems. At present, many evaluation platforms with rich scenes, high visual fidelity and various application scenarios have been developed. In this paper, we present a hybrid framework named NeuronsGym that can be used for policy learning of robot tasks, covering a simulation platform for training policy, and a physical system for studying sim2real problems. Unlike most current single-task, slow-moving robotic platforms, our framework provides agile physical robots with a wider range of speeds, and can be employed to train robotic navigation and confrontation policies. At the same time, in order to evaluate the safety of robot navigation, we propose a safety-weighted path length (SFPL) to improve the safety evaluation in the current mobile robot navigation. Based on this platform, we build a new benchmark for navigation and confrontation tasks under this platform by comparing the current mainstream sim2real methods, and hold the 2022 IEEE Conference on Games (CoG) RoboMaster sim2real challenge. We release the codes of this framework\footnote{\url{https://github.com/DRL-CASIA/NeuronsGym}} and hope that this platform can promote the development of more flexible and agile general mobile agent algorithms.
△ Less
Submitted 7 February, 2023;
originally announced February 2023.
-
MVM3Det: A Novel Method for Multi-view Monocular 3D Detection
Authors:
Li Haoran,
Duan Zicheng,
Ma Mingjun,
Chen Yaran,
Li Jiaqi,
Zhao Dongbin
Abstract:
Monocular 3D object detection encounters occlusion problems in many application scenarios, such as traffic monitoring, pedestrian monitoring, etc., which leads to serious false negative. Multi-view object detection effectively solves this problem by combining data from different perspectives. However, due to label confusion and feature confusion, the orientation estimation of multi-view 3D object…
▽ More
Monocular 3D object detection encounters occlusion problems in many application scenarios, such as traffic monitoring, pedestrian monitoring, etc., which leads to serious false negative. Multi-view object detection effectively solves this problem by combining data from different perspectives. However, due to label confusion and feature confusion, the orientation estimation of multi-view 3D object detection is intractable, which is important for object tracking and intention prediction. In this paper, we propose a novel multi-view 3D object detection method named MVM3Det which simultaneously estimates the 3D position and orientation of the object according to the multi-view monocular information. The method consists of two parts: 1) Position proposal network, which integrates the features from different perspectives into consistent global features through feature orthogonal transformation to estimate the position. 2) Multi-branch orientation estimation network, which introduces feature perspective pooling to overcome the two confusion problems during the orientation estimation. In addition, we present a first dataset for multi-view 3D object detection named MVM3D. Comparing with State-Of-The-Art (SOTA) methods on our dataset and public dataset WildTrack, our method achieves very competitive results.
△ Less
Submitted 21 September, 2021;
originally announced September 2021.
-
The monochromatic X-rays facilities at NIM
Authors:
Guo Siming,
Wu **jie,
Hou Dongjie,
Zhou Pengyue,
Wang Eryan,
Song Ruiqiang,
Wang Jia,
Zhai Yudan,
Liu Haoran,
Li Xinqiao,
An Zhenghua,
Zhang Dali,
Peng Wenxi,
Zhou Xu,
Li Mengshi,
Li Chengze,
Zhang Shuai,
Ren Guoyue,
Wang Ji,
Huang Jianwei,
Li Dehong,
Zhang Jian
Abstract:
Space scientific exploration is becoming the main battlefield for mankind to explore the universe. Countries around the world have successively launched various space exploration satellites. Accurate calibration on the ground is a key factor for space science satellites to obtain observational results. In order to provide calibration for various satellite-borne detectors, several monochromatic X-r…
▽ More
Space scientific exploration is becoming the main battlefield for mankind to explore the universe. Countries around the world have successively launched various space exploration satellites. Accurate calibration on the ground is a key factor for space science satellites to obtain observational results. In order to provide calibration for various satellite-borne detectors, several monochromatic X-rays facilities has been built at National Institute of Metrology, P.R. China (NIM). These facilities are mainly based on grating diffraction and Bragg diffraction, the energy range of produced monochromatic X-rays is (0.218-301) keV. The facilities have a good performance on energy stability, monochromaticity and flux stability. Monochromaticity of all facilities is better than 3.0%, the stability of energy is better than 1.0% over 8 hours, and the stability of flux is better than 2.0% over 8 hours. The calibration experiments of satellite-borne detectors, such as energy linearity, energy resolution, detection efficiency and temperature response can be carried out on the facilities. So far we have completed the calibration of two satellites, and there are still three satellites in progress. This work will contribute to the development of X-ray astronomy, and contribute to the development of Chinese space science.
△ Less
Submitted 28 October, 2020;
originally announced November 2020.
