Enhancing the LLM-Based Robot Manipulation Through Human-Robot Collaboration
Authors:
Haokun Liu,
Yaonan Zhu,
Kenji Kato,
Atsushi Tsukahara,
Izumi Kondo,
Tadayoshi Aoyama,
Yasuhisa Hasegawa
Abstract:
Large Language Models (LLMs) are gaining popularity in the field of robotics. However, LLM-based robots are limited to simple, repetitive motions due to the poor integration between language models, robots, and the environment. This paper proposes a novel approach to enhance the performance of LLM-based autonomous manipulation through Human-Robot Collaboration (HRC). The approach involves using a…
▽ More
Large Language Models (LLMs) are gaining popularity in the field of robotics. However, LLM-based robots are limited to simple, repetitive motions due to the poor integration between language models, robots, and the environment. This paper proposes a novel approach to enhance the performance of LLM-based autonomous manipulation through Human-Robot Collaboration (HRC). The approach involves using a prompted GPT-4 language model to decompose high-level language commands into sequences of motions that can be executed by the robot. The system also employs a YOLO-based perception algorithm, providing visual cues to the LLM, which aids in planning feasible motions within the specific environment. Additionally, an HRC method is proposed by combining teleoperation and Dynamic Movement Primitives (DMP), allowing the LLM-based robot to learn from human guidance. Real-world experiments have been conducted using the Toyota Human Support Robot for manipulation tasks. The outcomes indicate that tasks requiring complex trajectory planning and reasoning over environments can be efficiently accomplished through the incorporation of human demonstrations.
△ Less
Submitted 1 July, 2024; v1 submitted 20 June, 2024;
originally announced June 2024.
Self-induced inverse spin Hall effect in permalloy at room temperature
Authors:
Ayaka Tsukahara,
Yuichiro Ando,
Yuta Kitamura,
Hiroyuki Emito,
Eiji Shikoh,
Michael P. Delmo,
Teruya Shinjo,
Masashi Shiraishi
Abstract:
Inverse spin Hall effect (ISHE) allows the conversion of pure spin current into charge current in nonmagnetic materials (NM) due to spin-orbit interaction (SOI). In ferromagnetic materials (FM), SOI is known to contribute to anomalous Hall effect (AHE), anisotropic magnetoresistance (AMR), and other spin-dependent transport phenomena. However, SOI in FM has been ignored in ISHE studies in spintron…
▽ More
Inverse spin Hall effect (ISHE) allows the conversion of pure spin current into charge current in nonmagnetic materials (NM) due to spin-orbit interaction (SOI). In ferromagnetic materials (FM), SOI is known to contribute to anomalous Hall effect (AHE), anisotropic magnetoresistance (AMR), and other spin-dependent transport phenomena. However, SOI in FM has been ignored in ISHE studies in spintronic devices, and the possibility of "self-induced ISHE" in FM has never been explored until now. In this paper, we demonstrate the experimental verification of ISHE in FM. We found that the spin-pum**-induced spin current in permalloy (Py) film generates a transverse electromotive force (EMF) in the film itself, which results from the coupling of spin current and SOI in Py. The control experiments ruled out spin rectification effect and anomalous Nernst effect as the origin of the EMF.
△ Less
Submitted 15 June, 2014; v1 submitted 15 January, 2013;
originally announced January 2013.
