-
RING-NeRF : Rethinking Inductive Biases for Versatile and Efficient Neural Fields
Authors:
Doriand Petit,
Steve Bourgeois,
Dumitru Pavel,
Vincent Gay-Bellile,
Florian Chabot,
Loic Barthe
Abstract:
Recent advances in Neural Fields mostly rely on develo** task-specific supervision which often complicates the models. Rather than develo** hard-to-combine and specific modules, another approach generally overlooked is to directly inject generic priors on the scene representation (also called inductive biases) into the NeRF architecture. Based on this idea, we propose the RING-NeRF architectur…
▽ More
Recent advances in Neural Fields mostly rely on develo** task-specific supervision which often complicates the models. Rather than develo** hard-to-combine and specific modules, another approach generally overlooked is to directly inject generic priors on the scene representation (also called inductive biases) into the NeRF architecture. Based on this idea, we propose the RING-NeRF architecture which includes two inductive biases : a continuous multi-scale representation of the scene and an invariance of the decoder's latent space over spatial and scale domains. We also design a single reconstruction process that takes advantage of those inductive biases and experimentally demonstrates on-par performances in terms of quality with dedicated architecture on multiple tasks (anti-aliasing, few view reconstruction, SDF reconstruction without scene-specific initialization) while being more efficient. Moreover, RING-NeRF has the distinctive ability to dynamically increase the resolution of the model, opening the way to adaptive reconstruction.
△ Less
Submitted 14 March, 2024; v1 submitted 6 December, 2023;
originally announced December 2023.
-
Accelerating Robot Learning of Contact-Rich Manipulations: A Curriculum Learning Study
Authors:
Cristian C. Beltran-Hernandez,
Damien Petit,
Ixchel G. Ramirez-Alpizar,
Kensuke Harada
Abstract:
The Reinforcement Learning (RL) paradigm has been an essential tool for automating robotic tasks. Despite the advances in RL, it is still not widely adopted in the industry due to the need for an expensive large amount of robot interaction with its environment. Curriculum Learning (CL) has been proposed to expedite learning. However, most research works have been only evaluated in simulated enviro…
▽ More
The Reinforcement Learning (RL) paradigm has been an essential tool for automating robotic tasks. Despite the advances in RL, it is still not widely adopted in the industry due to the need for an expensive large amount of robot interaction with its environment. Curriculum Learning (CL) has been proposed to expedite learning. However, most research works have been only evaluated in simulated environments, from video games to robotic toy tasks. This paper presents a study for accelerating robot learning of contact-rich manipulation tasks based on Curriculum Learning combined with Domain Randomization (DR). We tackle complex industrial assembly tasks with position-controlled robots, such as insertion tasks. We compare different curricula designs and sampling approaches for DR. Based on this study, we propose a method that significantly outperforms previous work, which uses DR only (No CL is used), with less than a fifth of the training time (samples). Results also show that even when training only in simulation with toy tasks, our method can learn policies that can be transferred to the real-world robot. The learned policies achieved success rates of up to 86\% on real-world complex industrial insertion tasks (with tolerances of $\pm 0.01~mm$) not seen during the training.
△ Less
Submitted 28 April, 2022; v1 submitted 27 April, 2022;
originally announced April 2022.
-
Bimanual Shelf Picking Planner Based on Collapse Prediction
Authors:
T. Motoda,
D. Petit,
W. Wan,
K. Harada
Abstract:
In logistics warehouse, since many objects are randomly stacked on shelves, it becomes difficult for a robot to safely extract one of the objects without other objects falling from the shelf. In previous works, a robot needed to extract the target object after rearranging the neighboring objects. In contrast, humans extract an object from a shelf while supporting other neighboring objects. In this…
▽ More
In logistics warehouse, since many objects are randomly stacked on shelves, it becomes difficult for a robot to safely extract one of the objects without other objects falling from the shelf. In previous works, a robot needed to extract the target object after rearranging the neighboring objects. In contrast, humans extract an object from a shelf while supporting other neighboring objects. In this paper, we propose a bimanual manipulation planner based on collapse prediction trained with data generated from a physics simulator, which can safely extract a single object while supporting the other object. We confirmed that the proposed method achieves more than 80% success rate for safe extraction by real-world experiments using a dual-arm manipulator.
△ Less
Submitted 31 May, 2021;
originally announced May 2021.
-
Variable Compliance Control for Robotic Peg-in-Hole Assembly: A Deep Reinforcement Learning Approach
Authors:
Cristian C. Beltran-Hernandez,
Damien Petit,
Ixchel G. Ramirez-Alpizar,
Kensuke Harada
Abstract:
Industrial robot manipulators are playing a more significant role in modern manufacturing industries. Though peg-in-hole assembly is a common industrial task which has been extensively researched, safely solving complex high precision assembly in an unstructured environment remains an open problem. Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autono…
▽ More
Industrial robot manipulators are playing a more significant role in modern manufacturing industries. Though peg-in-hole assembly is a common industrial task which has been extensively researched, safely solving complex high precision assembly in an unstructured environment remains an open problem. Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges, especially when using position-controlled manipulators. The main contribution of this work is a learning-based method to solve peg-in-hole tasks with position uncertainty of the hole. We proposed the use of an off-policy model-free reinforcement learning method and bootstrap the training speed by using several transfer learning techniques (sim2real) and domain randomization. Our proposed learning framework for position-controlled robots was extensively evaluated on contact-rich insertion tasks on a variety of environments.
△ Less
Submitted 20 November, 2020; v1 submitted 24 August, 2020;
originally announced August 2020.
-
Team O2AS at the World Robot Summit 2018: An Approach to Robotic Kitting and Assembly Tasks using General Purpose Grippers and Tools
Authors:
Felix von Drigalski,
Chisato Nakashima,
Yoshiya Shibata,
Yoshinori Konishi,
Joshua C. Triyonoputro,
Kaidi Nie,
Damien Petit,
Toshio Ueshiba,
Ryuichi Takase,
Yukiyasu Domae,
Taku Yoshioka,
Yoshihisa Ijiri,
Ixchel G. Ramirez-Alpizar,
Weiwei Wan,
Kensuke Harada
Abstract:
We propose a versatile robotic system for kitting and assembly tasks which uses no jigs or commercial tool changers. Instead of specialized end effectors, it uses its two-finger grippers to grasp and hold tools to perform subtasks such as screwing and suctioning. A third gripper is used as a precision picking and centering tool, and uses in-built passive compliance to compensate for small position…
▽ More
We propose a versatile robotic system for kitting and assembly tasks which uses no jigs or commercial tool changers. Instead of specialized end effectors, it uses its two-finger grippers to grasp and hold tools to perform subtasks such as screwing and suctioning. A third gripper is used as a precision picking and centering tool, and uses in-built passive compliance to compensate for small position errors and uncertainty. A novel grasp point detection for bin picking is described for the kitting task, using a single depth map. Using the proposed system we competed in the Assembly Challenge of the Industrial Robotics Category of the World Robot Challenge at the World Robot Summit 2018, obtaining 4th place and the SICE award for lean design and versatile tool use. We show the effectiveness of our approach through experiments performed during the competition.
△ Less
Submitted 4 March, 2020;
originally announced March 2020.
-
Learning Force Control for Contact-rich Manipulation Tasks with Rigid Position-controlled Robots
Authors:
Cristian Camilo Beltran-Hernandez,
Damien Petit,
Ixchel G. Ramirez-Alpizar,
Takayuki Nishi,
Shinichi Kikuchi,
Takamitsu Matsubara,
Kensuke Harada
Abstract:
Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges, especially when using rigid position-controlled manipulators. These challenges include the need for a robust controller to avoid undesired behavior, that risk dam…
▽ More
Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges, especially when using rigid position-controlled manipulators. These challenges include the need for a robust controller to avoid undesired behavior, that risk damaging the robot and its environment, and constant supervision from a human operator. The main contributions of this work are, first, we proposed a learning-based force control framework combining RL techniques with traditional force control. Within said control scheme, we implemented two different conventional approaches to achieve force control with position-controlled robots; one is a modified parallel position/force control, and the other is an admittance control. Secondly, we empirically study both control schemes when used as the action space of the RL agent. Thirdly, we developed a fail-safe mechanism for safely training an RL agent on manipulation tasks using a real rigid robot manipulator. The proposed methods are validated on simulation and a real robot, an UR3 e-series robotic arm.
△ Less
Submitted 19 July, 2020; v1 submitted 1 March, 2020;
originally announced March 2020.
