-
RoboCup 2023 Humanoid AdultSize Winner NimbRo: NimbRoNet3 Visual Perception and Responsive Gait with Waveform In-walk Kicks
Authors:
Dmytro Pavlichenko,
Grzegorz Ficht,
Angel Villar-Corrales,
Luis Denninger,
Julia Brocker,
Tim Sinen,
Michael Schreiber,
Sven Behnke
Abstract:
The RoboCup Humanoid League holds annual soccer robot world championships towards the long-term objective of winning against the FIFA world champions by 2050. The participating teams continuously improve their systems. This paper presents the upgrades to our humanoid soccer system, leading our team NimbRo to win the Soccer Tournament in the Humanoid AdultSize League at RoboCup 2023 in Bordeaux, Fr…
▽ More
The RoboCup Humanoid League holds annual soccer robot world championships towards the long-term objective of winning against the FIFA world champions by 2050. The participating teams continuously improve their systems. This paper presents the upgrades to our humanoid soccer system, leading our team NimbRo to win the Soccer Tournament in the Humanoid AdultSize League at RoboCup 2023 in Bordeaux, France. The mentioned upgrades consist of: an updated model architecture for visual perception, extended fused angles feedback mechanisms and an additional COM-ZMP controller for walking robustness, and parametric in-walk kicks through waveforms.
△ Less
Submitted 11 January, 2024;
originally announced January 2024.
-
Centroidal State Estimation and Control for Hardware-constrained Humanoid Robots
Authors:
Grzegorz Ficht,
Sven Behnke
Abstract:
We introduce novel methods for state estimation, feedforward and feedback control, which specifically target humanoid robots with hardware limitations. Our method combines a five-mass model with approximate dynamics of each mass. It enables acquiring an accurate assessment of the centroidal state and Center of Pressure, even when direct forms of force or contact sensing are unavailable. Upon this,…
▽ More
We introduce novel methods for state estimation, feedforward and feedback control, which specifically target humanoid robots with hardware limitations. Our method combines a five-mass model with approximate dynamics of each mass. It enables acquiring an accurate assessment of the centroidal state and Center of Pressure, even when direct forms of force or contact sensing are unavailable. Upon this, we develop a feedforward scheme that operates on the centroidal state, accounting for insufficient joint tracking capabilities. Finally, we implement feedback mechanisms, which compensate for the lack in Degrees of Freedom that our NimbRo-OP2X robot has. The whole approach allows for reactive step** to maintain balance despite these limitations, which was verified on hardware during RoboCup 2023, in Bordeaux, France.
△ Less
Submitted 18 December, 2023;
originally announced December 2023.
-
RoboCup 2022 AdultSize Winner NimbRo: Upgraded Perception, Capture Steps Gait and Phase-based In-walk Kicks
Authors:
Dmytro Pavlichenko,
Grzegorz Ficht,
Arash Amini,
Mojtaba Hosseini,
Raphael Memmesheimer,
Angel Villar-Corrales,
Stefan M. Schulz,
Marcell Missura,
Maren Bennewitz,
Sven Behnke
Abstract:
Beating the human world champions by 2050 is an ambitious goal of the Humanoid League that provides a strong incentive for RoboCup teams to further improve and develop their systems. In this paper, we present upgrades of our system which enabled our team NimbRo to win the Soccer Tournament, the Drop-in Games, and the Technical Challenges in the Humanoid AdultSize League of RoboCup 2022. Strong per…
▽ More
Beating the human world champions by 2050 is an ambitious goal of the Humanoid League that provides a strong incentive for RoboCup teams to further improve and develop their systems. In this paper, we present upgrades of our system which enabled our team NimbRo to win the Soccer Tournament, the Drop-in Games, and the Technical Challenges in the Humanoid AdultSize League of RoboCup 2022. Strong performance in these competitions resulted in the Best Humanoid award in the Humanoid League. The mentioned upgrades include: hardware upgrade of the vision module, balanced walking with Capture Steps, and the introduction of phase-based in-walk kicks.
△ Less
Submitted 7 February, 2023; v1 submitted 6 February, 2023;
originally announced February 2023.
-
Direct Centroidal Control for Balanced Humanoid Locomotion
Authors:
Grzegorz Ficht,
Sven Behnke
Abstract:
We present an integrated approach to locomotion and balancing of humanoid robots based on direct centroidal control. Our method uses a five-mass description of a humanoid. It generates whole-body motions from desired foot trajectories and centroidal parameters of the robot. A set of simplified models is used to formulate general and intuitive control laws, which are then applied in real-time for e…
▽ More
We present an integrated approach to locomotion and balancing of humanoid robots based on direct centroidal control. Our method uses a five-mass description of a humanoid. It generates whole-body motions from desired foot trajectories and centroidal parameters of the robot. A set of simplified models is used to formulate general and intuitive control laws, which are then applied in real-time for estimating and regulating the center of mass position and orientation of the multibody's principal axes of inertia. The combination of proposed algorithms produces a stretched-leg gait with naturally looking upper body motions. As only a 6-axis IMU and joint encoders are necessary for the implementation, the portability between robots is high. Our method has been experimentally verified using an igus Humanoid Open Platform, demonstrating whole-body locomotion and push rejection capabilities.
△ Less
Submitted 9 August, 2022;
originally announced August 2022.
-
Bipedal Humanoid Hardware Design: A Technology Review
Authors:
Grzegorz Ficht,
Sven Behnke
Abstract:
Purpose of Review: As new technological advancements are made, humanoid robots that utilise them are being designed and manufactured. For optimal design choices, a broad overview with insight on the advantages and disadvantages of available technologies is necessary. This article intends to provide an analysis on the established approaches and contrast them with emerging ones.
Recent Findings: A…
▽ More
Purpose of Review: As new technological advancements are made, humanoid robots that utilise them are being designed and manufactured. For optimal design choices, a broad overview with insight on the advantages and disadvantages of available technologies is necessary. This article intends to provide an analysis on the established approaches and contrast them with emerging ones.
Recent Findings: A clear shift in the recent design features of humanoid robots is develo**, which is supported by literature. As humanoid robots are meant to leave laboratories and traverse the world, compliance and more efficient locomotion is necessary. The limitations of highly rigid actuation are being tackled by different research groups in unique ways. Some focus on modifying the kinematic structure, while others change the actuation scheme. With new manufacturing capabilities, previously impossible designs are becoming feasible.
Summary: A comprehensive review on the technologies crucial for bipedal humanoid robots was performed. Different mechanical concepts have been discussed, along with the advancements in actuation, sensing and manufacturing. The paper is supplemented with a list of the recently developed platforms along with a selection of their specifications.
△ Less
Submitted 8 March, 2021;
originally announced March 2021.
-
NimbRo-OP2X: Affordable Adult-sized 3D-printed Open-Source Humanoid Robot for Research
Authors:
Grzegorz Ficht,
Hafez Farazi,
Diego Rodriguez,
Dmytro Pavlichenko,
Philipp Allgeuer,
Andre Brandenburger,
Sven Behnke
Abstract:
For several years, high development and production costs of humanoid robots restricted researchers interested in working in the field. To overcome this problem, several research groups have opted to work with simulated or smaller robots, whose acquisition costs are significantly lower. However, due to scale differences and imperfect simulation replicability, results may not be directly reproducibl…
▽ More
For several years, high development and production costs of humanoid robots restricted researchers interested in working in the field. To overcome this problem, several research groups have opted to work with simulated or smaller robots, whose acquisition costs are significantly lower. However, due to scale differences and imperfect simulation replicability, results may not be directly reproducible on real, adult-sized robots. In this paper, we present the NimbRo-OP2X, a capable and affordable adult-sized humanoid platform aiming to significantly lower the entry barrier for humanoid robot research. With a height of 135 cm and weight of only 19 kg, the robot can interact in an unmodified, human environment without special safety equipment. Modularity in hardware and software allow this platform enough flexibility to operate in different scenarios and applications with minimal effort. The robot is equipped with an on-board computer with GPU, which enables the implementation of state-of-the-art approaches for object detection and human perception demanded by areas such as manipulation and human-robot interaction. Finally, the capabilities of the NimbRo-OP2X, especially in terms of locomotion stability and visual perception, are evaluated. This includes the performance at RoboCup 2018, where NimbRo-OP2X won all possible awards in the AdultSize class.
△ Less
Submitted 19 October, 2020;
originally announced October 2020.
-
Fast Whole-Body Motion Control of Humanoid Robots with Inertia Constraints
Authors:
Grzegorz Ficht,
Sven Behnke
Abstract:
We introduce a new, analytical method for generating whole-body motions for humanoid robots, which approximate the desired Composite Rigid Body (CRB) inertia. Our approach uses a reduced five mass model, where four of the masses are attributed to the limbs and one is used for the trunk. This compact formulation allows for finding an analytical solution that combines the kinematics with mass distri…
▽ More
We introduce a new, analytical method for generating whole-body motions for humanoid robots, which approximate the desired Composite Rigid Body (CRB) inertia. Our approach uses a reduced five mass model, where four of the masses are attributed to the limbs and one is used for the trunk. This compact formulation allows for finding an analytical solution that combines the kinematics with mass distribution and inertial properties of a humanoid robot. The positioning of the masses in Cartesian space is then directly used to obtain joint angles with relations based on simple geometry. Motions are achieved through the time evolution of poses generated through the desired foot positioning and CRB inertia properties. As a result, we achieve short computation times in the order of tens of microseconds. This makes the method suited for applications with limited computation resources, or leaving them to be spent on higher-layer tasks such as model predictive control. The approach is evaluated by performing a dynamic kicking motion with an igus Humanoid Open Platform robot.
△ Less
Submitted 13 July, 2020;
originally announced July 2020.
-
RoboCup 2019 AdultSize Winner NimbRo: Deep Learning Perception, In-Walk Kick, Push Recovery, and Team Play Capabilities
Authors:
Diego Rodriguez,
Hafez Farazi,
Grzegorz Ficht,
Dmytro Pavlichenko,
Andre Brandenburger,
Mojtaba Hosseini,
Oleg Kosenko,
Michael Schreiber,
Marcel Missura,
Sven Behnke
Abstract:
Individual and team capabilities are challenged every year by rule changes and the increasing performance of the soccer teams at RoboCup Humanoid League. For RoboCup 2019 in the AdultSize class, the number of players (2 vs. 2 games) and the field dimensions were increased, which demanded for team coordination and robust visual perception and localization modules. In this paper, we present the late…
▽ More
Individual and team capabilities are challenged every year by rule changes and the increasing performance of the soccer teams at RoboCup Humanoid League. For RoboCup 2019 in the AdultSize class, the number of players (2 vs. 2 games) and the field dimensions were increased, which demanded for team coordination and robust visual perception and localization modules. In this paper, we present the latest developments that lead team NimbRo to win the soccer tournament, drop-in games, technical challenges and the Best Humanoid Award of the RoboCup Humanoid League 2019 in Sydney. These developments include a deep learning vision system, in-walk kicks, step-based push-recovery, and team play strategies.
△ Less
Submitted 17 December, 2019; v1 submitted 16 December, 2019;
originally announced December 2019.
-
NimbRo Robots Winning RoboCup 2018 Humanoid AdultSize Soccer Competitions
Authors:
Hafez Farazi,
Grzegorz Ficht,
Philipp Allgeuer,
Dmytro Pavlichenko,
Diego Rodriguez,
Andre Brandenburger,
Mojtaba Hosseini,
Sven Behnke
Abstract:
Over the past few years, the Humanoid League rules have changed towards more realistic and challenging game environments, which encourage teams to advance their robot soccer performances. In this paper, we present the software and hardware designs that led our team NimbRo to win the competitions in the AdultSize league -- including the soccer tournament, the drop-in games, and the technical challe…
▽ More
Over the past few years, the Humanoid League rules have changed towards more realistic and challenging game environments, which encourage teams to advance their robot soccer performances. In this paper, we present the software and hardware designs that led our team NimbRo to win the competitions in the AdultSize league -- including the soccer tournament, the drop-in games, and the technical challenges at RoboCup 2018 in Montreal. Altogether, this resulted in NimbRo winning the Best Humanoid Award. In particular, we describe our deep-learning approaches for visual perception and our new fully 3D printed robot NimbRo-OP2X.
△ Less
Submitted 5 September, 2019;
originally announced September 2019.
-
NimbRo-OP2X: Adult-sized Open-source 3D Printed Humanoid Robot
Authors:
Grzegorz Ficht,
Hafez Farazi,
André Brandenburger,
Diego Rodriguez,
Dmytro Pavlichenko,
Philipp Allgeuer,
Mojtaba Hosseini,
Sven Behnke
Abstract:
Humanoid robotics research depends on capable robot platforms, but recently developed advanced platforms are often not available to other research groups, expensive, dangerous to operate, or closed-source. The lack of available platforms forces researchers to work with smaller robots, which have less strict dynamic constraints or with simulations, which lack many real-world effects. We developed N…
▽ More
Humanoid robotics research depends on capable robot platforms, but recently developed advanced platforms are often not available to other research groups, expensive, dangerous to operate, or closed-source. The lack of available platforms forces researchers to work with smaller robots, which have less strict dynamic constraints or with simulations, which lack many real-world effects. We developed NimbRo-OP2X to address this need. At a height of 135 cm our robot is large enough to interact in a human environment. Its low weight of only 19 kg makes the operation of the robot safe and easy, as no special operational equipment is necessary. Our robot is equipped with a fast onboard computer and a GPU to accelerate parallel computations. We extend our already open-source software by a deep-learning based vision system and gait parameter optimisation. The NimbRo-OP2X was evaluated during RoboCup 2018 in Montréal, Canada, where it won all possible awards in the Humanoid AdultSize class.
△ Less
Submitted 19 October, 2018;
originally announced October 2018.
-
Online Balanced Motion Generation for Humanoid Robots
Authors:
Grzegorz Ficht,
Sven Behnke
Abstract:
Reducing the complexity of higher order problems can enable solving them in analytical ways. In this paper, we propose an analytic whole body motion generator for humanoid robots. Our approach targets inexpensive platforms that possess position controlled joints and have limited feedback capabilities. By analysing the mass distribution in a humanoid-like body, we find relations between limb moveme…
▽ More
Reducing the complexity of higher order problems can enable solving them in analytical ways. In this paper, we propose an analytic whole body motion generator for humanoid robots. Our approach targets inexpensive platforms that possess position controlled joints and have limited feedback capabilities. By analysing the mass distribution in a humanoid-like body, we find relations between limb movement and their respective CoM positions. A full pose of a humanoid robot is then described with five point-masses, with one attached to the trunk and the remaining four assigned to each limb. The weighted sum of these masses in combination with a contact point form an inverted pendulum. We then generate statically stable poses by specifying a desired upright pendulum orientation, and any desired trunk orientation. Limb and trunk placement strategies are utilised to meet the reference CoM position. A set of these poses is interpolated to achieve stable whole body motions. The approach is evaluated by performing several motions with an igus Humanoid Open Platform robot. We demonstrate the extendability of the approach by applying basic feedback mechanisms for disturbance rejection and tracking error minimisation.
△ Less
Submitted 19 October, 2018;
originally announced October 2018.
-
First International HARTING Open Source Prize Winner: The igus Humanoid Open Platform
Authors:
Philipp Allgeuer,
Grzegorz Ficht,
Hafez Farazi,
Michael Schreiber,
Sven Behnke
Abstract:
The use of standard platforms in the field of humanoid robotics can lower the entry barrier for new research groups, and accelerate research by the facilitation of code sharing. Numerous humanoid standard platforms exist in the lower size ranges of up to 60cm, but beyond that humanoid robots scale up quickly in weight and price, becoming less affordable and more difficult to operate, maintain and…
▽ More
The use of standard platforms in the field of humanoid robotics can lower the entry barrier for new research groups, and accelerate research by the facilitation of code sharing. Numerous humanoid standard platforms exist in the lower size ranges of up to 60cm, but beyond that humanoid robots scale up quickly in weight and price, becoming less affordable and more difficult to operate, maintain and modify. The igus Humanoid Open Platform is an affordable, fully open-source platform for humanoid research. At 92cm, the robot is capable of acting in an environment meant for humans, and is equipped with enough sensors, actuators and computing power to support researchers in many fields. The structure of the robot is entirely 3D printed, leading to a lightweight and visually appealing design. This paper covers the mechanical and electrical aspects of the robot, as well as the main features of the corresponding open-source ROS software. At RoboCup 2016, the platform was awarded the first International HARTING Open Source Prize.
△ Less
Submitted 28 September, 2018;
originally announced October 2018.
-
NimbRo-OP2: Grown-up 3D Printed Open Humanoid Platform for Research
Authors:
Grzegorz Ficht,
Philipp Allgeuer,
Hafez Farazi,
Sven Behnke
Abstract:
The versatility of humanoid robots in locomotion, full-body motion, interaction with unmodified human environments, and intuitive human-robot interaction led to increased research interest. Multiple smaller platforms are available for research, but these require a miniaturized environment to interact with---and often the small scale of the robot diminishes the influence of factors which would have…
▽ More
The versatility of humanoid robots in locomotion, full-body motion, interaction with unmodified human environments, and intuitive human-robot interaction led to increased research interest. Multiple smaller platforms are available for research, but these require a miniaturized environment to interact with---and often the small scale of the robot diminishes the influence of factors which would have affected larger robots. Unfortunately, many research platforms in the larger size range are less affordable, more difficult to operate, maintain and modify, and very often closed-source. In this work, we introduce NimbRo-OP2X, an affordable, fully open-source platform in terms of both hardware and software. Being almost 135cm tall and only 18kg in weight, the robot is not only capable of interacting in an environment meant for humans, but also easy and safe to operate and does not require a gantry when doing so. The exoskeleton of the robot is 3D printed, which produces a lightweight and visually appealing design. We present all mechanical and electrical aspects of the robot, as well as some of the software features of our well-established open-source ROS software. The NimbRo-OP2X performed at RoboCup 2017 in Nagoya, Japan, where it won the Humanoid League AdultSize Soccer competition and Technical Challenge.
△ Less
Submitted 28 September, 2018;
originally announced September 2018.
-
RoboCup 2016 Humanoid TeenSize Winner NimbRo: Robust Visual Perception and Soccer Behaviors
Authors:
Hafez Farazi,
Philipp Allgeuer,
Grzegorz Ficht,
André Brandenburger,
Dmytro Pavlichenko,
Michael Schreiber,
Sven Behnke
Abstract:
The trend in the RoboCup Humanoid League rules over the past few years has been towards a more realistic and challenging game environment. Elementary skills such as visual perception and walking, which had become mature enough for exciting gameplay, are now once again core challenges. The field goals are both white, and the walking surface is artificial grass, which constitutes a much more irregul…
▽ More
The trend in the RoboCup Humanoid League rules over the past few years has been towards a more realistic and challenging game environment. Elementary skills such as visual perception and walking, which had become mature enough for exciting gameplay, are now once again core challenges. The field goals are both white, and the walking surface is artificial grass, which constitutes a much more irregular surface than the carpet used before. In this paper, team NimbRo TeenSize, the winner of the TeenSize class of the RoboCup 2016 Humanoid League, presents its robotic platforms, the adaptations that had to be made to them, and the newest developments in visual perception and soccer behaviour.
△ Less
Submitted 28 September, 2018;
originally announced September 2018.
-
The igus Humanoid Open Platform: A Child-sized 3D Printed Open-Source Robot for Research
Authors:
Philipp Allgeuer,
Hafez Farazi,
Grzegorz Ficht,
Michael Schreiber,
Sven Behnke
Abstract:
The use of standard robotic platforms can accelerate research and lower the entry barrier for new research groups. There exist many affordable humanoid standard platforms in the lower size ranges of up to 60cm, but larger humanoid robots quickly become less affordable and more difficult to operate, maintain and modify. The igus Humanoid Open Platform is a new and affordable, fully open-source huma…
▽ More
The use of standard robotic platforms can accelerate research and lower the entry barrier for new research groups. There exist many affordable humanoid standard platforms in the lower size ranges of up to 60cm, but larger humanoid robots quickly become less affordable and more difficult to operate, maintain and modify. The igus Humanoid Open Platform is a new and affordable, fully open-source humanoid platform. At 92cm in height, the robot is capable of interacting in an environment meant for humans, and is equipped with enough sensors, actuators and computing power to support researchers in many fields. The structure of the robot is entirely 3D printed, leading to a lightweight and visually appealing design. The main features of the platform are described in this article.
△ Less
Submitted 28 September, 2018;
originally announced September 2018.
-
Advanced Soccer Skills and Team Play of RoboCup 2017 TeenSize Winner NimbRo
Authors:
Diego Rodriguez,
Hafez Farazi,
Philipp Allgeuer,
Dmytro Pavlichenko,
Grzegorz Ficht,
André Brandenburger,
Johannes Kürsch,
Sven Behnke
Abstract:
In order to pursue the vision of the RoboCup Humanoid League of beating the soccer world champion by 2050, new rules and competitions are added or modified each year fostering novel technological advances. In 2017, the number of players in the TeenSize class soccer games was increase to 3 vs. 3, which allowed for more team play strategies. Improvements in individual skills were also demanded throu…
▽ More
In order to pursue the vision of the RoboCup Humanoid League of beating the soccer world champion by 2050, new rules and competitions are added or modified each year fostering novel technological advances. In 2017, the number of players in the TeenSize class soccer games was increase to 3 vs. 3, which allowed for more team play strategies. Improvements in individual skills were also demanded through a set of technical challenges. This paper presents the latest individual skills and team play developments used in RoboCup 2017 that lead our team Nimbro winning the 2017 TeenSize soccer tournament, the technical challenges, and the drop-in games.
△ Less
Submitted 14 September, 2018;
originally announced September 2018.
-
Grown-up NimbRo Robots Winning RoboCup 2017 Humanoid AdultSize Soccer Competitions
Authors:
Grzegorz Ficht,
Dmytro Pavlichenko,
Philipp Allgeuer,
Hafez Farazi,
Diego Rodriguez,
André Brandenburger,
Johannes Kürsch,
Michael Schreiber,
Sven Behnke
Abstract:
The ongoing evolution of the RoboCup Humanoid League led in 2017 to the introduction of one vs. one soccer games for the AdultSize robots, which motived our team NimbRo to enter this category. In this paper, we present the mechatronic design of our upgraded robot Copedo and the newly developed NimbRo-OP2, which received the RoboCup Design Award. We also describe improved approaches to visual perce…
▽ More
The ongoing evolution of the RoboCup Humanoid League led in 2017 to the introduction of one vs. one soccer games for the AdultSize robots, which motived our team NimbRo to enter this category. In this paper, we present the mechatronic design of our upgraded robot Copedo and the newly developed NimbRo-OP2, which received the RoboCup Design Award. We also describe improved approaches to visual perception of the game situation, including compassless localization on a soccer field with symmetric appearance, and the generation of soccer behaviors. At RoboCup 2017 in Nagoya, our robots played very well, winning the AdultSize soccer tournament with high scores. Our robots also won the technical challenges and we present the developed solutions.
△ Less
Submitted 13 September, 2018;
originally announced September 2018.
