Learning Agent-Aware Affordances for Closed-Loop Interaction with Articulated Objects
Authors:
Giulio Schiavi,
Paula Wulkop,
Giuseppe Rizzi,
Lionel Ott,
Roland Siegwart,
Jen Jen Chung
Abstract:
Interactions with articulated objects are a challenging but important task for mobile robots. To tackle this challenge, we propose a novel closed-loop control pipeline, which integrates manipulation priors from affordance estimation with sampling-based whole-body control. We introduce the concept of agent-aware affordances which fully reflect the agent's capabilities and embodiment and we show tha…
▽ More
Interactions with articulated objects are a challenging but important task for mobile robots. To tackle this challenge, we propose a novel closed-loop control pipeline, which integrates manipulation priors from affordance estimation with sampling-based whole-body control. We introduce the concept of agent-aware affordances which fully reflect the agent's capabilities and embodiment and we show that they outperform their state-of-the-art counterparts which are only conditioned on the end-effector geometry. Additionally, closed-loop affordance inference is found to allow the agent to divide a task into multiple non-continuous motions and recover from failure and unexpected states. Finally, the pipeline is able to perform long-horizon mobile manipulation tasks, i.e. opening and closing an oven, in the real world with high success rates (opening: 71%, closing: 72%).
△ Less
Submitted 6 February, 2023; v1 submitted 13 September, 2022;
originally announced September 2022.
Voliro: An Omnidirectional Hexacopter With Tiltable Rotors
Authors:
Mina Kamel,
Sebastian Verling,
Omar Elkhatib,
Christian Sprecher,
Paula Wulkop,
Zachary Taylor,
Roland Siegwart,
Igor Gilitschenski
Abstract:
Extending the maneuverability of unmanned areal vehicles promises to yield a considerable increase in the areas in which these systems can be used. Some such applications are the performance of more complicated inspection tasks and the generation of complex uninterrupted movements of an attached camera. In this paper we address this challenge by presenting Voliro, a novel aerial platform that comb…
▽ More
Extending the maneuverability of unmanned areal vehicles promises to yield a considerable increase in the areas in which these systems can be used. Some such applications are the performance of more complicated inspection tasks and the generation of complex uninterrupted movements of an attached camera. In this paper we address this challenge by presenting Voliro, a novel aerial platform that combines the advantages of existing multi-rotor systems with the agility of omnidirectionally controllable platforms. We propose the use of a hexacopter with tiltable rotors allowing the system to decouple the control of position and orientation. The contributions of this work involve the mechanical design as well as a controller with the corresponding allocation scheme. This work also discusses the design challenges involved when turning the concept of a hexacopter with tiltable rotors into an actual prototype. The agility of the system is demonstrated and evaluated in real- world experiments.
△ Less
Submitted 14 January, 2018;
originally announced January 2018.
