-
Bent & Broken Bicycles: Leveraging synthetic data for damaged object re-identification
Authors:
Luca Piano,
Filippo Gabriele Pratticò,
Alessandro Sebastian Russo,
Lorenzo Lanari,
Lia Morra,
Fabrizio Lamberti
Abstract:
Instance-level object re-identification is a fundamental computer vision task, with applications from image retrieval to intelligent monitoring and fraud detection. In this work, we propose the novel task of damaged object re-identification, which aims at distinguishing changes in visual appearance due to deformations or missing parts from subtle intra-class variations. To explore this task, we le…
▽ More
Instance-level object re-identification is a fundamental computer vision task, with applications from image retrieval to intelligent monitoring and fraud detection. In this work, we propose the novel task of damaged object re-identification, which aims at distinguishing changes in visual appearance due to deformations or missing parts from subtle intra-class variations. To explore this task, we leverage the power of computer-generated imagery to create, in a semi-automatic fashion, high-quality synthetic images of the same bike before and after a damage occurs. The resulting dataset, Bent & Broken Bicycles (BBBicycles), contains 39,200 images and 2,800 unique bike instances spanning 20 different bike models. As a baseline for this task, we propose TransReI3D, a multi-task, transformer-based deep network unifying damage detection (framed as a multi-label classification task) with object re-identification. The BBBicycles dataset is available at https://huggingface.co/datasets/GrainsPolito/BBBicycles
△ Less
Submitted 16 April, 2023;
originally announced April 2023.
-
Gait Generation using Intrinsically Stable MPC in the Presence of Persistent Disturbances
Authors:
Filippo M. Smaldone,
Nicola Scianca,
Valerio Modugno,
Leonardo Lanari,
Giuseppe Oriolo
Abstract:
Maintaining balance while walking is not a simple task for a humanoid robot because of its complex dynamics. The presence of a persistent disturbance makes this task even more challenging, as it can cause a loss of balance and ultimately lead the the robot to a fall. In this paper, we extend our previously proposed Intrinsically Stable MPC (IS-MPC), which guarantees boundedness of the CoM with res…
▽ More
Maintaining balance while walking is not a simple task for a humanoid robot because of its complex dynamics. The presence of a persistent disturbance makes this task even more challenging, as it can cause a loss of balance and ultimately lead the the robot to a fall. In this paper, we extend our previously proposed Intrinsically Stable MPC (IS-MPC), which guarantees boundedness of the CoM with respect to the ZMP, to the case of persistent disturbances. This is achieved by designing a disturbance observer whose estimate is used to compute a modified stability constraint included in the QP problem formulation. The method is validated by MATLAB simulations for the LIP as well as dynamic simulations for a NAO humanoid in DART.
△ Less
Submitted 13 July, 2019;
originally announced July 2019.
-
MPC for Humanoid Gait Generation: Stability and Feasibility
Authors:
Nicola Scianca,
Daniele De Simone,
Leonardo Lanari,
Giuseppe Oriolo
Abstract:
We present IS-MPC, an intrinsically stable MPC framework for humanoid gait generation which incorporates an explicit stability constraint in the formulation. The proposed method uses as prediction model a dynamically extended LIP where ZMP velocities are the control inputs, producing in real time a gait (including footsteps with the associated timing) that realizes omnidirectional motion commands…
▽ More
We present IS-MPC, an intrinsically stable MPC framework for humanoid gait generation which incorporates an explicit stability constraint in the formulation. The proposed method uses as prediction model a dynamically extended LIP where ZMP velocities are the control inputs, producing in real time a gait (including footsteps with the associated timing) that realizes omnidirectional motion commands coming from an external source. The stability constraint links the future ZMP velocities to the current system state so as to guarantee the essential requirement that the generated CoM trajectory is bounded with respect to the ZMP trajectory. Since the control horizon of the MPC algorithm is finite, only part of the future ZMP velocities are decision variables of the QP problem; the remaining part, called tail, must be either conjectured or anticipated using preview information on the reference motion. Several possible options for the tail are discussed, and each of them is shown to correspond to a specific terminal constraint. A theoretical analysis of the feasibility of the generic MPC iteration is developed and used to obtain sufficient conditions for recursive feasibility. Finally, it is proved that IS-MPC guarantees stability of the CoM/ZMP dynamics if it is recursively feasible. Simulation and experimental results on the NAO and the HRP-4 humanoids are presented to illustrate the performance of the proposed method.
△ Less
Submitted 22 January, 2020; v1 submitted 24 January, 2019;
originally announced January 2019.
-
Capturability-based Pattern Generation for Walking with Variable Height
Authors:
Stéphane Caron,
Adrien Escande,
Leonardo Lanari,
Bastien Mallein
Abstract:
Capturability analysis of the linear inverted pendulum (LIP) model enabled walking with constrained height based on the capture point. We generalize this analysis to the variable-height inverted pendulum (VHIP) and show how it enables 3D walking over uneven terrains based on capture inputs. Thanks to a tailored optimization scheme, we can compute these inputs fast enough for real-time mode…
▽ More
Capturability analysis of the linear inverted pendulum (LIP) model enabled walking with constrained height based on the capture point. We generalize this analysis to the variable-height inverted pendulum (VHIP) and show how it enables 3D walking over uneven terrains based on capture inputs. Thanks to a tailored optimization scheme, we can compute these inputs fast enough for real-time model predictive control. We implement this approach as open-source software and demonstrate it in dynamic simulations.
△ Less
Submitted 25 October, 2018; v1 submitted 22 January, 2018;
originally announced January 2018.
