-
Affordance segmentation of hand-occluded containers from exocentric images
Authors:
Tommaso Apicella,
Alessio Xompero,
Edoardo Ragusa,
Riccardo Berta,
Andrea Cavallaro,
Paolo Gastaldo
Abstract:
Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as occlusions. In this paper, we focus on occlusions of an object that is hand-held by a person manipulating it. To address this challenge, we propose an affordance s…
▽ More
Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as occlusions. In this paper, we focus on occlusions of an object that is hand-held by a person manipulating it. To address this challenge, we propose an affordance segmentation model that uses auxiliary branches to process the object and hand regions separately. The proposed model learns affordance features under hand-occlusion by weighting the feature map through hand and object segmentation. To train the model, we annotated the visual affordances of an existing dataset with mixed-reality images of hand-held containers in third-person (exocentric) images. Experiments on both real and mixed-reality images show that our model achieves better affordance segmentation and generalisation than existing models.
△ Less
Submitted 22 August, 2023;
originally announced August 2023.
-
Container Localisation and Mass Estimation with an RGB-D Camera
Authors:
Tommaso Apicella,
Giulia Slavic,
Edoardo Ragusa,
Paolo Gastaldo,
Lucio Marcenaro
Abstract:
In the research area of human-robot interactions, the automatic estimation of the mass of a container manipulated by a person leveraging only visual information is a challenging task. The main challenges consist of occlusions, different filling materials and lighting conditions. The mass of an object constitutes key information for the robot to correctly regulate the force required to grasp the co…
▽ More
In the research area of human-robot interactions, the automatic estimation of the mass of a container manipulated by a person leveraging only visual information is a challenging task. The main challenges consist of occlusions, different filling materials and lighting conditions. The mass of an object constitutes key information for the robot to correctly regulate the force required to grasp the container. We propose a single RGB-D camera-based method to locate a manipulated container and estimate its empty mass i.e., independently of the presence of the content. The method first automatically selects a number of candidate containers based on the distance with the fixed frontal view, then averages the mass predictions of a lightweight model to provide the final estimation. Results on the CORSMAL Containers Manipulation dataset show that the proposed method estimates empty container mass obtaining a score of 71.08% under different lighting or filling conditions.
△ Less
Submitted 2 March, 2022;
originally announced March 2022.
-
Direct observation of Jahn-Teller critical dynamics at a charge-order Verwey transition
Authors:
Vinícius Pascotto Gastaldo,
Mala N. Rao,
Alexey Bosak,
Matteo d'Astuto,
Andrea Prodi,
Marine Verseils,
Yannick Klein,
Christophe Bellin,
Luigi Paolasini,
Adilson J. A. de Oliveira,
Edmondo Gilioli,
Samrath Lal Chaplot,
Andrea Gauzzi
Abstract:
By means of diffuse and inelastic x-ray scattering (DS,IXS), we probe directly the charge-ordering (CO) dynamics in the Verwey system (NaMn$_3$)Mn$_4$O$_{12}$, where a peculiar quadruple perovskite structure with no oxygen disorder stabilizes a nearly full Mn$^{3+}$/Mn$^{4+}$ static charge order at $T_{\rm CO}$=175 K concomitant to a commensurate structural modulation with propagation vector…
▽ More
By means of diffuse and inelastic x-ray scattering (DS,IXS), we probe directly the charge-ordering (CO) dynamics in the Verwey system (NaMn$_3$)Mn$_4$O$_{12}$, where a peculiar quadruple perovskite structure with no oxygen disorder stabilizes a nearly full Mn$^{3+}$/Mn$^{4+}$ static charge order at $T_{\rm CO}$=175 K concomitant to a commensurate structural modulation with propagation vector ${\bf q}_{\rm CO}=(\frac{1}{2},\frac{1}{2},0)$. At $T_{\rm CO}$, the IXS spectra unveil a softening of a 35.3 meV phonon at ${\bf q}_{\rm CO}$. Lattice dynamical calculations enable us to attribute this soft phonon to a A$_g$ mode whose polarization matches the Jahn-Teller-like distortion pattern of the structural modulation. This result demonstrates that the Jahn-Teller instability is the driving force of the CO Verwey transition in (NaMn$_3$)Mn$_4$O$_{12}$, thus elucidating a long-standing controversy regarding the mechanism of this transition observed in other mixed-valence systems like magnetite.
△ Less
Submitted 8 December, 2021;
originally announced December 2021.
-
Unconventional magnetic ferroelectricity in the quadruple perovskite NaMn$_7$O$_{12}$
Authors:
Vinícius Pascotto Gastaldo,
Yannick Klein,
Benoît Baptiste,
Riccardo Cabassi,
Edmondo Gilioli,
Andrea Gauzzi,
Adilson J. A. de Oliveira
Abstract:
By means of magnetic, specific heat and pyroelectric measurements, we report on magnetic ferroelectricity in the quadruple perovskite \namno, characterized by a canted antiferromagnetic (AFM) CE structure. Surprisingly, ferroelectricity is concomitant to a dramatic broadening of the magnetic hysteresis loop, well below the AFM ordering temperature. This unconventional behavior shows that the forma…
▽ More
By means of magnetic, specific heat and pyroelectric measurements, we report on magnetic ferroelectricity in the quadruple perovskite \namno, characterized by a canted antiferromagnetic (AFM) CE structure. Surprisingly, ferroelectricity is concomitant to a dramatic broadening of the magnetic hysteresis loop, well below the AFM ordering temperature. This unconventional behavior shows that the formation of ferroelectric domains is induced by the symmetric exchange interaction in the local scale, e.g. at magnetic domain boundaries or defects. The value of electric polarization, $P = 0.027 μ$C cm$^{-2}$, measured in polycrystalline samples is comparatively large as compared to other magnetic multiferroics, suggesting that the above scenario is promising indeed for the rational design of practical multiferroic materials.
△ Less
Submitted 3 November, 2020; v1 submitted 24 August, 2020;
originally announced August 2020.
-
Ferroelectricity in the 1 $μ$C cm$^{-2}$ range induced by canted antiferromagnetism in (LaMn$_{3}$)Mn$_{4}$O$_{12}$
Authors:
A. Gauzzi,
F. Milton,
V. Pascotto Gastaldo,
M. Verseils,
A. Gualdi,
D. Dreifus,
Y. Klein,
D. Garcia,
A. J. A de Oliveira,
P. Bordet,
E. Gilioli
Abstract:
Pyroelectric current and magnetoelectric coupling measurements on polycrystalline samples of the quadruple perovskite (LaMn$_{3}$)Mn$_{4}$O$_{12}$ give evidence of ferroelectricity driven by the antiferromagnetic ordering of the $B$-site Mn$^{3+}$ ions at $T_{N,B}$=78 K with record values of remnant electric polarization up to $P$=0.56 $μ$C cm$^{-2}$. X-ray diffraction measurements indicates an an…
▽ More
Pyroelectric current and magnetoelectric coupling measurements on polycrystalline samples of the quadruple perovskite (LaMn$_{3}$)Mn$_{4}$O$_{12}$ give evidence of ferroelectricity driven by the antiferromagnetic ordering of the $B$-site Mn$^{3+}$ ions at $T_{N,B}$=78 K with record values of remnant electric polarization up to $P$=0.56 $μ$C cm$^{-2}$. X-ray diffraction measurements indicates an anomalous behavior of the monoclinic $β$ angle at $T_{N,B}$, which suggests that $P$ lies in the $ac$-plane, where the moments are collinear, so we conclude that exchange striction is the mechanism of spin-driven ferroelectricity. Polarization values $\sim$3 $μ$C cm$^{-2}$ are expected in single crystals, which would open the avenue towards practical multiferroic applications.
△ Less
Submitted 17 November, 2018;
originally announced November 2018.
