-
Reliable edge machine learning hardware for scientific applications
Authors:
Tommaso Baldi,
Javier Campos,
Ben Hawks,
Jennifer Ngadiuba,
Nhan Tran,
Daniel Diaz,
Javier Duarte,
Ryan Kastner,
Andres Meza,
Melissa Quinnan,
Olivia Weng,
Caleb Geniesse,
Amir Gholami,
Michael W. Mahoney,
Vladimir Loncar,
Philip Harris,
Joshua Agar,
Shuyu Qin
Abstract:
Extreme data rate scientific experiments create massive amounts of data that require efficient ML edge processing. This leads to unique validation challenges for VLSI implementations of ML algorithms: enabling bit-accurate functional simulations for performance validation in experimental software frameworks, verifying those ML models are robust under extreme quantization and pruning, and enabling…
▽ More
Extreme data rate scientific experiments create massive amounts of data that require efficient ML edge processing. This leads to unique validation challenges for VLSI implementations of ML algorithms: enabling bit-accurate functional simulations for performance validation in experimental software frameworks, verifying those ML models are robust under extreme quantization and pruning, and enabling ultra-fine-grained model inspection for efficient fault tolerance. We discuss approaches to develo** and validating reliable algorithms at the scientific edge under such strict latency, resource, power, and area requirements in extreme experimental environments. We study metrics for develo** robust algorithms, present preliminary results and mitigation strategies, and conclude with an outlook of these and future directions of research towards the longer-term goal of develo** autonomous scientific experimentation methods for accelerated scientific discovery.
△ Less
Submitted 27 June, 2024;
originally announced June 2024.
-
Avatarm: an Avatar With Manipulation Capabilities for the Physical Metaverse
Authors:
Alberto Villani,
Giovanni Cortigiani,
Bernardo Brogi,
Nicole D'Aurizio,
Tommaso Lisini Baldi,
Domenico Prattichizzo
Abstract:
Metaverse is an immersive shared space that remote users can access through virtual and augmented reality interfaces, enabling their avatars to interact with each other and the surrounding. Although digital objects can be manipulated, physical objects cannot be touched, grasped, or moved within the metaverse due to the lack of a suitable interface. This work proposes a solution to overcome this li…
▽ More
Metaverse is an immersive shared space that remote users can access through virtual and augmented reality interfaces, enabling their avatars to interact with each other and the surrounding. Although digital objects can be manipulated, physical objects cannot be touched, grasped, or moved within the metaverse due to the lack of a suitable interface. This work proposes a solution to overcome this limitation by introducing the concept of a Physical Metaverse enabled by a new interface named "Avatarm". The Avatarm consists in an avatar enhanced with a robotic arm that performs physical manipulation tasks while remaining entirely hidden in the metaverse. The users have the illusion that the avatar is directly manipulating objects without the mediation by a robot. The Avatarm is the first step towards a new metaverse, the "Physical Metaverse", where users can physically interact each other and with the environment.
△ Less
Submitted 20 February, 2024; v1 submitted 27 March, 2023;
originally announced March 2023.
-
Exploiting Intrinsic Kinematic Null Space for Supernumerary Robotic Limbs Control
Authors:
Tommaso Lisini Baldi,
Nicole D'Aurizio,
Sergio Gurgone,
Daniele Borzelli,
Andrea D'Avella,
Domenico Prattichizzo
Abstract:
Supernumerary robotic limbs (SRLs) gained increasing interest in the last years for their applicability as healthcare and assistive technologies. These devices can either support or augment human sensorimotor capabilities, allowing users to complete tasks that are more complex than those feasible for their natural limbs. However, for a successful coordination between natural and artificial limbs,…
▽ More
Supernumerary robotic limbs (SRLs) gained increasing interest in the last years for their applicability as healthcare and assistive technologies. These devices can either support or augment human sensorimotor capabilities, allowing users to complete tasks that are more complex than those feasible for their natural limbs. However, for a successful coordination between natural and artificial limbs, intuitiveness of interaction and perception of autonomy are key enabling features, especially for people suffering from motor disorders and impairments. The development of suitable human-robot interfaces is thus fundamental to foster the adoption of SRLs.
With this work, we describe how to control an extra degree of freedom by taking advantage of what we defined the Intrinsic Kinematic Null Space, i.e. the redundancy of the human kinematic chain involved in the ongoing task. Obtained results demonstrated that the proposed control strategy is effective for performing complex tasks with a supernumerary robotic finger, and that practice improves users' control ability.
△ Less
Submitted 9 June, 2024; v1 submitted 7 December, 2020;
originally announced December 2020.
-
Wearable Haptics for Remote Social Walking
Authors:
Tommaso Lisini Baldi,
Gianluca Paolocci,
Davide Barcelli,
Domenico Prattichizzo
Abstract:
Walking is an essential activity for a healthy life, which becomes less tiring and more enjoyable if done together. Common difficulties we have in performing sufficient physical exercise, for instance the lack of motivation, can be overcome by exploiting its social aspect. However, our lifestyle sometimes makes it very difficult to find time together with others who live far away from us to go for…
▽ More
Walking is an essential activity for a healthy life, which becomes less tiring and more enjoyable if done together. Common difficulties we have in performing sufficient physical exercise, for instance the lack of motivation, can be overcome by exploiting its social aspect. However, our lifestyle sometimes makes it very difficult to find time together with others who live far away from us to go for a walk. In this paper we propose a novel system enabling people to have a 'remote social walk' by streaming the gait cadence between two persons walking in different places, increasing the sense of mutual presence. Vibrations provided at the users' ankles display the partner's sensation perceived during the heel-strike. In order to achieve the aforementioned goal in a two users experiment, we envisaged a four-step incremental validation process: i) a single walker has to adapt the cadence with a virtual reference generated by a software; ii) a single user is tasked to follow a predefined time varying gait cadence; iii) a leader-follower scenario in which the haptic actuation is mono-directional; iv) a peer-to-peer case with bi-directional haptic communication. Careful experimental validation was conducted involving a total of 50 people, which confirmed the efficacy of our system in perceiving the partners' gait cadence in each of the proposed scenarios.
△ Less
Submitted 14 January, 2020; v1 submitted 12 January, 2020;
originally announced January 2020.
-
Upper Body Pose Estimation Using Wearable Inertial Sensors and Multiplicative Kalman Filter
Authors:
Tommaso Lisini Baldi,
Francesco Farina,
Andrea Garulli,
Antonio Giannitrapani,
Domenico Prattichizzo
Abstract:
Estimating the limbs pose in a wearable way may benefit multiple areas such as rehabilitation, teleoperation, human-robot interaction, gaming, and many more. Several solutions are commercially available, but they are usually expensive or not wearable/portable. We present a wearable pose estimation system (WePosE), based on inertial measurements units (IMUs), for motion analysis and body tracking.…
▽ More
Estimating the limbs pose in a wearable way may benefit multiple areas such as rehabilitation, teleoperation, human-robot interaction, gaming, and many more. Several solutions are commercially available, but they are usually expensive or not wearable/portable. We present a wearable pose estimation system (WePosE), based on inertial measurements units (IMUs), for motion analysis and body tracking. Differently from camera-based approaches, the proposed system does not suffer from occlusion problems and lighting conditions, it is cost effective and it can be used in indoor and outdoor environments. Moreover, since only accelerometers and gyroscopes are used to estimate the orientation, the system can be used also in the presence of iron and magnetic disturbances. An experimental validation using a high precision optical tracker has been performed. Results confirmed the effectiveness of the proposed approach.
△ Less
Submitted 24 September, 2019; v1 submitted 23 September, 2019;
originally announced September 2019.
