-
LinkGlide-S: A Wearable Multi-Contact Tactile Display Aimed at Rendering Object Softness at the Palm with Impedance Control in VR and Telemanipulation
Authors:
Miguel Altamirano Cabrera,
Jonathan Tirado,
Juan Heredia,
Dzmitry Tsetserukou
Abstract:
LinkGlide-S is a novel wearable hand-worn tactile display to deliver multi-contact and multi-modal stimuli at the user's palm.} The array of inverted five-bar linkages generates three independent contact points to cover the whole palm area. \textcolor{black} {The independent contact points generate various tactile patterns at the user's hand, providing multi-contact tactile feedback. An impedance…
▽ More
LinkGlide-S is a novel wearable hand-worn tactile display to deliver multi-contact and multi-modal stimuli at the user's palm.} The array of inverted five-bar linkages generates three independent contact points to cover the whole palm area. \textcolor{black} {The independent contact points generate various tactile patterns at the user's hand, providing multi-contact tactile feedback. An impedance control delivers the stiffness of objects according to different parameters. Three experiments were performed to evaluate the perception of patterns, investigate the realistic perception of object interaction in Virtual Reality, and assess the users' softness perception by the impedance control. The experimental results revealed a high recognition rate for the generated patterns. These results confirm that the performance of LinkGlide-S is adequate to detect and manipulate virtual objects with different stiffness. This novel haptic device can potentially achieve a highly immersive VR experience and more interactive applications during telemanipulation.
△ Less
Submitted 30 August, 2022;
originally announced August 2022.
-
Jacobian Computation for Cumulative B-Splines on SE(3) and Application to Continuous-Time Object Tracking
Authors:
Javier Tirado,
Javier Civera
Abstract:
In this paper we propose a method that estimates the $SE(3)$ continuous trajectories (orientation and translation) of the dynamic rigid objects present in a scene, from multiple RGB-D views. Specifically, we fit the object trajectories to cumulative B-Splines curves, which allow us to interpolate, at any intermediate time stamp, not only their poses but also their linear and angular velocities and…
▽ More
In this paper we propose a method that estimates the $SE(3)$ continuous trajectories (orientation and translation) of the dynamic rigid objects present in a scene, from multiple RGB-D views. Specifically, we fit the object trajectories to cumulative B-Splines curves, which allow us to interpolate, at any intermediate time stamp, not only their poses but also their linear and angular velocities and accelerations. Additionally, we derive in this work the analytical $SE(3)$ Jacobians needed by the optimization, being applicable to any other approach that uses this type of curves. To the best of our knowledge this is the first work that proposes 6-DoF continuous-time object tracking, which we endorse with significant computational cost reduction thanks to our analytical derivations. We evaluate our proposal in synthetic data and in a public benchmark, showing competitive results in localization and significant improvements in velocity estimation in comparison to discrete-time approaches.
△ Less
Submitted 24 May, 2022; v1 submitted 25 January, 2022;
originally announced January 2022.
-
CoboGuider: Haptic Potential Fields for Safe Human-Robot Interaction
Authors:
Viktor Rakhmatulin,
Miguel Altamirano Cabrera,
Fikre Hagos,
Oleg Sautenkov,
Jonathan Tirado,
Ighor Uzhinsky,
Dzmitry Tsetserukou
Abstract:
Modern industry still relies on manual manufacturing operations and safe human-robot interaction is of great interest nowadays. Speed and Separation Monitoring (SSM) allows close and efficient collaborative scenarios by maintaining a protective separation distance during robot operation. The paper focuses on a novel approach to strengthen the SSM safety requirements by introducing haptic feedback…
▽ More
Modern industry still relies on manual manufacturing operations and safe human-robot interaction is of great interest nowadays. Speed and Separation Monitoring (SSM) allows close and efficient collaborative scenarios by maintaining a protective separation distance during robot operation. The paper focuses on a novel approach to strengthen the SSM safety requirements by introducing haptic feedback to a robotic cell worker. Tactile stimuli provide early warning of dangerous movements and proximity to the robot, based on the human reaction time and instantaneous velocities of robot and operator. A preliminary experiment was performed to identify the reaction time of participants when they are exposed to tactile stimuli in a collaborative environment with controlled conditions. In a second experiment, we evaluated our approach into a study case where human worker and cobot performed collaborative planetary gear assembly. Results show that the applied approach increased the average minimum distance between the robot's end-effector and hand by 44% compared to the operator relying only on the visual feedback. Moreover, the participants without the haptic support have failed several times to maintain the protective separation distance.
△ Less
Submitted 16 December, 2021; v1 submitted 25 October, 2021;
originally announced October 2021.
-
CoHaptics: Development of Human-Robot Collaborative System with Forearm-worn Haptic Display to Increase Safety in Future Factories
Authors:
Miguel Altamirano Cabrera,
Juan Heredia,
Jonathan Tirado,
Vladislav Panov,
Fikre Hagos,
Dzmitry Tsetserukou
Abstract:
Complex tasks require human collaboration since robots do not have enough dexterity. However, robots are still used as instruments and not as collaborative systems. We are introducing a framework to ensure safety in a human-robot collaborative environment. The system is composed of a haptic feedback display, low-cost wearable mocap, and a new collision avoidance algorithm based on the Artificial P…
▽ More
Complex tasks require human collaboration since robots do not have enough dexterity. However, robots are still used as instruments and not as collaborative systems. We are introducing a framework to ensure safety in a human-robot collaborative environment. The system is composed of a haptic feedback display, low-cost wearable mocap, and a new collision avoidance algorithm based on the Artificial Potential Fields (APF). Wearable optical motion capturing system enables tracking the human hand position with high accuracy and low latency on large working areas. This study evaluates whether haptic feedback improves safety in human-robot collaboration. Three experiments were carried out to evaluate the performance of the proposed system. The first one evaluated human responses to the haptic device during interaction with the Robot Tool Center Point (TCP). The second experiment analyzed human-robot behavior during an imminent collision. The third experiment evaluated the system in a collaborative activity in a shared working environment. This study had shown that when haptic feedback in the control loop was included, the safe distance (minimum robot-obstacle distance) increased by 4.1 cm from 12.39 cm to 16.55 cm, and the robot's path, when the collision avoidance algorithm was activated, was reduced by 81%.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition
Authors:
Ilya Zakharkin,
Arman Tsaturyan,
Miguel Altamirano-Cabrera,
Jonathan Tirado,
Dzmitry Tsetserukou
Abstract:
We present ZoomTouch - a breakthrough technology for multi-user control of robot from Zoom in real-time by DNN-based gesture recognition. The users from digital world can have a video conferencing and manipulate the robot to make the dexterous manipulations with tangible objects. As the scenario, we proposed the remote COVID-19 test Laboratory to considerably reduce the time to receive the data an…
▽ More
We present ZoomTouch - a breakthrough technology for multi-user control of robot from Zoom in real-time by DNN-based gesture recognition. The users from digital world can have a video conferencing and manipulate the robot to make the dexterous manipulations with tangible objects. As the scenario, we proposed the remote COVID-19 test Laboratory to considerably reduce the time to receive the data and substitute medical assistant working in protective gear in close proximity with infected cells. The proposed technology suggests a new type of reality, where multi-users can jointly interact with remote object, e.g. make a new building design, joint cooking in robotic kitchen, etc, and discuss/modify the results at the same time.
△ Less
Submitted 7 November, 2020;
originally announced November 2020.
-
MaskBot: Real-time Robotic Projection Map** with Head Motion Tracking
Authors:
Miguel Altamirano-Cabrera,
Igor Usachev,
Juan Heredia,
Jonathan Tirado,
Aleksey Fedoseev,
Dzmitry Tsetserukou
Abstract:
The projection map** systems on the human face is limited by the latency and the movement of the users. The area of the projection is restricted by the position of the projectors and the cameras. We are introducing MaskBot, a real-time projection map** system operated by a 6 Degrees of Freedom (DoF) collaborative robot. The collaborative robot locates the projector and camera in normal positio…
▽ More
The projection map** systems on the human face is limited by the latency and the movement of the users. The area of the projection is restricted by the position of the projectors and the cameras. We are introducing MaskBot, a real-time projection map** system operated by a 6 Degrees of Freedom (DoF) collaborative robot. The collaborative robot locates the projector and camera in normal position to the face of the user to increase the projection area and to reduce the latency of the system. A webcam is used to detect the face and to sense the robot-user distance to modify the projection size and orientation. MaskBot projects different images on the face of the user, such as face modifications, make-up, and logos. In contrast to the existing methods, the presented system is the first that introduces a robotic projection map**. One of the prospective applications is to acquire a dataset of adversarial images to challenge face detection DNN systems, such as Face ID.
△ Less
Submitted 7 November, 2020;
originally announced November 2020.
-
ElectroAR: Distributed Electro-tactile Stimulation for Tactile Transfer
Authors:
Jonathan Tirado,
Vladislav Panov,
Vibol Yem,
Dzmitry Tsetserukou,
Hiroyuki Kajimoto
Abstract:
We present ElectroAR, a visual and tactile sharing system for hand skills training. This system comprises a head-mounted display (HMD), two cameras, tactile sensing glove, and electro-stimulation glove. The trainee wears a tactile sensing glove that gets pressure data from touching different objects. His movements are recorded by two cameras, which are located in front and top side of the workspac…
▽ More
We present ElectroAR, a visual and tactile sharing system for hand skills training. This system comprises a head-mounted display (HMD), two cameras, tactile sensing glove, and electro-stimulation glove. The trainee wears a tactile sensing glove that gets pressure data from touching different objects. His movements are recorded by two cameras, which are located in front and top side of the workspace. In the remote site, the trainer wears the electro-tactile stimulation glove. This glove transforms the remotely collected pressure data to electro-tactile stimuli. Additionally, the trainer wears an HMD to see and guide the movements of the trainee. The key part of this project is to combine distributed tactile sensor and electro-tactile display to let the trainer understand what the trainee is doing. Results show our system supports a higher user recognition performance.
△ Less
Submitted 21 July, 2020;
originally announced July 2020.
-
CobotGear: Interaction with Collaborative Robots using Wearable Optical Motion Capturing Systems
Authors:
Juan Heredia,
Miguel Altamirano Cabrera,
Jonathan Tirado,
Vladislav Panov,
Dzmitry Tsetserukou
Abstract:
In industrial applications, complex tasks require human collaboration since the robot doesn't have enough dexterity. However, the robots are still implemented as tools and not as collaborative intelligent systems. To ensure safety in the human-robot collaboration, we introduce a system that presents a new method that integrates low-cost wearable mocap, and an improved collision avoidance algorithm…
▽ More
In industrial applications, complex tasks require human collaboration since the robot doesn't have enough dexterity. However, the robots are still implemented as tools and not as collaborative intelligent systems. To ensure safety in the human-robot collaboration, we introduce a system that presents a new method that integrates low-cost wearable mocap, and an improved collision avoidance algorithm based on the artificial potential fields. Wearable optical motion capturing allows to track the human hand position with high accuracy and low latency on large working areas. To increase the efficiency of the proposed algorithm, two obstacle types are discriminated according to their collision probability. A preliminary experiment was performed to analyze the algorithm behavior and to select the best values for the obstacle's threshold angle $θ_{OBS}$, and for the avoidance threshold distance $d_{AT}$. The second experiment was carried out to evaluate the system performance with $d_{AT}$ = 0.2 m and $θ_{OBS}$ = 45 degrees. The third experiment evaluated the system in a real collaborative task. The results demonstrate the robust performance of the robotic arm generating smooth collision-free trajectories. The proposed technology will allow consumer robots to safely collaborate with humans in cluttered environments, e.g., factories, kitchens, living rooms, and restaurants.
△ Less
Submitted 20 July, 2020;
originally announced July 2020.
-
RecyGlide : A Forearm-worn Multi-modal Haptic Display aimed to Improve User VR Immersion
Authors:
Juan Heredia,
Jonathan Tirado,
Vladislav Panov,
Miguel Altamirano,
Youcef Kamal-Toumi,
Dzmitry Tsetserukou
Abstract:
Haptic devices have been employed to immerse users in VR environments. In particular, hand and finger haptic devices have been deeply developed. However, this type of device occlude the hand detection by some tracking systems, or in other tracking systems, it is uncomfortable for the users to wear two-hand devices (haptic and tracking device). We introduce RecyGlide, which is a novel wearable fore…
▽ More
Haptic devices have been employed to immerse users in VR environments. In particular, hand and finger haptic devices have been deeply developed. However, this type of device occlude the hand detection by some tracking systems, or in other tracking systems, it is uncomfortable for the users to wear two-hand devices (haptic and tracking device). We introduce RecyGlide, which is a novel wearable forearm multimodal display at the forearm. The RecyGlide is composed of inverted five-bar linkages and vibration motors. The device provides multimodal tactile feedback such as slippage, a force vector, pressure, and vibration. We tested the discrimination ability of monomodal and multimodal stimuli patterns in the forearm and confirmed that the multimodal stimuli patterns are more recognizable. This haptic device was used in VR applications, and we proved that it enhances VR experience and makes it more interactive.
△ Less
Submitted 17 November, 2019; v1 submitted 13 November, 2019;
originally announced November 2019.
-
Web Data Knowledge Extraction
Authors:
Juan M. Tirado,
Ovidiu Serban,
Qiang Guo,
Eiko Yoneki
Abstract:
A constantly growing amount of information is available through the web. Unfortunately, extracting useful content from this massive amount of data still remains an open issue. The lack of standard data models and structures forces developers to create adhoc solutions from the scratch. The figure of the expert is still needed in many situations where developers do not have the correct background kn…
▽ More
A constantly growing amount of information is available through the web. Unfortunately, extracting useful content from this massive amount of data still remains an open issue. The lack of standard data models and structures forces developers to create adhoc solutions from the scratch. The figure of the expert is still needed in many situations where developers do not have the correct background knowledge. This forces developers to spend time acquiring the needed background from the expert. In other directions, there are promising solutions employing machine learning techniques. However, increasing accuracy requires an increase in system complexity that cannot be endured in many projects. In this work, we approach the web knowledge extraction problem using an expertcentric methodology. This methodology defines a set of configurable, extendible and independent components that permit the reutilisation of large pieces of code among projects. Our methodology differs from similar solutions in its expert-driven design. This design, makes it possible for subject-matter expert to drive the knowledge extraction for a given set of documents. Additionally, we propose the utilization of machine assisted solutions that guide the expert during this process. To demonstrate the capabilities of our methodology, we present a real use case scenario in which public procurement data is extracted from the web-based repositories of several public institutions across Europe. We provide insightful details about the challenges we had to deal with in this use case and additional discussions about how to apply our methodology.
△ Less
Submitted 24 March, 2016;
originally announced March 2016.
