-
Learning In-Hand Translation Using Tactile Skin With Shear and Normal Force Sensing
Authors:
Jessica Yin,
Haozhi Qi,
Jitendra Malik,
James Pikul,
Mark Yim,
Tess Hellebrekers
Abstract:
Recent progress in reinforcement learning (RL) and tactile sensing has significantly advanced dexterous manipulation. However, these methods often utilize simplified tactile signals due to the gap between tactile simulation and the real world. We introduce a sensor model for tactile skin that enables zero-shot sim-to-real transfer of ternary shear and binary normal forces. Using this model, we dev…
▽ More
Recent progress in reinforcement learning (RL) and tactile sensing has significantly advanced dexterous manipulation. However, these methods often utilize simplified tactile signals due to the gap between tactile simulation and the real world. We introduce a sensor model for tactile skin that enables zero-shot sim-to-real transfer of ternary shear and binary normal forces. Using this model, we develop an RL policy that leverages sliding contact for dexterous in-hand translation. We conduct extensive real-world experiments to assess how tactile sensing facilitates policy adaptation to various unseen object properties and robot hand orientations. We demonstrate that our 3-axis tactile policies consistently outperform baselines that use only shear forces, only normal forces, or only proprioception. Website: https://jessicayin.github.io/tactile-skin-rl/
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Thermal effect on microwave pulse driven magnetization switching of Stoner particle
Authors:
S. Chowdhury,
M. A. S. Akanda,
M. A. J. Pikul,
M. T. Islam,
Tai Min
Abstract:
Recently it has been demonstrated that the cosine chirp microwave pulse (CCMP) is capable of achieving fast and energy-efficient magnetization-reversal of a nanoparticle with zero-Temperature. However, we investigate the finite temperature, $T$ effect on the CCMP-driven magnetization reversal using the framework of the stochastic Landau Lifshitz Gilbert equation. At finite Temperature, we obtain t…
▽ More
Recently it has been demonstrated that the cosine chirp microwave pulse (CCMP) is capable of achieving fast and energy-efficient magnetization-reversal of a nanoparticle with zero-Temperature. However, we investigate the finite temperature, $T$ effect on the CCMP-driven magnetization reversal using the framework of the stochastic Landau Lifshitz Gilbert equation. At finite Temperature, we obtain the CCMP-driven fast and energy-efficient reversal and hence estimate the maximal temperature, $T_{max}$ at which the magnetization reversal is valid. $T_{max}$ increases with increasing the nanoparticle cross-sectional area/shape anisotropy up to a certain value, and afterward $T_{max}$ decreases with the further increment of nanoparticle cross-sectional area/shape anisotropy. This is because of demagnetization/shape anisotropy field opposes the magnetocrystalline anisotropy, i.e., reduces the energy barrier which separates the two stable states. For smaller cross-sectional area/shape anisotropy, the controlling parameters of CCMP show decreasing trend with temperature. We also find that with the increment easy-plane shape-anisotropy, the required initial frequency of CCMP significantly reduces. For the larger volume of nanoparticles, the parameters of CCMP remains constant for a wide range of temperature which are desired for the device application. Therefore, The above findings might be useful to realize the CCMP-driven fast and energy-efficient magnetization reversal in realistic conditions.
△ Less
Submitted 24 August, 2023;
originally announced August 2023.
-
Proximity and Visuotactile Point Cloud Fusion for Contact Patches in Extreme Deformation
Authors:
Jessica Yin,
Paarth Shah,
Naveen Kuppuswamy,
Andrew Beaulieu,
Avinash Uttamchandani,
Alejandro Castro,
James Pikul,
Russ Tedrake
Abstract:
Equip** robots with the sense of touch is critical to emulating the capabilities of humans in real world manipulation tasks. Visuotactile sensors are a popular tactile sensing strategy due to data output compatible with computer vision algorithms and accurate, high resolution estimates of local object geometry. However, these sensors struggle to accommodate high deformations of the sensing surfa…
▽ More
Equip** robots with the sense of touch is critical to emulating the capabilities of humans in real world manipulation tasks. Visuotactile sensors are a popular tactile sensing strategy due to data output compatible with computer vision algorithms and accurate, high resolution estimates of local object geometry. However, these sensors struggle to accommodate high deformations of the sensing surface during object interactions, hindering more informative contact with cm-scale objects frequently encountered in the real world. The soft interfaces of visuotactile sensors are often made of hyperelastic elastomers, which are difficult to simulate quickly and accurately when extremely deformed for tactile information. Additionally, many visuotactile sensors that rely on strict internal light conditions or pattern tracking will fail if the surface is highly deformed. In this work, we propose an algorithm that fuses proximity and visuotactile point clouds for contact patch segmentation that is entirely independent from membrane mechanics. This algorithm exploits the synchronous, high-res proximity and visuotactile modalities enabled by an extremely deformable, selectively transmissive soft membrane, which uses visible light for visuotactile sensing and infrared light for proximity depth. We present the hardware design, membrane fabrication, and evaluation of our contact patch algorithm in low (10%), medium (60%), and high (100%+) membrane strain states. We compare our algorithm against three baselines: proximity-only, tactile-only, and a membrane mechanics model. Our proposed algorithm outperforms all baselines with an average RMSE under 2.8mm of the contact patch geometry across all strain ranges. We demonstrate our contact patch algorithm in four applications: varied stiffness membranes, torque and shear-induced wrinkling, closed loop control for whole body manipulation, and pose estimation.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
Electroadhesive Clutches for Programmable Shape Morphing of Soft Actuators
Authors:
Gregory M. Campbell,
Jessica Yin,
Yuyang Song,
Umesh Gandhi,
Mark Yim,
James Pikul
Abstract:
Soft robotic actuators are safe and adaptable devices with inherent compliance, which makes them attractive for manipulating delicate and complex objects. Researchers have integrated stiff materials into soft actuators to increase their force capacity and direct their deformation. However, these embedded materials have largely been pre-prescribed and static, which constrains the actuators to a pre…
▽ More
Soft robotic actuators are safe and adaptable devices with inherent compliance, which makes them attractive for manipulating delicate and complex objects. Researchers have integrated stiff materials into soft actuators to increase their force capacity and direct their deformation. However, these embedded materials have largely been pre-prescribed and static, which constrains the actuators to a predetermined range of motion. In this work, electroadhesive (EA) clutches integrated on a single-chamber soft pneumatic actuator (SPA) provide local programmable stiffness modulation to control the actuator deformation. We show that activating different clutch patterns inflates a silicone membrane into pyramidal, round, and plateau shapes. Curvatures from these shapes are combined during actuation to apply forces on both a 3.7 g and 820 g object along five different degrees of freedom (DoF). The actuator workspace is up to 12 mm for light objects. Clutch deactivation, which results in local elastomeric expansion, rapidly applies forces up to 3.2 N to an object resting on the surface and launches a 3.7 g object in controlled directions. The actuator also rotates a heavier, 820 g, object by 5 degrees and rapidly restores it to horizontal alignment after clutch deactivation. This actuator is fully powered by a 5 V battery, AA battery, DC-DC transformer, and 4.5 V (63 g) DC air pump. These results demonstrate a first step towards realizing a soft actuator with high DoF shape change that preserves the inherent benefits of pneumatic actuation while gaining the electrical controllability and strength of EA clutches. We envision such a system supplying human contact forces in the form of a low-profile sit-to-stand assistance device, bed-ridden patient manipulator, or other ergonomic mechanism.
This technology was also demonstrated at ICRA 2022: https://www.youtube.com/watch?v=6Y6-iHWNi6s
△ Less
Submitted 14 November, 2022;
originally announced November 2022.
-
Role of shape anisotropy on thermal gradient-driven domain wall dynamics in magnetic nanowires
Authors:
M. T. Islam,
M. A. S. Akanda,
F. Yesmin,
M. A. J. Pikul,
J. M. T. Islam
Abstract:
We investigate the magnetic domain wall (DW) dynamics in uniaxial/biaxial nanowires under a thermal gradient (TG). The findings reveal that the DW propagates toward the hotter region in both nanowires. The main physics of such observations is the magnonic angular momentum transfer to the DW. The hard (shape) anisotropy exists in biaxial nanowire, which contributes an additional torque, hence DW sp…
▽ More
We investigate the magnetic domain wall (DW) dynamics in uniaxial/biaxial nanowires under a thermal gradient (TG). The findings reveal that the DW propagates toward the hotter region in both nanowires. The main physics of such observations is the magnonic angular momentum transfer to the DW. The hard (shape) anisotropy exists in biaxial nanowire, which contributes an additional torque, hence DW speed is larger than that in uniaxial nanowire. With lower dam**, the DW velocity is smaller and DW velocity increases with dam** which is opposite to usual expectation. To explain this, it is predicted that there is a probability to form the standing spin-waves (which do not carry net energy/momentum) together with travelling spin-waves if the propagation length of thermally-generated spin-waves is larger than the nanowire length. For larger-dam**, DW decreases with dam** since the magnon propagation length decreases. Therefore, the above findings might be useful in realizing the spintronic (racetrack memory) devices.
△ Less
Submitted 15 October, 2022; v1 submitted 19 April, 2022;
originally announced April 2022.
-
Multimodal Proximity and Visuotactile Sensing With a Selectively Transmissive Soft Membrane
Authors:
Jessica Yin,
Gregory M. Campbell,
James Pikul,
Mark Yim
Abstract:
The most common sensing modalities found in a robot perception system are vision and touch, which together can provide global and highly localized data for manipulation. However, these sensing modalities often fail to adequately capture the behavior of target objects during the critical moments as they transition out of static, controlled contact with an end-effector to dynamic and uncontrolled mo…
▽ More
The most common sensing modalities found in a robot perception system are vision and touch, which together can provide global and highly localized data for manipulation. However, these sensing modalities often fail to adequately capture the behavior of target objects during the critical moments as they transition out of static, controlled contact with an end-effector to dynamic and uncontrolled motion. In this work, we present a novel multimodal visuotactile sensor that provides simultaneous visuotactile and proximity depth data. The sensor integrates an RGB camera and air pressure sensor to sense touch with an infrared time-of-flight (ToF) camera to sense proximity by leveraging a selectively transmissive soft membrane to enable the dual sensing modalities. We present the mechanical design, fabrication techniques, algorithm implementations, and evaluation of the sensor's tactile and proximity modalities. The sensor is demonstrated in three open-loop robotic tasks: approaching and contacting an object, catching, and throwing. The fusion of tactile and proximity data could be used to capture key information about a target object's transition behavior for sensor-based control in dynamic manipulation.
△ Less
Submitted 18 April, 2022;
originally announced April 2022.
-
Shape anisotropy effect on magnetization reversal induced by linear down chirp pulse
Authors:
Z. K. Juthy,
M. A. J. Pikul,
M. A. S. Akanda,
M. T. Islam
Abstract:
We investigate the influence of shape anisotropy on the magnetization reversal of a single-domain magnetic nanoparticle driven by a circularly polarized linear down-chirp microwave field pulse (DCMP). Based on the Landau-Lifshitz-Gilbert equation, numerical results show that the three controlling parameters of DCMP, namely, microwave amplitude, initial frequency and chirp rate, decrease with the i…
▽ More
We investigate the influence of shape anisotropy on the magnetization reversal of a single-domain magnetic nanoparticle driven by a circularly polarized linear down-chirp microwave field pulse (DCMP). Based on the Landau-Lifshitz-Gilbert equation, numerical results show that the three controlling parameters of DCMP, namely, microwave amplitude, initial frequency and chirp rate, decrease with the increase of shape anisotropy. For certain shape anisotropy, the reversal time significantly reduces. These findings are related to the competition of shape anisotropy and uniaxial magnetocrystalline anisotropy and thus to the height of energy barrier which separates the two stable states. The result of dam** dependence of magnetization reversal indicates that for a certain sample shape, there exists an optimal dam** situation at which magnetization is fastest. Moreover, it is also shown that the required microwave field amplitude can be lowered by applying the spin-polarized current simultaneously. The usage of an optimum combination of both microwave field pulse and current is suggested to achieve cost efficiency and faster switching. So these findings may provide the knowledge to fabricate the shape of a single domain nanoparticle for the fast and power-efficient magnetic data storage device.
△ Less
Submitted 2 October, 2021; v1 submitted 24 August, 2021;
originally announced August 2021.
-
Fast magnetization reversal of a magnetic nanoparticle induced by cosine chirp microwave field pulse
Authors:
M. T. Islam,
M. A. S. Akanda,
M. A. J. Pikul,
X. S. Wang
Abstract:
We investigate the magnetization reversal of single-domain magnetic nanoparticle driven by the circularly polarized cosine chirp microwave pulse (CCMP). The numerical findings, based on the Landau-Lifshitz-Gilbert equation, reveal that the CCMP is by itself capable of driving fast and energy-efficient magnetization reversal. The microwave field amplitude and initial frequency required by a CCMP ar…
▽ More
We investigate the magnetization reversal of single-domain magnetic nanoparticle driven by the circularly polarized cosine chirp microwave pulse (CCMP). The numerical findings, based on the Landau-Lifshitz-Gilbert equation, reveal that the CCMP is by itself capable of driving fast and energy-efficient magnetization reversal. The microwave field amplitude and initial frequency required by a CCMP are much smaller than that of the linear down-chirp microwave pulse. This is achieved as the frequency change of the CCMP closely matches the frequency change of the magnetization precession which leads to an efficient stimulated microwave energy absorption (emission) by (from) the magnetic particle before (after) it crosses over the energy barrier. We further find that the enhancement of easy-plane shape anisotropy significantly reduces the required microwave amplitude and the initial frequency of CCMP. We also find that there is an optimal Gilbert dam** for fast magnetization reversal. These findings may provide a pathway to realize the fast and low-cost memory device.
△ Less
Submitted 15 September, 2021; v1 submitted 20 February, 2021;
originally announced February 2021.
-
Thermally assisted magnetization reversal of a magnetic nanoparticle driven by a down-chirp microwave field pulse
Authors:
M. T. Islam,
M. A. J. Pikul,
X. S. Wang
Abstract:
It has been shown that a single-domain magnetic nanoparticle can be effectively switched by a linear down-chirp microwave field pulse (DCMWP) in zero temperature limit. However, finite temperature is ubiquitous in practice. Here, we study the effect of finite temperature on the DCMWP-induced magnetization reversal based on the stochastic Landau-Lifshitz-Gilbert equation. It is found that any one o…
▽ More
It has been shown that a single-domain magnetic nanoparticle can be effectively switched by a linear down-chirp microwave field pulse (DCMWP) in zero temperature limit. However, finite temperature is ubiquitous in practice. Here, we study the effect of finite temperature on the DCMWP-induced magnetization reversal based on the stochastic Landau-Lifshitz-Gilbert equation. It is found that any one of the three controlling parameters of a DCMWP, i.e. the amplitude, chirp rate, or initial frequency, decreases with increasing temperature while the other two are fixed. The maximal temperature at which the reversal can happen increases with enlarging the system size. These phenomena are related to the facts that the energy barrier induced by anisotropy increases with the system volume, and the effective magnetization decreases with temperature. We also provide a set of optimal parameters for practical realization of our proposal. These findings may provide a way to realize low-cost and fast magnetization reversal with a wide operating temperature.
△ Less
Submitted 2 March, 2021; v1 submitted 17 November, 2020;
originally announced November 2020.