-
AutoMate: Specialist and Generalist Assembly Policies over Diverse Geometries
Authors:
Bingjie Tang,
Iretiayo Akinola,
Jie Xu,
Bowen Wen,
Ankur Handa,
Karl Van Wyk,
Dieter Fox,
Gaurav S. Sukhatme,
Fabio Ramos,
Yashraj Narang
Abstract:
Robotic assembly for high-mixture settings requires adaptivity to diverse parts and poses, which is an open challenge. Meanwhile, in other areas of robotics, large models and sim-to-real have led to tremendous progress. Inspired by such work, we present AutoMate, a learning framework and system that consists of 4 parts: 1) a dataset of 100 assemblies compatible with simulation and the real world,…
▽ More
Robotic assembly for high-mixture settings requires adaptivity to diverse parts and poses, which is an open challenge. Meanwhile, in other areas of robotics, large models and sim-to-real have led to tremendous progress. Inspired by such work, we present AutoMate, a learning framework and system that consists of 4 parts: 1) a dataset of 100 assemblies compatible with simulation and the real world, along with parallelized simulation environments for policy learning, 2) a novel simulation-based approach for learning specialist (i.e., part-specific) policies and generalist (i.e., unified) assembly policies, 3) demonstrations of specialist policies that individually solve 80 assemblies with 80% or higher success rates in simulation, as well as a generalist policy that jointly solves 20 assemblies with an 80%+ success rate, and 4) zero-shot sim-to-real transfer that achieves similar (or better) performance than simulation, including on perception-initialized assembly. The key methodological takeaway is that a union of diverse algorithms from manufacturing engineering, character animation, and time-series analysis provides a generic and robust solution for a diverse range of robotic assembly problems.To our knowledge, AutoMate provides the first simulation-based framework for learning specialist and generalist policies over a wide range of assemblies, as well as the first system demonstrating zero-shot sim-to-real transfer over such a range.
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Scaling Population-Based Reinforcement Learning with GPU Accelerated Simulation
Authors:
Asad Ali Shahid,
Yashraj Narang,
Vincenzo Petrone,
Enrico Ferrentino,
Ankur Handa,
Dieter Fox,
Marco Pavone,
Loris Roveda
Abstract:
In recent years, deep reinforcement learning (RL) has shown its effectiveness in solving complex continuous control tasks like locomotion and dexterous manipulation. However, this comes at the cost of an enormous amount of experience required for training, exacerbated by the sensitivity of learning efficiency and the policy performance to hyperparameter selection, which often requires numerous tri…
▽ More
In recent years, deep reinforcement learning (RL) has shown its effectiveness in solving complex continuous control tasks like locomotion and dexterous manipulation. However, this comes at the cost of an enormous amount of experience required for training, exacerbated by the sensitivity of learning efficiency and the policy performance to hyperparameter selection, which often requires numerous trials of time-consuming experiments. This work introduces a Population-Based Reinforcement Learning (PBRL) approach that exploits a GPU-accelerated physics simulator to enhance the exploration capabilities of RL by concurrently training multiple policies in parallel. The PBRL framework is applied to three state-of-the-art RL algorithms - PPO, SAC, and DDPG - dynamically adjusting hyperparameters based on the performance of learning agents. The experiments are performed on four challenging tasks in Isaac Gym - Anymal Terrain, Shadow Hand, Humanoid, Franka Nut Pick - by analyzing the effect of population size and mutation mechanisms for hyperparameters. The results demonstrate that PBRL agents outperform non-evolutionary baseline agents across tasks essential for humanoid robots, such as bipedal locomotion, manipulation, and gras** in unstructured environments. The trained agents are finally deployed in the real world for the Franka Nut Pick manipulation task. To our knowledge, this is the first sim-to-real attempt for successfully deploying PBRL agents on real hardware. Code and videos of the learned policies are available on our project website (https://sites.google.com/view/pbrl).
△ Less
Submitted 24 June, 2024; v1 submitted 4 April, 2024;
originally announced April 2024.
-
Mesoscale simulations of diffusion and sedimentation in shape-anisotropic nanoparticle suspensions
Authors:
Yashraj M. Wani,
Penelope Grace Kovakas,
Arash Nikoubashman,
Michael P. Howard
Abstract:
We determine the long-time self-diffusion coefficient and sedimentation coefficient for suspensions of nanoparticles with anisotropic shapes (octahedra, cubes, tetrahedra, and spherocylinders) as a function of nanoparticle concentration using mesoscale simulations. We use a discrete particle model for the nanoparticles, and we account for solvent-mediated hydrodynamic interactions between nanopart…
▽ More
We determine the long-time self-diffusion coefficient and sedimentation coefficient for suspensions of nanoparticles with anisotropic shapes (octahedra, cubes, tetrahedra, and spherocylinders) as a function of nanoparticle concentration using mesoscale simulations. We use a discrete particle model for the nanoparticles, and we account for solvent-mediated hydrodynamic interactions between nanoparticles using the multiparticle collision dynamics method. Our simulations are compared to theoretical predictions and experimental data from existing literature, demonstrating good agreement in the majority of cases. Further, we find that the self-diffusion coefficient of the regular polyhedral shapes can be estimated from that of a sphere whose diameter is average of their inscribed and circumscribed sphere diameters.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Soft, slender and active structures in fluids: embedding Cosserat rods in vortex methods
Authors:
Arman Tekinalp,
Yashraj Bhosale,
Songyuan Cui,
Fan Kiat Chan,
Mattia Gazzola
Abstract:
We present a hybrid Eulerian-Lagrangian method for the direct simulation of three-dimensional, heterogeneous structures made of soft fibers and immersed in incompressible viscous fluids. Fiber-based organization of matter is pervasive in nature and engineering, from biological architectures made of cilia, hair, muscles or bones to polymers, composite materials or soft robots. In nature, many such…
▽ More
We present a hybrid Eulerian-Lagrangian method for the direct simulation of three-dimensional, heterogeneous structures made of soft fibers and immersed in incompressible viscous fluids. Fiber-based organization of matter is pervasive in nature and engineering, from biological architectures made of cilia, hair, muscles or bones to polymers, composite materials or soft robots. In nature, many such structures are adapted to manipulate flows for feeding, locomotion or energy harvesting, through mechanisms that are often not fully understood. While simulations can support the analysis (and subsequent translational engineering) of these systems, extreme fibers' aspect-ratios, large elastic deformations and two-way coupling with three-dimensional flows, all render the problem numerically challenging. To address this, we couple Cosserat rod theory, which exploits fibers' slenderness to capture their dynamics in one-dimensional, accurate fashion, with vortex methods via a penalty immersed boundary technique. The favorable properties of the resultant hydroelastic solver are demonstrated against a battery of benchmarks, and further showcased in a range of multi-physics scenarios, involving magnetic actuation, viscous streaming, biomechanics, multi-body interaction, and self-propulsion.
△ Less
Submitted 17 January, 2024;
originally announced January 2024.
-
MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations
Authors:
Ajay Mandlekar,
Soroush Nasiriany,
Bowen Wen,
Iretiayo Akinola,
Yashraj Narang,
Linxi Fan,
Yuke Zhu,
Dieter Fox
Abstract:
Imitation learning from a large set of human demonstrations has proved to be an effective paradigm for building capable robot agents. However, the demonstrations can be extremely costly and time-consuming to collect. We introduce MimicGen, a system for automatically synthesizing large-scale, rich datasets from only a small number of human demonstrations by adapting them to new contexts. We use Mim…
▽ More
Imitation learning from a large set of human demonstrations has proved to be an effective paradigm for building capable robot agents. However, the demonstrations can be extremely costly and time-consuming to collect. We introduce MimicGen, a system for automatically synthesizing large-scale, rich datasets from only a small number of human demonstrations by adapting them to new contexts. We use MimicGen to generate over 50K demonstrations across 18 tasks with diverse scene configurations, object instances, and robot arms from just ~200 human demonstrations. We show that robot agents can be effectively trained on this generated dataset by imitation learning to achieve strong performance in long-horizon and high-precision tasks, such as multi-part assembly and coffee preparation, across broad initial state distributions. We further demonstrate that the effectiveness and utility of MimicGen data compare favorably to collecting additional human demonstrations, making it a powerful and economical approach towards scaling up robot learning. Datasets, simulation environments, videos, and more at https://mimicgen.github.io .
△ Less
Submitted 26 October, 2023;
originally announced October 2023.
-
Density-contrast induced inertial forces on particles in oscillatory flows
Authors:
Siddhansh Agarwal,
Gaurav Upadhyay,
Yashraj Bhosale,
Mattia Gazzola,
Sascha Hilgenfeldt
Abstract:
Oscillatory flows have become an indispensable tool in microfluidics, inducing inertial effects for displacing and manipulating fluid-borne objects in a reliable, controllable, and label-free fashion. However, the quantitative description of such effects has been confined to limit cases and specialized scenarios. Here we develop an analytical formalism yielding the equation of motion of density-mi…
▽ More
Oscillatory flows have become an indispensable tool in microfluidics, inducing inertial effects for displacing and manipulating fluid-borne objects in a reliable, controllable, and label-free fashion. However, the quantitative description of such effects has been confined to limit cases and specialized scenarios. Here we develop an analytical formalism yielding the equation of motion of density-mismatched spherical particles in arbitrary background flows, generalizing previous work. Inertial force terms are systematically derived from the geometry of the flow field together with analytically known Stokes number dependences. Supported by independent, first-principles direct numerical simulations, we find that these forces are important even for nearly density-matched objects such as cells or bacteria, enabling their fast displacement and separation. Our formalism thus generalizes the Maxey--Riley equation, encompassing not only particle inertia, but consistently recovering, in the limit of large Stokes numbers, the Auton modification to added mass as well as the far-field acoustofluidic secondary radiation force.
△ Less
Submitted 8 August, 2023;
originally announced August 2023.
-
IndustReal: Transferring Contact-Rich Assembly Tasks from Simulation to Reality
Authors:
Bingjie Tang,
Michael A. Lin,
Iretiayo Akinola,
Ankur Handa,
Gaurav S. Sukhatme,
Fabio Ramos,
Dieter Fox,
Yashraj Narang
Abstract:
Robotic assembly is a longstanding challenge, requiring contact-rich interaction and high precision and accuracy. Many applications also require adaptivity to diverse parts, poses, and environments, as well as low cycle times. In other areas of robotics, simulation is a powerful tool to develop algorithms, generate datasets, and train agents. However, simulation has had a more limited impact on as…
▽ More
Robotic assembly is a longstanding challenge, requiring contact-rich interaction and high precision and accuracy. Many applications also require adaptivity to diverse parts, poses, and environments, as well as low cycle times. In other areas of robotics, simulation is a powerful tool to develop algorithms, generate datasets, and train agents. However, simulation has had a more limited impact on assembly. We present IndustReal, a set of algorithms, systems, and tools that solve assembly tasks in simulation with reinforcement learning (RL) and successfully achieve policy transfer to the real world. Specifically, we propose 1) simulation-aware policy updates, 2) signed-distance-field rewards, and 3) sampling-based curricula for robotic RL agents. We use these algorithms to enable robots to solve contact-rich pick, place, and insertion tasks in simulation. We then propose 4) a policy-level action integrator to minimize error at policy deployment time. We build and demonstrate a real-world robotic assembly system that uses the trained policies and action integrator to achieve repeatable performance in the real world. Finally, we present hardware and software tools that allow other researchers to reproduce our system and results. For videos and additional details, please see http://sites.google.com/nvidia.com/industreal .
△ Less
Submitted 26 May, 2023;
originally announced May 2023.
-
Coexisting single-particle excitations and octupole correlations in transitional nucleus $\mathbf{^{217}Ra}$
Authors:
Madhu,
A. Y. Deo,
Khamosh Yadav,
Dhananjaya Sahoo,
Y. Y. Wang,
Y. K. Wang,
J. Meng,
Saket Suman,
S. K. Tandel,
A. Sharma,
I. Ahmed,
K. Katre,
K. Rojeeta Devi,
S. Dutt,
S. Kumar,
Yashraj,
S. Muralithar,
R. P. Singh
Abstract:
The level structure of the transitional nucleus $\mathrm{^{217}Ra}$ has been extended with the addition of around 20 new transitions. The discrepancies between the placements of several transitions reported in the earlier studies are resolved. The newly-established negative-parity sequence at low excitation energies hints at the expected parity-doublet structures in this nucleus. The properties of…
▽ More
The level structure of the transitional nucleus $\mathrm{^{217}Ra}$ has been extended with the addition of around 20 new transitions. The discrepancies between the placements of several transitions reported in the earlier studies are resolved. The newly-established negative-parity sequence at low excitation energies hints at the expected parity-doublet structures in this nucleus. The properties of the observed simplex bands are compared with that of similar bands in neighboring nuclei. Since the presence of parity-doublet structures reflect octupole correlations, theoretical calculations using reflection-asymmetric triaxial particle rotor model (RAT-PRM) have been performed. A comparison of the observed features of the simplex bands with the predictions of the RAT-PRM calculations suggests that $\mathrm{^{217}Ra}$ exhibits an intermediate the behavior between the extremes of spherical and octupole-deformed nuclei. The termination of the simplex bands at intermediate energies and the structures lying above reflect the dominance of the single-particle excitations at higher excitation energies.
△ Less
Submitted 24 April, 2023;
originally announced April 2023.
-
Three-dimensional soft streaming
Authors:
Songyuan Cui,
Yashraj Bhosale,
Mattia Gazzola
Abstract:
Viscous streaming is an efficient rectification mechanism to exploit flow inertia at small scales for fluid and particle manipulation. It typically entails a fluid vibrating around an immersed solid feature that, by concentrating stresses, modulates the emergence of steady flows of useful topology. Motivated by its relevance in biological and artificial settings characterized by soft materials, re…
▽ More
Viscous streaming is an efficient rectification mechanism to exploit flow inertia at small scales for fluid and particle manipulation. It typically entails a fluid vibrating around an immersed solid feature that, by concentrating stresses, modulates the emergence of steady flows of useful topology. Motivated by its relevance in biological and artificial settings characterized by soft materials, recent studies have theoretically elucidated, in two dimensions, the impact of body elasticity on streaming flows. Here, we generalize those findings to three dimensions, via the minimal case of an immersed soft sphere. We first improve existing solutions for the rigid sphere limit, by considering previously unaccounted terms. We then enable body compliance, exposing a three-dimensional, elastic streaming process available even in Stokes flows. Such effect, consistent with two-dimensional analyses but analytically distinct, is validated against direct numerical simulations and shown to translate to bodies of complex geometry and topology, paving the way for advanced forms of flow control.
△ Less
Submitted 7 April, 2023;
originally announced April 2023.
-
DefGraspNets: Grasp Planning on 3D Fields with Graph Neural Nets
Authors:
Isabella Huang,
Yashraj Narang,
Ruzena Bajcsy,
Fabio Ramos,
Tucker Hermans,
Dieter Fox
Abstract:
Robotic gras** of 3D deformable objects is critical for real-world applications such as food handling and robotic surgery. Unlike rigid and articulated objects, 3D deformable objects have infinite degrees of freedom. Fully defining their state requires 3D deformation and stress fields, which are exceptionally difficult to analytically compute or experimentally measure. Thus, evaluating grasp can…
▽ More
Robotic gras** of 3D deformable objects is critical for real-world applications such as food handling and robotic surgery. Unlike rigid and articulated objects, 3D deformable objects have infinite degrees of freedom. Fully defining their state requires 3D deformation and stress fields, which are exceptionally difficult to analytically compute or experimentally measure. Thus, evaluating grasp candidates for grasp planning typically requires accurate, but slow 3D finite element method (FEM) simulation. Sampling-based grasp planning is often impractical, as it requires evaluation of a large number of grasp candidates. Gradient-based grasp planning can be more efficient, but requires a differentiable model to synthesize optimal grasps from initial candidates. Differentiable FEM simulators may fill this role, but are typically no faster than standard FEM. In this work, we propose learning a predictive graph neural network (GNN), DefGraspNets, to act as our differentiable model. We train DefGraspNets to predict 3D stress and deformation fields based on FEM-based grasp simulations. DefGraspNets not only runs up to 1500 times faster than the FEM simulator, but also enables fast gradient-based grasp optimization over 3D stress and deformation metrics. We design DefGraspNets to align with real-world grasp planning practices and demonstrate generalization across multiple test sets, including real-world experiments.
△ Less
Submitted 28 March, 2023;
originally announced March 2023.
-
High-spin spectroscopy in $^{207}$At: Evidence of a 29/2$^{+}$ isomeric state
Authors:
Khamosh Yadav,
A. Y. Deo,
Madhu,
Dhananjaya Sahoo,
P. C. Srivastava,
Saket Suman,
S. K. Tandel,
A. Sharma,
I. Ahmed,
K. Katre,
K. Rojeeta Devi,
Sunil Dutt,
Sushil Kumar,
Yashraj,
S. Muralithar,
R. P. Singh
Abstract:
Yrast and near-yrast states above the known 25/2$^{+}$ isomer in $^{207}$At are established for the first time. The level scheme is extended up to 47/2$\hbar$ and 6.5 MeV with the addition of about 60 new $γ$-ray transitions. The half-life of the 25/2$^{+}$ isomer is revisited and a value of $T_{1/2}$ = 107.5(9) ns is deduced. Evidence of a hitherto unobserved 29/2$^{+}$ isomer in $^{207}$At is pr…
▽ More
Yrast and near-yrast states above the known 25/2$^{+}$ isomer in $^{207}$At are established for the first time. The level scheme is extended up to 47/2$\hbar$ and 6.5 MeV with the addition of about 60 new $γ$-ray transitions. The half-life of the 25/2$^{+}$ isomer is revisited and a value of $T_{1/2}$ = 107.5(9) ns is deduced. Evidence of a hitherto unobserved 29/2$^{+}$ isomer in $^{207}$At is presented. A systematic study of $B(E3)$ values for the transitions de-exciting the 29/2$^{+}$ isomer in the neighboring odd-$A$ At isotopes suggests a half-life in the 2$-$4.5 $μ$s range for this state in $^{207}$At. The experimental results are compared with large-scale shell-model calculations performed using the KHM3Y effective interaction in the $Z$ = 50$-$126, $N$ = 82$-$184 model space and an overall good agreement is noted between the theory and the experiment. A qualitative comparison of the excited states and the isomers with analogous states in neighboring nuclei provides further insight into the structure of $^{207}$At.
△ Less
Submitted 28 April, 2023; v1 submitted 4 November, 2022;
originally announced November 2022.
-
An in vitro living system for flow rectification
Authors:
Zhi Dou,
Liu Hong,
Zhengwei Li,
Fan Kiat Chan,
Yashraj Bhosale,
Onur Aydin,
Gabriel Juarez,
M. Taher A. Saif,
Leonardo P. Chamorro,
Mattia Gazzola
Abstract:
Small - but finite - fluid inertia can be leveraged to generate steady flows out of liquid vibrations around an immersed interface. In engineering, external high-frequency drivers (10$^2$-10$^5$ Hz) allow this inertial rectification phenomenon, known as viscous streaming, to be employed in micron-scale devices for precise flow control, particle manipulation and spatially controlled chemistry. Howe…
▽ More
Small - but finite - fluid inertia can be leveraged to generate steady flows out of liquid vibrations around an immersed interface. In engineering, external high-frequency drivers (10$^2$-10$^5$ Hz) allow this inertial rectification phenomenon, known as viscous streaming, to be employed in micron-scale devices for precise flow control, particle manipulation and spatially controlled chemistry. However, beyond artificial settings, streaming may also be accessed by larger-scale biological systems pertaining to lower frequencies. Then, millimeter-size bacteria or larvae that oscillate cilia and appendages in the 1-10Hz range may be able to endogenously rectify surrounding flows, for feeding or locomotion, removing the need for external actuators, tethers or tubings. In support of this hypothesis, here we demonstrate an in vitro living system able to produce streaming flows, endogenously, autonomously and unassisted. Computationally informed, our biological device generates oscillatory flows through the cyclic contractions of an engineered muscle tissue, shaped in the form of a ring and suspended in fluid within a Micro-Particle Image Velocimetry setup, for analysis. Flow patterns consistent with streaming simulations are observed for low-frequency muscle contractions (2-4Hz), either spontaneous or light-induced, illustrating system autonomy and controllability, respectively. Thus, this work provides experimental evidence of biologically powered streaming in untethered millimeter-scale living systems, showcasing the utility of bio-hybrid technology for fundamental and applied fluid mechanics.
△ Less
Submitted 26 October, 2022;
originally announced October 2022.
-
DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality
Authors:
Ankur Handa,
Arthur Allshire,
Viktor Makoviychuk,
Aleksei Petrenko,
Ritvik Singh,
**gzhou Liu,
Denys Makoviichuk,
Karl Van Wyk,
Alexander Zhurkevich,
Balakumar Sundaralingam,
Yashraj Narang,
Jean-Francois Lafleche,
Dieter Fox,
Gavriel State
Abstract:
Recent work has demonstrated the ability of deep reinforcement learning (RL) algorithms to learn complex robotic behaviours in simulation, including in the domain of multi-fingered manipulation. However, such models can be challenging to transfer to the real world due to the gap between simulation and reality. In this paper, we present our techniques to train a) a policy that can perform robust de…
▽ More
Recent work has demonstrated the ability of deep reinforcement learning (RL) algorithms to learn complex robotic behaviours in simulation, including in the domain of multi-fingered manipulation. However, such models can be challenging to transfer to the real world due to the gap between simulation and reality. In this paper, we present our techniques to train a) a policy that can perform robust dexterous manipulation on an anthropomorphic robot hand and b) a robust pose estimator suitable for providing reliable real-time information on the state of the object being manipulated. Our policies are trained to adapt to a wide range of conditions in simulation. Consequently, our vision-based policies significantly outperform the best vision policies in the literature on the same reorientation task and are competitive with policies that are given privileged state information via motion capture systems. Our work reaffirms the possibilities of sim-to-real transfer for dexterous manipulation in diverse kinds of hardware and simulator setups, and in our case, with the Allegro Hand and Isaac Gym GPU-based simulation. Furthermore, it opens up possibilities for researchers to achieve such results with commonly-available, affordable robot hands and cameras. Videos of the resulting policy and supplementary information, including experiments and demos, can be found at https://dextreme.org/
△ Less
Submitted 2 January, 2024; v1 submitted 24 October, 2022;
originally announced October 2022.
-
Factory: Fast Contact for Robotic Assembly
Authors:
Yashraj Narang,
Kier Storey,
Iretiayo Akinola,
Miles Macklin,
Philipp Reist,
Lukasz Wawrzyniak,
Yunrong Guo,
Adam Moravanszky,
Gavriel State,
Michelle Lu,
Ankur Handa,
Dieter Fox
Abstract:
Robotic assembly is one of the oldest and most challenging applications of robotics. In other areas of robotics, such as perception and gras**, simulation has rapidly accelerated research progress, particularly when combined with modern deep learning. However, accurately, efficiently, and robustly simulating the range of contact-rich interactions in assembly remains a longstanding challenge. In…
▽ More
Robotic assembly is one of the oldest and most challenging applications of robotics. In other areas of robotics, such as perception and gras**, simulation has rapidly accelerated research progress, particularly when combined with modern deep learning. However, accurately, efficiently, and robustly simulating the range of contact-rich interactions in assembly remains a longstanding challenge. In this work, we present Factory, a set of physics simulation methods and robot learning tools for such applications. We achieve real-time or faster simulation of a wide range of contact-rich scenes, including simultaneous simulation of 1000 nut-and-bolt interactions. We provide $60$ carefully-designed part models, 3 robotic assembly environments, and 7 robot controllers for training and testing virtual robots. Finally, we train and evaluate proof-of-concept reinforcement learning policies for nut-and-bolt assembly. We aim for Factory to open the doors to using simulation for robotic assembly, as well as many other contact-rich applications in robotics. Please see https://sites.google.com/nvidia.com/factory for supplementary content, including videos.
△ Less
Submitted 6 May, 2022;
originally announced May 2022.
-
Accelerated Policy Learning with Parallel Differentiable Simulation
Authors:
Jie Xu,
Viktor Makoviychuk,
Yashraj Narang,
Fabio Ramos,
Wojciech Matusik,
Animesh Garg,
Miles Macklin
Abstract:
Deep reinforcement learning can generate complex control policies, but requires large amounts of training data to work effectively. Recent work has attempted to address this issue by leveraging differentiable simulators. However, inherent problems such as local minima and exploding/vanishing numerical gradients prevent these methods from being generally applied to control tasks with complex contac…
▽ More
Deep reinforcement learning can generate complex control policies, but requires large amounts of training data to work effectively. Recent work has attempted to address this issue by leveraging differentiable simulators. However, inherent problems such as local minima and exploding/vanishing numerical gradients prevent these methods from being generally applied to control tasks with complex contact-rich dynamics, such as humanoid locomotion in classical RL benchmarks. In this work we present a high-performance differentiable simulator and a new policy learning algorithm (SHAC) that can effectively leverage simulation gradients, even in the presence of non-smoothness. Our learning algorithm alleviates problems with local minima through a smooth critic function, avoids vanishing/exploding gradients through a truncated learning window, and allows many physical environments to be run in parallel. We evaluate our method on classical RL control tasks, and show substantial improvements in sample efficiency and wall-clock time over state-of-the-art RL and differentiable simulation-based algorithms. In addition, we demonstrate the scalability of our method by applying it to the challenging high-dimensional problem of muscle-actuated locomotion with a large action space, achieving a greater than 17x reduction in training time over the best-performing established RL algorithm.
△ Less
Submitted 14 April, 2022;
originally announced April 2022.
-
Towards Differential Relational Privacy and its use in Question Answering
Authors:
Simone Bombari,
Alessandro Achille,
Zijian Wang,
Yu-Xiang Wang,
Yusheng Xie,
Kunwar Yashraj Singh,
Srikar Appalaraju,
Vijay Mahadevan,
Stefano Soatto
Abstract:
Memorization of the relation between entities in a dataset can lead to privacy issues when using a trained model for question answering. We introduce Relational Memorization (RM) to understand, quantify and control this phenomenon. While bounding general memorization can have detrimental effects on the performance of a trained model, bounding RM does not prevent effective learning. The difference…
▽ More
Memorization of the relation between entities in a dataset can lead to privacy issues when using a trained model for question answering. We introduce Relational Memorization (RM) to understand, quantify and control this phenomenon. While bounding general memorization can have detrimental effects on the performance of a trained model, bounding RM does not prevent effective learning. The difference is most pronounced when the data distribution is long-tailed, with many queries having only few training examples: Impeding general memorization prevents effective learning, while impeding only relational memorization still allows learning general properties of the underlying concepts. We formalize the notion of Relational Privacy (RP) and, inspired by Differential Privacy (DP), we provide a possible definition of Differential Relational Privacy (DrP). These notions can be used to describe and compute bounds on the amount of RM in a trained model. We illustrate Relational Privacy concepts in experiments with large-scale models for Question Answering.
△ Less
Submitted 30 March, 2022;
originally announced March 2022.
-
DefGraspSim: Physics-based simulation of grasp outcomes for 3D deformable objects
Authors:
Isabella Huang,
Yashraj Narang,
Clemens Eppner,
Balakumar Sundaralingam,
Miles Macklin,
Ruzena Bajcsy,
Tucker Hermans,
Dieter Fox
Abstract:
Robotic gras** of 3D deformable objects (e.g., fruits/vegetables, internal organs, bottles/boxes) is critical for real-world applications such as food processing, robotic surgery, and household automation. However, develo** grasp strategies for such objects is uniquely challenging. Unlike rigid objects, deformable objects have infinite degrees of freedom and require field quantities (e.g., def…
▽ More
Robotic gras** of 3D deformable objects (e.g., fruits/vegetables, internal organs, bottles/boxes) is critical for real-world applications such as food processing, robotic surgery, and household automation. However, develo** grasp strategies for such objects is uniquely challenging. Unlike rigid objects, deformable objects have infinite degrees of freedom and require field quantities (e.g., deformation, stress) to fully define their state. As these quantities are not easily accessible in the real world, we propose studying interaction with deformable objects through physics-based simulation. As such, we simulate grasps on a wide range of 3D deformable objects using a GPU-based implementation of the corotational finite element method (FEM). To facilitate future research, we open-source our simulated dataset (34 objects, 1e5 Pa elasticity range, 6800 grasp evaluations, 1.1M grasp measurements), as well as a code repository that allows researchers to run our full FEM-based grasp evaluation pipeline on arbitrary 3D object models of their choice. Finally, we demonstrate good correspondence between grasp outcomes on simulated objects and their real counterparts.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
DiSECt: A Differentiable Simulator for Parameter Inference and Control in Robotic Cutting
Authors:
Eric Heiden,
Miles Macklin,
Yashraj Narang,
Dieter Fox,
Animesh Garg,
Fabio Ramos
Abstract:
Robotic cutting of soft materials is critical for applications such as food processing, household automation, and surgical manipulation. As in other areas of robotics, simulators can facilitate controller verification, policy learning, and dataset generation. Moreover, differentiable simulators can enable gradient-based optimization, which is invaluable for calibrating simulation parameters and op…
▽ More
Robotic cutting of soft materials is critical for applications such as food processing, household automation, and surgical manipulation. As in other areas of robotics, simulators can facilitate controller verification, policy learning, and dataset generation. Moreover, differentiable simulators can enable gradient-based optimization, which is invaluable for calibrating simulation parameters and optimizing controllers. In this work, we present DiSECt: the first differentiable simulator for cutting soft materials. The simulator augments the finite element method (FEM) with a continuous contact model based on signed distance fields (SDF), as well as a continuous damage model that inserts springs on opposite sides of the cutting plane and allows them to weaken until zero stiffness, enabling crack formation. Through various experiments, we evaluate the performance of the simulator. We first show that the simulator can be calibrated to match resultant forces and deformation fields from a state-of-the-art commercial solver and real-world cutting datasets, with generality across cutting velocities and object instances. We then show that Bayesian inference can be performed efficiently by leveraging the differentiability of the simulator, estimating posteriors over hundreds of parameters in a fraction of the time of derivative-free methods. Next, we illustrate that control parameters in the simulation can be optimized to minimize cutting forces via lateral slicing motions. Finally, we conduct experiments on a real robot arm equipped with a slicing knife to infer simulation parameters from force measurements. By optimizing the slicing motion of the knife, we show on fruit cutting scenarios that the average knife force can be reduced by more than 40% compared to a vertical cutting motion. We publish code and additional materials on our project website at https://diff-cutting-sim.github.io.
△ Less
Submitted 19 March, 2022;
originally announced March 2022.
-
Soft streaming -- flow rectification via elastic boundaries
Authors:
Yashraj Bhosale,
Tejaswin Parthasarathy,
Mattia Gazzola
Abstract:
Viscous streaming is an efficient mechanism to exploit inertia at the microscale for flow control. While streaming from rigid features has been thoroughly investigated, when body compliance is involved, as in biological settings, little is known. Here, we investigate body elasticity effects on streaming in the minimal case of an immersed soft cylinder. Our study reveals an additional streaming pro…
▽ More
Viscous streaming is an efficient mechanism to exploit inertia at the microscale for flow control. While streaming from rigid features has been thoroughly investigated, when body compliance is involved, as in biological settings, little is known. Here, we investigate body elasticity effects on streaming in the minimal case of an immersed soft cylinder. Our study reveals an additional streaming process, available even in Stokes flows. Paving the way for advanced forms of flow manipulation, we illustrate how gained insights may translate to complex geometries beyond circular cylinders.
△ Less
Submitted 18 February, 2022;
originally announced February 2022.
-
Assistive Tele-op: Leveraging Transformers to Collect Robotic Task Demonstrations
Authors:
Henry M. Clever,
Ankur Handa,
Hammad Mazhar,
Kevin Parker,
Omer Shapira,
Qian Wan,
Yashraj Narang,
Iretiayo Akinola,
Maya Cakmak,
Dieter Fox
Abstract:
Sharing autonomy between robots and human operators could facilitate data collection of robotic task demonstrations to continuously improve learned models. Yet, the means to communicate intent and reason about the future are disparate between humans and robots. We present Assistive Tele-op, a virtual reality (VR) system for collecting robot task demonstrations that displays an autonomous trajector…
▽ More
Sharing autonomy between robots and human operators could facilitate data collection of robotic task demonstrations to continuously improve learned models. Yet, the means to communicate intent and reason about the future are disparate between humans and robots. We present Assistive Tele-op, a virtual reality (VR) system for collecting robot task demonstrations that displays an autonomous trajectory forecast to communicate the robot's intent. As the robot moves, the user can switch between autonomous and manual control when desired. This allows users to collect task demonstrations with both a high success rate and with greater ease than manual teleoperation systems. Our system is powered by transformers, which can provide a window of potential states and actions far into the future -- with almost no added computation time. A key insight is that human intent can be injected at any location within the transformer sequence if the user decides that the model-predicted actions are inappropriate. At every time step, the user can (1) do nothing and allow autonomous operation to continue while observing the robot's future plan sequence, or (2) take over and momentarily prescribe a different set of actions to nudge the model back on track. We host the videos and other supplementary material at https://sites.google.com/view/assistive-teleop.
△ Less
Submitted 9 December, 2021;
originally announced December 2021.
-
Micromechanical origin of plasticity and hysteresis in nest-like packings
Authors:
Yashraj Bhosale,
Nicholas Weiner,
Alex Butler,
Seung Hyun Kim,
Mattia Gazzola,
Hunter King
Abstract:
Disordered packings of unbonded, semiflexible fibers represent a class of materials spanning contexts and scales. From twig-based bird nests to unwoven textiles, bulk mechanics of disparate systems emerge from the bending of constituent slender elements about impermanent contacts. In experimental and computational packings of wooden sticks, we identify prominent features of their response to cycli…
▽ More
Disordered packings of unbonded, semiflexible fibers represent a class of materials spanning contexts and scales. From twig-based bird nests to unwoven textiles, bulk mechanics of disparate systems emerge from the bending of constituent slender elements about impermanent contacts. In experimental and computational packings of wooden sticks, we identify prominent features of their response to cyclic oedometric compression: non-linear stiffness, transient plasticity, and eventually repeatable velocity-independent hysteresis. We trace these features to their micromechanic origins, identified in characteristic appearance, disappearance, and displacement of internal contacts.
△ Less
Submitted 1 December, 2021;
originally announced December 2021.
-
Video Content Classification using Deep Learning
Authors:
Pradyumn Patil,
Vishwajeet Pawar,
Yashraj Pawar,
Shruti Pisal
Abstract:
Video content classification is an important research content in computer vision, which is widely used in many fields, such as image and video retrieval, computer vision. This paper presents a model that is a combination of Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) which develops, trains, and optimizes a deep learning network that can identify the type of video content…
▽ More
Video content classification is an important research content in computer vision, which is widely used in many fields, such as image and video retrieval, computer vision. This paper presents a model that is a combination of Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) which develops, trains, and optimizes a deep learning network that can identify the type of video content and classify them into categories such as "Animation, Gaming, natural content, flat content, etc". To enhance the performance of the model novel keyframe extraction method is included to classify only the keyframes, thereby reducing the overall processing time without sacrificing any significant performance.
△ Less
Submitted 26 November, 2021;
originally announced November 2021.
-
Multi-curvature viscous streaming: flow topology and particle manipulation
Authors:
Yashraj Bhosale,
Giridar Vishwanathan,
Tejaswin Parthasarathy,
Gabriel Juarez,
Mattia Gazzola
Abstract:
Viscous streaming refers to the rectified, steady flows that emerge when a liquid oscillates around an immersed microfeature, typically a solid body or a bubble. The ability of such features to locally concentrate stresses produces strong inertial effects to which both fluid and immersed particles respond within short length (O(100) microns) and time (milliseconds) scales, rendering viscous stream…
▽ More
Viscous streaming refers to the rectified, steady flows that emerge when a liquid oscillates around an immersed microfeature, typically a solid body or a bubble. The ability of such features to locally concentrate stresses produces strong inertial effects to which both fluid and immersed particles respond within short length (O(100) microns) and time (milliseconds) scales, rendering viscous streaming arguably the most efficient mechanism to exploit inertia at the microscale. Despite this potential, viscous streaming has been investigated in rather narrow conditions, mostly making use of bodies of uniform curvature (cylinders, spheres) for which induced flow topologies are constrained to only two regimes, classically referred to as single and double layer regimes. This severely limits the scope of potential applications, and sits in stark contrast to inertial focusing (the approach that perhaps has most defined the field of inertial microfluidics), where instead boundaries with multiple curvatures have long been utilised to magnify inertial effects, expand design space, and enable novel applications. Here, we demonstrate that a multi-curvature approach in viscous streaming dramatically extends the range of accessible flow topologies. We show that numerically predicted, but never experimentally observed, streaming flows can be physically reproduced, computationally engineered, and in turn used to enhance particle manipulation, filtering and separation in compact, robust, tunable and inexpensive devices. Overall, this study provides an avenue to unlock the utility of viscous streaming with potential applications in manufacturing, environment, health and medicine, from particle self-assembly to microplastics removal.
△ Less
Submitted 13 November, 2021;
originally announced November 2021.
-
Diffusion and sedimentation in colloidal suspensions using multiparticle collision dynamics with a discrete particle model
Authors:
Yashraj M. Wani,
Penelope Grace Kovakas,
Arash Nikoubashman,
Michael P. Howard
Abstract:
We study self-diffusion and sedimentation in colloidal suspensions of nearly-hard spheres using the multiparticle collision dynamics simulation method for the solvent with a discrete mesh model for the colloidal particles (MD+MPCD). We cover colloid volume fractions from 0.01 to 0.40 and compare the MD+MPCD simulations to Brownian dynamics simulations with free-draining hydrodynamics (BD) as well…
▽ More
We study self-diffusion and sedimentation in colloidal suspensions of nearly-hard spheres using the multiparticle collision dynamics simulation method for the solvent with a discrete mesh model for the colloidal particles (MD+MPCD). We cover colloid volume fractions from 0.01 to 0.40 and compare the MD+MPCD simulations to Brownian dynamics simulations with free-draining hydrodynamics (BD) as well as pairwise far-field hydrodynamics described using the Rotne--Prager--Yamakawa mobility tensor (BD+RPY). The dynamics in MD+MPCD suggest that the colloidal particles are only partially coupled to the solvent at short times. However, the long-time self-diffusion coefficient in MD+MPCD is comparable to that in BD and BD+RPY, and the sedimentation coefficient in MD+MPCD is in good agreement with that in BD+RPY, suggesting that MD+MPCD gives a reasonable description of the hydrodynamic interactions in colloidal suspensions. The discrete-particle MD+MPCD approach is convenient and readily extended to more complex shapes, and we determine the long-time self-diffusion coefficient in suspensions of nearly-hard cubes to demonstrate its generality.
△ Less
Submitted 12 October, 2021;
originally announced October 2021.
-
DefGraspSim: Simulation-based gras** of 3D deformable objects
Authors:
Isabella Huang,
Yashraj Narang,
Clemens Eppner,
Balakumar Sundaralingam,
Miles Macklin,
Tucker Hermans,
Dieter Fox
Abstract:
Robotic gras** of 3D deformable objects (e.g., fruits/vegetables, internal organs, bottles/boxes) is critical for real-world applications such as food processing, robotic surgery, and household automation. However, develo** grasp strategies for such objects is uniquely challenging. In this work, we efficiently simulate grasps on a wide range of 3D deformable objects using a GPU-based implement…
▽ More
Robotic gras** of 3D deformable objects (e.g., fruits/vegetables, internal organs, bottles/boxes) is critical for real-world applications such as food processing, robotic surgery, and household automation. However, develo** grasp strategies for such objects is uniquely challenging. In this work, we efficiently simulate grasps on a wide range of 3D deformable objects using a GPU-based implementation of the corotational finite element method (FEM). To facilitate future research, we open-source our simulated dataset (34 objects, 1e5 Pa elasticity range, 6800 grasp evaluations, 1.1M grasp measurements), as well as a code repository that allows researchers to run our full FEM-based grasp evaluation pipeline on arbitrary 3D object models of their choice. We also provide a detailed analysis on 6 object primitives. For each primitive, we methodically describe the effects of different grasp strategies, compute a set of performance metrics (e.g., deformation, stress) that fully capture the object response, and identify simple grasp features (e.g., gripper displacement, contact area) measurable by robots prior to pickup and predictive of these performance metrics. Finally, we demonstrate good correspondence between grasps on simulated objects and their real-world counterparts.
△ Less
Submitted 12 July, 2021;
originally announced July 2021.
-
Three-dimensional geometry and topology effects in viscous streaming
Authors:
Fan Kiat Chan,
Yashraj Bhosale,
Tejaswin Parthasarathy,
Mattia Gazzola
Abstract:
Recent studies on viscous streaming flows in two dimensions have elucidated the impact of body curvature variations on resulting flow topology and dynamics, with opportunities for microfluidic applications. Following that, we present here a three-dimensional characterization of streaming flows as function of changes in body geometry and topology, starting from the well-known case of a sphere to pr…
▽ More
Recent studies on viscous streaming flows in two dimensions have elucidated the impact of body curvature variations on resulting flow topology and dynamics, with opportunities for microfluidic applications. Following that, we present here a three-dimensional characterization of streaming flows as function of changes in body geometry and topology, starting from the well-known case of a sphere to progressively arrive at toroidal shapes. We leverage direct numerical simulations and dynamical systems theory to systematically analyze the reorganization of streaming flows into a dynamically rich set of regimes, the origins of which are explained using bifurcation theory.
△ Less
Submitted 15 June, 2021;
originally announced June 2021.
-
DiSECt: A Differentiable Simulation Engine for Autonomous Robotic Cutting
Authors:
Eric Heiden,
Miles Macklin,
Yashraj Narang,
Dieter Fox,
Animesh Garg,
Fabio Ramos
Abstract:
Robotic cutting of soft materials is critical for applications such as food processing, household automation, and surgical manipulation. As in other areas of robotics, simulators can facilitate controller verification, policy learning, and dataset generation. Moreover, differentiable simulators can enable gradient-based optimization, which is invaluable for calibrating simulation parameters and op…
▽ More
Robotic cutting of soft materials is critical for applications such as food processing, household automation, and surgical manipulation. As in other areas of robotics, simulators can facilitate controller verification, policy learning, and dataset generation. Moreover, differentiable simulators can enable gradient-based optimization, which is invaluable for calibrating simulation parameters and optimizing controllers. In this work, we present DiSECt: the first differentiable simulator for cutting soft materials. The simulator augments the finite element method (FEM) with a continuous contact model based on signed distance fields (SDF), as well as a continuous damage model that inserts springs on opposite sides of the cutting plane and allows them to weaken until zero stiffness, enabling crack formation. Through various experiments, we evaluate the performance of the simulator. We first show that the simulator can be calibrated to match resultant forces and deformation fields from a state-of-the-art commercial solver and real-world cutting datasets, with generality across cutting velocities and object instances. We then show that Bayesian inference can be performed efficiently by leveraging the differentiability of the simulator, estimating posteriors over hundreds of parameters in a fraction of the time of derivative-free methods. Finally, we illustrate that control parameters in the simulation can be optimized to minimize cutting forces via lateral slicing motions.
We publish videos and additional results on our project website at https://diff-cutting-sim.github.io.
△ Less
Submitted 25 May, 2021;
originally announced May 2021.
-
DexYCB: A Benchmark for Capturing Hand Gras** of Objects
Authors:
Yu-Wei Chao,
Wei Yang,
Yu Xiang,
Pavlo Molchanov,
Ankur Handa,
Jonathan Tremblay,
Yashraj S. Narang,
Karl Van Wyk,
Umar Iqbal,
Stan Birchfield,
Jan Kautz,
Dieter Fox
Abstract:
We introduce DexYCB, a new dataset for capturing hand gras** of objects. We first compare DexYCB with a related one through cross-dataset evaluation. We then present a thorough benchmark of state-of-the-art approaches on three relevant tasks: 2D object and keypoint detection, 6D object pose estimation, and 3D hand pose estimation. Finally, we evaluate a new robotics-relevant task: generating saf…
▽ More
We introduce DexYCB, a new dataset for capturing hand gras** of objects. We first compare DexYCB with a related one through cross-dataset evaluation. We then present a thorough benchmark of state-of-the-art approaches on three relevant tasks: 2D object and keypoint detection, 6D object pose estimation, and 3D hand pose estimation. Finally, we evaluate a new robotics-relevant task: generating safe robot grasps in human-to-robot object handover. Dataset and code are available at https://dex-ycb.github.io.
△ Less
Submitted 9 April, 2021;
originally announced April 2021.
-
Sim-to-Real for Robotic Tactile Sensing via Physics-Based Simulation and Learned Latent Projections
Authors:
Yashraj Narang,
Balakumar Sundaralingam,
Miles Macklin,
Arsalan Mousavian,
Dieter Fox
Abstract:
Tactile sensing is critical for robotic gras** and manipulation of objects under visual occlusion. However, in contrast to simulations of robot arms and cameras, current simulations of tactile sensors have limited accuracy, speed, and utility. In this work, we develop an efficient 3D finite element method (FEM) model of the SynTouch BioTac sensor using an open-access, GPU-based robotics simulato…
▽ More
Tactile sensing is critical for robotic gras** and manipulation of objects under visual occlusion. However, in contrast to simulations of robot arms and cameras, current simulations of tactile sensors have limited accuracy, speed, and utility. In this work, we develop an efficient 3D finite element method (FEM) model of the SynTouch BioTac sensor using an open-access, GPU-based robotics simulator. Our simulations closely reproduce results from an experimentally-validated model in an industry-standard, CPU-based simulator, but at 75x the speed. We then learn latent representations for simulated BioTac deformations and real-world electrical output through self-supervision, as well as projections between the latent spaces using a small supervised dataset. Using these learned latent projections, we accurately synthesize real-world BioTac electrical output and estimate contact patches, both for unseen contact interactions. This work contributes an efficient, freely-accessible FEM model of the BioTac and comprises one of the first efforts to combine self-supervision, cross-modal transfer, and sim-to-real transfer for tactile sensors.
△ Less
Submitted 30 March, 2021;
originally announced March 2021.
-
Markov model with machine learning integration for fraud detection in health insurance
Authors:
Rohan Yashraj Gupta,
Satya Sai Mudigonda,
Pallav Kumar Baruah,
Phani Krishna Kandala
Abstract:
Fraud has led to a huge addition of expenses in health insurance sector in India. The work is aimed to provide methods applied to health insurance fraud detection. The work presents two approaches - a markov model and an improved markov model using gradient boosting method in health insurance claims. The dataset 382,587 claims of which 38,082 claims are fraudulent. The markov based model gave the…
▽ More
Fraud has led to a huge addition of expenses in health insurance sector in India. The work is aimed to provide methods applied to health insurance fraud detection. The work presents two approaches - a markov model and an improved markov model using gradient boosting method in health insurance claims. The dataset 382,587 claims of which 38,082 claims are fraudulent. The markov based model gave the accuracy of 94.07% with F1-score at 0.6683. However, the improved markov model performed much better in comparison with the accuracy of 97.10% and F1-score of 0.8546. It was observed that the improved markov model gave much lower false positives compared to markov model.
△ Less
Submitted 11 February, 2021;
originally announced February 2021.
-
Implementation of Correlation and Regression Models for Health Insurance Fraud in Covid-19 Environment using Actuarial and Data Science Techniques
Authors:
Rohan Yashraj Gupta,
Satya Sai Mudigonda,
Pallav Kumar Baruah,
Phani Krishna Kandala
Abstract:
Fraud acts as a major deterrent to a companys growth if uncontrolled. It challenges the fundamental value of Trust in the Insurance business. COVID-19 brought additional challenges of increased potential fraud to health insurance business. This work describes implementation of existing and enhanced fraud detection methods in the pre-COVID-19 and COVID-19 environments. For this purpose, we have dev…
▽ More
Fraud acts as a major deterrent to a companys growth if uncontrolled. It challenges the fundamental value of Trust in the Insurance business. COVID-19 brought additional challenges of increased potential fraud to health insurance business. This work describes implementation of existing and enhanced fraud detection methods in the pre-COVID-19 and COVID-19 environments. For this purpose, we have developed an innovative enhanced fraud detection framework using actuarial and data science techniques. Triggers specific to COVID-19 are identified in addition to the existing triggers. We have also explored the relationship between insurance fraud and COVID-19. To determine this we calculated Pearson correlation coefficient and fitted logarithmic regression model between fraud in health insurance and COVID-19 cases. This work uses two datasets: health insurance dataset and Kaggle dataset on COVID-19 cases for the same select geographical location in India. Our experimental results shows Pearson correlation coefficient of 0.86, which implies that the month on month rate of fraudulent cases is highly correlated with month on month rate of COVID-19 cases. The logarithmic regression performed on the data gave the r-squared value of 0.91 which indicates that the model is a good fit. This work aims to provide much needed tools and techniques for health insurance business to counter the fraud.
△ Less
Submitted 24 January, 2021;
originally announced February 2021.
-
Interpreting and Predicting Tactile Signals for the SynTouch BioTac
Authors:
Yashraj S. Narang,
Balakumar Sundaralingam,
Karl Van Wyk,
Arsalan Mousavian,
Dieter Fox
Abstract:
In the human hand, high-density contact information provided by afferent neurons is essential for many human gras** and manipulation capabilities. In contrast, robotic tactile sensors, including the state-of-the-art SynTouch BioTac, are typically used to provide low-density contact information, such as contact location, center of pressure, and net force. Although useful, these data do not convey…
▽ More
In the human hand, high-density contact information provided by afferent neurons is essential for many human gras** and manipulation capabilities. In contrast, robotic tactile sensors, including the state-of-the-art SynTouch BioTac, are typically used to provide low-density contact information, such as contact location, center of pressure, and net force. Although useful, these data do not convey or leverage the rich information content that some tactile sensors naturally measure. This research extends robotic tactile sensing beyond reduced-order models through 1) the automated creation of a precise experimental tactile dataset for the BioTac over a diverse range of physical interactions, 2) a 3D finite element (FE) model of the BioTac, which complements the experimental dataset with high-density, distributed contact data, 3) neural-network-based map**s from raw BioTac signals to not only low-dimensional experimental data, but also high-density FE deformation fields, and 4) map**s from the FE deformation fields to the raw signals themselves. The high-density data streams can provide a far greater quantity of interpretable information for gras** and manipulation algorithms than previously accessible.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
A remeshed vortex method for mixed rigid/soft body fluid--structure interaction
Authors:
Yashraj Bhosale,
Tejaswin Parthasarathy,
Mattia Gazzola
Abstract:
We outline a 2D algorithm for solving incompressible flow--structure interaction problems for mixed rigid/soft body representations, within a consistent framework based on the remeshed vortex method. We adopt the one--continuum formulation to represent both solid and fluid phases on an Eulerian grid, separated by a diffuse interface. Rigid solids are treated using Brinkman penalization while an in…
▽ More
We outline a 2D algorithm for solving incompressible flow--structure interaction problems for mixed rigid/soft body representations, within a consistent framework based on the remeshed vortex method. We adopt the one--continuum formulation to represent both solid and fluid phases on an Eulerian grid, separated by a diffuse interface. Rigid solids are treated using Brinkman penalization while an inverse map technique is used to obtain elastic stresses in the hyper-elastic solid phase. We test our solver against a number of benchmark problems, which demonstrate physical accuracy and first to second order convergence in space and time. Benchmarks are complemented by additional investigations that illustrate the ability of our numerical scheme to capture essential fluid--structure interaction phenomena across a variety of scenarios involving internal muscular actuation, self propulsion, multi-body contact, heat transfer and rectified viscous streaming effects. Through these illustrations, we showcase the ability of our solver to robustly deal with different constitutive models and boundary conditions, solve disparate multi-physics problems and achieve faster time-to-solutions by sidestep** CFL time step restrictions.
△ Less
Submitted 19 November, 2020;
originally announced November 2020.
-
A hyperelastic oscillatory Couette system
Authors:
Tejaswin Parthasarathy,
Yashraj Bhosale,
Mattia Gazzola
Abstract:
We report (semi-)analytical solutions of a problem involving a visco-hyperelastic solid material layer sandwiched between two fluid layers, in turn confined by two long planar walls that undergo oscillatory motion. The resulting system dynamics are rationalized, based on fluid viscosity and solid elasticity, via wave and boundary-layer theory. This allows for physical interpretation of elasto-hydr…
▽ More
We report (semi-)analytical solutions of a problem involving a visco-hyperelastic solid material layer sandwiched between two fluid layers, in turn confined by two long planar walls that undergo oscillatory motion. The resulting system dynamics are rationalized, based on fluid viscosity and solid elasticity, via wave and boundary-layer theory. This allows for physical interpretation of elasto-hydrodynamic coupling, potentially connecting to a broad set of biophysical phenomena and applications, from synovial joint mechanics to elastometry. Further, obtained solutions are demonstrated to be rigorous benchmarks for testing coupled incompressible fluid--hyperelastic solid and multiphase numerical solvers, towards which we highlight challenging parameter sets. Finally, we provide an interactive, online sandbox to build physical intuition, and open-source our code-base.
△ Less
Submitted 28 December, 2021; v1 submitted 18 November, 2020;
originally announced November 2020.
-
STReSSD: Sim-To-Real from Sound for Stochastic Dynamics
Authors:
Carolyn Matl,
Yashraj Narang,
Dieter Fox,
Ruzena Bajcsy,
Fabio Ramos
Abstract:
Sound is an information-rich medium that captures dynamic physical events. This work presents STReSSD, a framework that uses sound to bridge the simulation-to-reality gap for stochastic dynamics, demonstrated for the canonical case of a bouncing ball. A physically-motivated noise model is presented to capture stochastic behavior of the balls upon collision with the environment. A likelihood-free B…
▽ More
Sound is an information-rich medium that captures dynamic physical events. This work presents STReSSD, a framework that uses sound to bridge the simulation-to-reality gap for stochastic dynamics, demonstrated for the canonical case of a bouncing ball. A physically-motivated noise model is presented to capture stochastic behavior of the balls upon collision with the environment. A likelihood-free Bayesian inference framework is used to infer the parameters of the noise model, as well as a material property called the coefficient of restitution, from audio observations. The same inference framework and the calibrated stochastic simulator are then used to learn a probabilistic model of ball dynamics. The predictive capabilities of the dynamics model are tested in two robotic experiments. First, open-loop predictions anticipate probabilistic success of bouncing a ball into a cup. The second experiment integrates audio perception with a robotic arm to track and deflect a bouncing ball in real-time. We envision that this work is a step towards integrating audio-based inference for dynamic robotic tasks. Experimental results can be viewed at https://youtu.be/b7pOrgZrArk.
△ Less
Submitted 5 November, 2020;
originally announced November 2020.
-
Interpreting and Predicting Tactile Signals via a Physics-Based and Data-Driven Framework
Authors:
Yashraj S. Narang,
Karl Van Wyk,
Arsalan Mousavian,
Dieter Fox
Abstract:
High-density afferents in the human hand have long been regarded as essential for human gras** and manipulation abilities. In contrast, robotic tactile sensors are typically used to provide low-density contact data, such as center-of-pressure and resultant force. Although useful, this data does not exploit the rich information content that some tactile sensors (e.g., the SynTouch BioTac) natural…
▽ More
High-density afferents in the human hand have long been regarded as essential for human gras** and manipulation abilities. In contrast, robotic tactile sensors are typically used to provide low-density contact data, such as center-of-pressure and resultant force. Although useful, this data does not exploit the rich information content that some tactile sensors (e.g., the SynTouch BioTac) naturally provide. This research extends robotic tactile sensing beyond reduced-order models through 1) the automated creation of a precise tactile dataset for the BioTac over diverse physical interactions, 2) a 3D finite element (FE) model of the BioTac, which complements the experimental dataset with high-resolution, distributed contact data, and 3) neural-network-based map**s from raw BioTac signals to low-dimensional experimental data, and more importantly, high-density FE deformation fields. These data streams can provide a far greater quantity of interpretable information for gras** and manipulation algorithms than previously accessible.
△ Less
Submitted 6 June, 2020;
originally announced June 2020.
-
Inferring the Material Properties of Granular Media for Robotic Tasks
Authors:
Carolyn Matl,
Yashraj Narang,
Ruzena Bajcsy,
Fabio Ramos,
Dieter Fox
Abstract:
Granular media (e.g., cereal grains, plastic resin pellets, and pills) are ubiquitous in robotics-integrated industries, such as agriculture, manufacturing, and pharmaceutical development. This prevalence mandates the accurate and efficient simulation of these materials. This work presents a software and hardware framework that automatically calibrates a fast physics simulator to accurately simula…
▽ More
Granular media (e.g., cereal grains, plastic resin pellets, and pills) are ubiquitous in robotics-integrated industries, such as agriculture, manufacturing, and pharmaceutical development. This prevalence mandates the accurate and efficient simulation of these materials. This work presents a software and hardware framework that automatically calibrates a fast physics simulator to accurately simulate granular materials by inferring material properties from real-world depth images of granular formations (i.e., piles and rings). Specifically, coefficients of sliding friction, rolling friction, and restitution of grains are estimated from summary statistics of grain formations using likelihood-free Bayesian inference. The calibrated simulator accurately predicts unseen granular formations in both simulation and experiment; furthermore, simulator predictions are shown to generalize to more complex tasks, including using a robot to pour grains into a bowl, as well as to create a desired pattern of piles and rings. Visualizations of the framework and experiments can be viewed at https://youtu.be/OBvV5h2NMKA
△ Less
Submitted 5 November, 2020; v1 submitted 18 March, 2020;
originally announced March 2020.
-
Shape curvature effects in viscous streaming
Authors:
Yashraj Bhosale,
Tejaswin Parthasarathy,
Mattia Gazzola
Abstract:
Viscous streaming flows generated by objects of constant curvature (circular cylinders, infinite plates) have been well understood. Yet, characterization and understanding of such flows when multiple body length-scales are involved has not been looked into, in rigorous detail. We propose a simplified setting to understand and explore the effect of multiple body curvatures on streaming flows, analy…
▽ More
Viscous streaming flows generated by objects of constant curvature (circular cylinders, infinite plates) have been well understood. Yet, characterization and understanding of such flows when multiple body length-scales are involved has not been looked into, in rigorous detail. We propose a simplified setting to understand and explore the effect of multiple body curvatures on streaming flows, analyzing the system through the lens of bifurcation theory. Our setup consists of periodic, regular lattices of cylinders characterized by two distinct radii, so as to inject discrete curvatures into the system, which in turn affect the streaming field generated due to an oscillatory background flow. We demonstrate that our understanding based on this system can be then generalized to a variety of individual convex shapes presenting a spectrum of curvatures, explaining prior experimental and computational observations. Thus, this study illustrates a route towards the rational manipulation of viscous streaming flow topology, through regulated variation of object geometry.
△ Less
Submitted 8 December, 2019;
originally announced December 2019.
-
Perspective: Mechanics of randomly packed filaments -- the `bird nest' as meta-material
Authors:
Nicholas Weiner,
Yashraj Bhosale,
Mattia Gazzola,
Hunter King
Abstract:
Systems of randomly packed, macroscopic elements, from jammed spherical grains to tangled long filaments, represent a broad class of disordered meta-materials with a wide range of applications and manifestations in nature. A `bird nest' presents itself at an interface between hard round grains described by granular physics to long soft filaments, the center of textile material science. All of thes…
▽ More
Systems of randomly packed, macroscopic elements, from jammed spherical grains to tangled long filaments, represent a broad class of disordered meta-materials with a wide range of applications and manifestations in nature. A `bird nest' presents itself at an interface between hard round grains described by granular physics to long soft filaments, the center of textile material science. All of these randomly packed systems exhibit forms of self assembly, evident through their robust packing statistics, and a common, unusual elastoplastic response to oedometric compression. In reviewing packing statistics, mechanical response characterization and consideration of boundary effects, we present a perspective that attempts to establish a link between the bulk and local behaviour of a pile of sand and a wad of cotton, demonstrating the nest's relationship with each. Finally, potential directions for impactful applications are outlined.
△ Less
Submitted 31 October, 2019;
originally announced November 2019.