-
AddBiomechanics Dataset: Capturing the Physics of Human Motion at Scale
Authors:
Keenon Werling,
Janelle Kaneda,
Alan Tan,
Rishi Agarwal,
Six Skov,
Tom Van Wouwe,
Scott Uhlrich,
Nicholas Bianco,
Carmichael Ong,
Antoine Falisse,
Shardul Sapkota,
Aidan Chandra,
Joshua Carter,
Ezio Preatoni,
Benjamin Fregly,
Jennifer Hicks,
Scott Delp,
C. Karen Liu
Abstract:
While reconstructing human poses in 3D from inexpensive sensors has advanced significantly in recent years, quantifying the dynamics of human motion, including the muscle-generated joint torques and external forces, remains a challenge. Prior attempts to estimate physics from reconstructed human poses have been hampered by a lack of datasets with high-quality pose and force data for a variety of m…
▽ More
While reconstructing human poses in 3D from inexpensive sensors has advanced significantly in recent years, quantifying the dynamics of human motion, including the muscle-generated joint torques and external forces, remains a challenge. Prior attempts to estimate physics from reconstructed human poses have been hampered by a lack of datasets with high-quality pose and force data for a variety of movements. We present the AddBiomechanics Dataset 1.0, which includes physically accurate human dynamics of 273 human subjects, over 70 hours of motion and force plate data, totaling more than 24 million frames. To construct this dataset, novel analytical methods were required, which are also reported here. We propose a benchmark for estimating human dynamics from motion using this dataset, and present several baseline results. The AddBiomechanics Dataset is publicly available at https://addbiomechanics.org/download_data.html.
△ Less
Submitted 16 May, 2024;
originally announced June 2024.
-
Real-time Model Predictive Control and System Identification Using Differentiable Physics Simulation
Authors:
Sirui Chen,
Keenon Werling,
Albert Wu,
C. Karen Liu
Abstract:
Develo** robot controllers in a simulated environment is advantageous but transferring the controllers to the target environment presents challenges, often referred to as the "sim-to-real gap". We present a method for continuous improvement of modeling and control after deploying the robot to a dynamically-changing target environment. We develop a differentiable physics simulation framework that…
▽ More
Develo** robot controllers in a simulated environment is advantageous but transferring the controllers to the target environment presents challenges, often referred to as the "sim-to-real gap". We present a method for continuous improvement of modeling and control after deploying the robot to a dynamically-changing target environment. We develop a differentiable physics simulation framework that performs online system identification and optimal control simultaneously, using the incoming observations from the target environment in real time. To ensure robust system identification against noisy observations, we devise an algorithm to assess the confidence of our estimated parameters, using numerical analysis of the dynamic equations. To ensure real-time optimal control, we adaptively schedule the optimization window in the future so that the optimized actions can be replenished faster than they are consumed, while staying as up-to-date with new sensor information as possible. The constant re-planning based on a constantly improved model allows the robot to swiftly adapt to the changing environment and utilize real-world data in the most sample-efficient way. Thanks to a fast differentiable physics simulator, the optimization for both system identification and control can be solved efficiently for robots operating in real time. We demonstrate our method on a set of examples in simulation and show that our results are favorable compared to baseline methods.
△ Less
Submitted 22 November, 2022; v1 submitted 20 February, 2022;
originally announced February 2022.
-
Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contact
Authors:
Keenon Werling,
Dalton Omens,
Jeongseok Lee,
Ioannis Exarchos,
C. Karen Liu
Abstract:
We present a fast and feature-complete differentiable physics engine, Nimble (nimblephysics.org), that supports Lagrangian dynamics and hard contact constraints for articulated rigid body simulation. Our differentiable physics engine offers a complete set of features that are typically only available in non-differentiable physics simulators commonly used by robotics applications. We solve contact…
▽ More
We present a fast and feature-complete differentiable physics engine, Nimble (nimblephysics.org), that supports Lagrangian dynamics and hard contact constraints for articulated rigid body simulation. Our differentiable physics engine offers a complete set of features that are typically only available in non-differentiable physics simulators commonly used by robotics applications. We solve contact constraints precisely using linear complementarity problems (LCPs). We present efficient and novel analytical gradients through the LCP formulation of inelastic contact that exploit the sparsity of the LCP solution. We support complex contact geometry, and gradients approximating continuous-time elastic collision. We also introduce a novel method to compute complementarity-aware gradients that help downstream optimization tasks avoid stalling in saddle points. We show that an implementation of this combination in an existing physics engine (DART) is capable of a 87x single-core speedup over finite-differencing in computing analytical Jacobians for a single timestep, while preserving all the expressiveness of original DART.
△ Less
Submitted 22 June, 2021; v1 submitted 29 March, 2021;
originally announced March 2021.
-
Develo** a Molecular Theory of Electromechanical Responses
Authors:
Keith A. Werling,
Geoffrey R. Hutchison,
Daniel S. Lambrecht
Abstract:
Develo** a bottom-up (molecular) theory for the electromechanical response of aperiodic materials is a prerequisite for understanding the piezoelectric properties of systems such as nanoparticles, (non-crystalline) polymers, or biomolecule agglomerates. The focus of this publication is to establish a new language and formalism for describing molecular piezoelectric responses. More specifically,…
▽ More
Develo** a bottom-up (molecular) theory for the electromechanical response of aperiodic materials is a prerequisite for understanding the piezoelectric properties of systems such as nanoparticles, (non-crystalline) polymers, or biomolecule agglomerates. The focus of this publication is to establish a new language and formalism for describing molecular piezoelectric responses. More specifically, we define the molecular piezoelectric response tensor d, which necessarily differs from the known bulk definition due to the anisotropy and inhomogeneity at the molecular scale, and derive an analytical theory to calculate this tensor. Based on this new theory, we develop a computational procedure for practical calculations of piezoelectric matrices for molecular systems. Our studies demonstrate that the new analytical theory yields results that are consistent with fully numerical computations. This publication is the first in a series; this work establishes the theoretical molecular foundation and follow-up publications will show how to bridge molecular and macroscopic piezoelectric responses. It is expected that the present work will aid in develo** design strategies for piezoelectric materials by revealing connections between molecular structure and piezoelectric response. We expect that the language and formalism developed here may also be useful to describe mechanochemical phenomena.
△ Less
Submitted 24 July, 2017;
originally announced July 2017.
-
On-the-Job Learning with Bayesian Decision Theory
Authors:
Keenon Werling,
Arun Chaganty,
Percy Liang,
Chris Manning
Abstract:
Our goal is to deploy a high-accuracy system starting with zero training examples. We consider an "on-the-job" setting, where as inputs arrive, we use real-time crowdsourcing to resolve uncertainty where needed and output our prediction when confident. As the model improves over time, the reliance on crowdsourcing queries decreases. We cast our setting as a stochastic game based on Bayesian decisi…
▽ More
Our goal is to deploy a high-accuracy system starting with zero training examples. We consider an "on-the-job" setting, where as inputs arrive, we use real-time crowdsourcing to resolve uncertainty where needed and output our prediction when confident. As the model improves over time, the reliance on crowdsourcing queries decreases. We cast our setting as a stochastic game based on Bayesian decision theory, which allows us to balance latency, cost, and accuracy objectives in a principled way. Computing the optimal policy is intractable, so we develop an approximation based on Monte Carlo Tree Search. We tested our approach on three datasets---named-entity recognition, sentiment classification, and image classification. On the NER task we obtained more than an order of magnitude reduction in cost compared to full human annotation, while boosting performance relative to the expert provided labels. We also achieve a 8% F1 improvement over having a single human label the whole set, and a 28% F1 improvement over online learning.
△ Less
Submitted 7 December, 2015; v1 submitted 9 June, 2015;
originally announced June 2015.
-
Robust Subgraph Generation Improves Abstract Meaning Representation Parsing
Authors:
Keenon Werling,
Gabor Angeli,
Christopher Manning
Abstract:
The Abstract Meaning Representation (AMR) is a representation for open-domain rich semantics, with potential use in fields like event extraction and machine translation. Node generation, typically done using a simple dictionary lookup, is currently an important limiting factor in AMR parsing. We propose a small set of actions that derive AMR subgraphs by transformations on spans of text, which all…
▽ More
The Abstract Meaning Representation (AMR) is a representation for open-domain rich semantics, with potential use in fields like event extraction and machine translation. Node generation, typically done using a simple dictionary lookup, is currently an important limiting factor in AMR parsing. We propose a small set of actions that derive AMR subgraphs by transformations on spans of text, which allows for more robust learning of this stage. Our set of construction actions generalize better than the previous approach, and can be learned with a simple classifier. We improve on the previous state-of-the-art result for AMR parsing, boosting end-to-end performance by 3 F$_1$ on both the LDC2013E117 and LDC2014T12 datasets.
△ Less
Submitted 9 June, 2015;
originally announced June 2015.