PyPose: A Library for Robot Learning with Physics-based Optimization
Authors:
Chen Wang,
Dasong Gao,
Kuan Xu,
Junyi Geng,
Yaoyu Hu,
Yuheng Qiu,
Bowen Li,
Fan Yang,
Brady Moon,
Abhinav Pandey,
Aryan,
Jiahe Xu,
Tianhao Wu,
Haonan He,
Daning Huang,
Zhongqiang Ren,
Shibo Zhao,
Taimeng Fu,
Pranay Reddy,
Xiao Lin,
Wenshan Wang,
**gnan Shi,
Rajat Talak,
Kun Cao,
Yi Du
, et al. (12 additional authors not shown)
Abstract:
Deep learning has had remarkable success in robotic perception, but its data-centric nature suffers when it comes to generalizing to ever-changing environments. By contrast, physics-based optimization generalizes better, but it does not perform as well in complicated tasks due to the lack of high-level semantic information and reliance on manual parametric tuning. To take advantage of these two co…
▽ More
Deep learning has had remarkable success in robotic perception, but its data-centric nature suffers when it comes to generalizing to ever-changing environments. By contrast, physics-based optimization generalizes better, but it does not perform as well in complicated tasks due to the lack of high-level semantic information and reliance on manual parametric tuning. To take advantage of these two complementary worlds, we present PyPose: a robotics-oriented, PyTorch-based library that combines deep perceptual models with physics-based optimization. PyPose's architecture is tidy and well-organized, it has an imperative style interface and is efficient and user-friendly, making it easy to integrate into real-world robotic applications. Besides, it supports parallel computing of any order gradients of Lie groups and Lie algebras and $2^{\text{nd}}$-order optimizers, such as trust region methods. Experiments show that PyPose achieves more than $10\times$ speedup in computation compared to the state-of-the-art libraries. To boost future research, we provide concrete examples for several fields of robot learning, including SLAM, planning, control, and inertial navigation.
△ Less
Submitted 24 March, 2023; v1 submitted 30 September, 2022;
originally announced September 2022.
FeTaQA: Free-form Table Question Answering
Authors:
Linyong Nan,
Chiachun Hsieh,
Ziming Mao,
Xi Victoria Lin,
Neha Verma,
Rui Zhang,
Wojciech Kryściński,
Nick Schoelkopf,
Riley Kong,
Xiangru Tang,
Murori Mutuma,
Ben Rosand,
Isabel Trindade,
Renusree Bandaru,
Jacob Cunningham,
Caiming Xiong,
Dragomir Radev
Abstract:
Existing table question answering datasets contain abundant factual questions that primarily evaluate the query and schema comprehension capability of a system, but they fail to include questions that require complex reasoning and integration of information due to the constraint of the associated short-form answers. To address these issues and to demonstrate the full challenge of table question an…
▽ More
Existing table question answering datasets contain abundant factual questions that primarily evaluate the query and schema comprehension capability of a system, but they fail to include questions that require complex reasoning and integration of information due to the constraint of the associated short-form answers. To address these issues and to demonstrate the full challenge of table question answering, we introduce FeTaQA, a new dataset with 10K Wikipedia-based {table, question, free-form answer, supporting table cells} pairs. FeTaQA yields a more challenging table question answering setting because it requires generating free-form text answers after retrieval, inference, and integration of multiple discontinuous facts from a structured knowledge source. Unlike datasets of generative QA over text in which answers are prevalent with copies of short text spans from the source, answers in our dataset are human-generated explanations involving entities and their high-level relations. We provide two benchmark methods for the proposed task: a pipeline method based on semantic-parsing-based QA systems and an end-to-end method based on large pretrained text generation models, and show that FeTaQA poses a challenge for both methods.
△ Less
Submitted 1 April, 2021;
originally announced April 2021.
