SegICP-DSR: Dense Semantic Scene Reconstruction and Registration
Authors:
Jay M. Wong,
Syler Wagner,
Connor Lawson,
Vincent Kee,
Mitchell Hebert,
Justin Rooney,
Gian-Luca Mariottini,
Rebecca Russell,
Abraham Schneider,
Rahul Chipalkatty,
David M. S. Johnson
Abstract:
To enable autonomous robotic manipulation in unstructured environments, we present SegICP-DSR, a real- time, dense, semantic scene reconstruction and pose estimation algorithm that achieves mm-level pose accuracy and standard deviation (7.9 mm, σ=7.6 mm and 1.7 deg, σ=0.7 deg) and suc- cessfully identified the object pose in 97% of test cases. This represents a 29% increase in accuracy, and a 14%…
▽ More
To enable autonomous robotic manipulation in unstructured environments, we present SegICP-DSR, a real- time, dense, semantic scene reconstruction and pose estimation algorithm that achieves mm-level pose accuracy and standard deviation (7.9 mm, σ=7.6 mm and 1.7 deg, σ=0.7 deg) and suc- cessfully identified the object pose in 97% of test cases. This represents a 29% increase in accuracy, and a 14% increase in success rate compared to SegICP in cluttered, unstruc- tured environments. The performance increase of SegICP-DSR arises from (1) improved deep semantic segmentation under adversarial training, (2) precise automated calibration of the camera intrinsic and extrinsic parameters, (3) viewpoint specific ray-casting of the model geometry, and (4) dense semantic ElasticFusion point clouds for registration. We benchmark the performance of SegICP-DSR on thousands of pose-annotated video frames and demonstrate its accuracy and efficacy on two tight tolerance gras** and insertion tasks using a KUKA LBR iiwa robotic arm.
△ Less
Submitted 6 November, 2017;
originally announced November 2017.
SegICP: Integrated Deep Semantic Segmentation and Pose Estimation
Authors:
Jay M. Wong,
Vincent Kee,
Tiffany Le,
Syler Wagner,
Gian-Luca Mariottini,
Abraham Schneider,
Lei Hamilton,
Rahul Chipalkatty,
Mitchell Hebert,
David M. S. Johnson,
Jimmy Wu,
Bolei Zhou,
Antonio Torralba
Abstract:
Recent robotic manipulation competitions have highlighted that sophisticated robots still struggle to achieve fast and reliable perception of task-relevant objects in complex, realistic scenarios. To improve these systems' perceptive speed and robustness, we present SegICP, a novel integrated solution to object recognition and pose estimation. SegICP couples convolutional neural networks and multi…
▽ More
Recent robotic manipulation competitions have highlighted that sophisticated robots still struggle to achieve fast and reliable perception of task-relevant objects in complex, realistic scenarios. To improve these systems' perceptive speed and robustness, we present SegICP, a novel integrated solution to object recognition and pose estimation. SegICP couples convolutional neural networks and multi-hypothesis point cloud registration to achieve both robust pixel-wise semantic segmentation as well as accurate and real-time 6-DOF pose estimation for relevant objects. Our architecture achieves 1cm position error and <5^\circ$ angle error in real time without an initial seed. We evaluate and benchmark SegICP against an annotated dataset generated by motion capture.
△ Less
Submitted 5 September, 2017; v1 submitted 5 March, 2017;
originally announced March 2017.
