Showing 1–1 of 1 results for author: Ramesh, D M
-
Mono-STAR: Mono-camera Scene-level Tracking and Reconstruction
Authors:
Haonan Chang,
Dhruv Metha Ramesh,
Shijie Geng,
Yuqiu Gan,
Abdeslam Boularias
Abstract:
We present Mono-STAR, the first real-time 3D reconstruction system that simultaneously supports semantic fusion, fast motion tracking, non-rigid object deformation, and topological change under a unified framework. The proposed system solves a new optimization problem incorporating optical-flow-based 2D constraints to deal with fast motion and a novel semantic-aware deformation graph (SAD-graph) f…
▽ More
We present Mono-STAR, the first real-time 3D reconstruction system that simultaneously supports semantic fusion, fast motion tracking, non-rigid object deformation, and topological change under a unified framework. The proposed system solves a new optimization problem incorporating optical-flow-based 2D constraints to deal with fast motion and a novel semantic-aware deformation graph (SAD-graph) for handling topology change. We test the proposed system under various challenging scenes and demonstrate that it significantly outperforms existing state-of-the-art methods.
△ Less
Submitted 30 January, 2023;
originally announced January 2023.
