-
DPA-Net: Structured 3D Abstraction from Sparse Views via Differentiable Primitive Assembly
Authors:
Fenggen Yu,
Yiming Qian,
Xu Zhang,
Francisca Gil-Ureta,
Brian Jackson,
Eric Bennett,
Hao Zhang
Abstract:
We present a differentiable rendering framework to learn structured 3D abstractions in the form of primitive assemblies from sparse RGB images capturing a 3D object. By leveraging differentiable volume rendering, our method does not require 3D supervision. Architecturally, our network follows the general pipeline of an image-conditioned neural radiance field (NeRF) exemplified by pixelNeRF for col…
▽ More
We present a differentiable rendering framework to learn structured 3D abstractions in the form of primitive assemblies from sparse RGB images capturing a 3D object. By leveraging differentiable volume rendering, our method does not require 3D supervision. Architecturally, our network follows the general pipeline of an image-conditioned neural radiance field (NeRF) exemplified by pixelNeRF for color prediction. As our core contribution, we introduce differential primitive assembly (DPA) into NeRF to output a 3D occupancy field in place of density prediction, where the predicted occupancies serve as opacity values for volume rendering. Our network, coined DPA-Net, produces a union of convexes, each as an intersection of convex quadric primitives, to approximate the target 3D object, subject to an abstraction loss and a masking loss, both defined in the image space upon volume rendering. With test-time adaptation and additional sampling and loss designs aimed at improving the accuracy and compactness of the obtained assemblies, our method demonstrates superior performance over state-of-the-art alternatives for 3D primitive abstraction from sparse views.
△ Less
Submitted 2 April, 2024; v1 submitted 31 March, 2024;
originally announced April 2024.
-
HAL3D: Hierarchical Active Learning for Fine-Grained 3D Part Labeling
Authors:
Fenggen Yu,
Yiming Qian,
Francisca Gil-Ureta,
Brian Jackson,
Eric Bennett,
Hao Zhang
Abstract:
We present the first active learning tool for fine-grained 3D part labeling, a problem which challenges even the most advanced deep learning (DL) methods due to the significant structural variations among the small and intricate parts. For the same reason, the necessary data annotation effort is tremendous, motivating approaches to minimize human involvement. Our labeling tool iteratively verifies…
▽ More
We present the first active learning tool for fine-grained 3D part labeling, a problem which challenges even the most advanced deep learning (DL) methods due to the significant structural variations among the small and intricate parts. For the same reason, the necessary data annotation effort is tremendous, motivating approaches to minimize human involvement. Our labeling tool iteratively verifies or modifies part labels predicted by a deep neural network, with human feedback continually improving the network prediction. To effectively reduce human efforts, we develop two novel features in our tool, hierarchical and symmetry-aware active labeling. Our human-in-the-loop approach, coined HAL3D, achieves 100% accuracy (barring human errors) on any test set with pre-defined hierarchical part labels, with 80% time-saving over manual effort.
△ Less
Submitted 1 April, 2024; v1 submitted 25 January, 2023;
originally announced January 2023.
-
Structurally optimized shells
Authors:
Francisca Gil-Ureta,
Nico Pietroni,
Denis Zorin
Abstract:
Shells, i.e., objects made of a thin layer of material following a surface, are among the most common structures in use. They are highly efficient, in terms of material required to maintain strength, but also prone to deformation and failure. We introduce an efficient method for reinforcing shells, that is, adding material to the shell to increase its resilience to external loads. Our goal is to p…
▽ More
Shells, i.e., objects made of a thin layer of material following a surface, are among the most common structures in use. They are highly efficient, in terms of material required to maintain strength, but also prone to deformation and failure. We introduce an efficient method for reinforcing shells, that is, adding material to the shell to increase its resilience to external loads. Our goal is to produce a reinforcement structure of minimal weight. It has been demonstrated that optimal reinforcement structures may be qualitatively different, depending on external loads and surface shape. In some cases, it naturally consists of discrete protruding ribs; in other cases, a smooth shell thickness variation allows to save more material.
Most previously proposed solutions, starting from classical Michell trusses, are not able to handle a full range of shells (e.g., are restricted to self-supporting structures) or are unable to reproduce this range of behaviors, resulting in suboptimal structures.
We propose a new method that works for any input surface with any load configurations, taking into account both in-plane (tensile/compression) and out-of-plane (bending) forces. By using a more precise volume model, we are capable of producing optimized structures with the full range of qualitative behaviors. Our method includes new algorithms for determining the layout of reinforcement structure elements, and an efficient algorithm to optimize their shape, minimizing a non-linear non-convex functional at a fraction of the cost and with better optimality compared to standard solvers.
We demonstrate the optimization results for a variety of shapes, and the improvements it yields in the strength of 3D-printed objects.
△ Less
Submitted 27 April, 2019;
originally announced April 2019.
