-
Neural Microfacet Fields for Inverse Rendering
Authors:
Alexander Mai,
Dor Verbin,
Falko Kuester,
Sara Fridovich-Keil
Abstract:
We present Neural Microfacet Fields, a method for recovering materials, geometry, and environment illumination from images of a scene. Our method uses a microfacet reflectance model within a volumetric setting by treating each sample along the ray as a (potentially non-opaque) surface. Using surface-based Monte Carlo rendering in a volumetric setting enables our method to perform inverse rendering…
▽ More
We present Neural Microfacet Fields, a method for recovering materials, geometry, and environment illumination from images of a scene. Our method uses a microfacet reflectance model within a volumetric setting by treating each sample along the ray as a (potentially non-opaque) surface. Using surface-based Monte Carlo rendering in a volumetric setting enables our method to perform inverse rendering efficiently by combining decades of research in surface-based light transport with recent advances in volume rendering for view synthesis. Our approach outperforms prior work in inverse rendering, capturing high fidelity geometry and high frequency illumination details; its novel view synthesis results are on par with state-of-the-art methods that do not recover illumination or materials.
△ Less
Submitted 15 October, 2023; v1 submitted 31 March, 2023;
originally announced March 2023.
-
BTO-RRT: A rapid, optimal, smooth and point cloud-based path planning algorithm
Authors:
Zhaoliang Zheng,
Thomas R. Bewley,
Falko Kuester,
Jiaqi Ma
Abstract:
This paper explores a rapid, optimal smooth path-planning algorithm for robots (e.g., autonomous vehicles) in point cloud environments. Derivative maps such as dense point clouds, mesh maps, Octomaps, etc. are frequently used for path planning purposes. A bi-directional target-oriented point planning algorithm, directly using point clouds to compute the optimized and dynamically feasible trajector…
▽ More
This paper explores a rapid, optimal smooth path-planning algorithm for robots (e.g., autonomous vehicles) in point cloud environments. Derivative maps such as dense point clouds, mesh maps, Octomaps, etc. are frequently used for path planning purposes. A bi-directional target-oriented point planning algorithm, directly using point clouds to compute the optimized and dynamically feasible trajectories, is presented in this paper. This approach searches for obstacle-free, low computational cost, smooth, and dynamically feasible paths by analyzing a point cloud of the target environment, using a modified bi-directional and RRT-connect-based path planning algorithm, with a k-d tree-based obstacle avoidance strategy and three-step optimization. This presented approach bypasses the common 3D map discretization, directly leveraging point cloud data and it can be separated into two parts: modified RRT-based algorithm core and the three-step optimization. Simulations on 8 2D maps with different configurations and characteristics are presented to show the efficiency and 2D performance of the proposed algorithm. Benchmark comparison and evaluation with other RRT-based algorithms like RRT, B-RRT, and RRT star are also shown in the paper. Finally, the proposed algorithm successfully achieved different levels of mission goals on three 3D point cloud maps with different densities. The whole simulation proves that not only can our algorithm achieves a better performance on 2D maps compared with other algorithms, but also it can handle different tasks(ground vehicles and UAV applications) on different 3D point cloud maps, which shows the high performance and robustness of the proposed algorithm. The algorithm is open-sourced at \url{https://github.com/zhz03/BTO-RRT}
△ Less
Submitted 12 November, 2022;
originally announced November 2022.
-
Teat Pose Estimation via RGBD Segmentation for Automated Milking
Authors:
Nicolas Borla,
Fabian Kuster,
Jonas Langenegger,
Juan Ribera,
Marcel Honegger,
Giovanni Toffetti
Abstract:
We present initial results in the development of a novel robot using RGBD cameras, image segmentation, and a simple teat pose estimation algorithm for automated milking. We relate on the analysis of the accuracy of different commercial RGBD cameras in realistic conditions. Although preliminary, our initial implementation shows that 2D image segmentation combined with point cloud processing can ach…
▽ More
We present initial results in the development of a novel robot using RGBD cameras, image segmentation, and a simple teat pose estimation algorithm for automated milking. We relate on the analysis of the accuracy of different commercial RGBD cameras in realistic conditions. Although preliminary, our initial implementation shows that 2D image segmentation combined with point cloud processing can achieve repeatable millimeter-scale precision in estimating (synthetic) teat tip positions and cup attachment approach. The solution is also applicable in a cloud robotics setup, with GPU-based segmentation executed on an edge device or cloud.
△ Less
Submitted 20 May, 2021;
originally announced May 2021.
-
Visualizing Flat Spacetime: Viewing Optical versus Special Relativistic Effects
Authors:
Don V. Black,
M. Gopi,
F. Wessel,
R. Pajarola,
F. Kuester
Abstract:
A simple visual representation of Minkowski spacetime appropriate for a student with a background in geometry and algebra is presented. Minkowski spacetime can be modeled with a Euclidean 4-space to yield accurate visualizations as predicted by special relativity theory. The contributions of relativistic aberration as compared to classical pre-relativistic aberration to the geometry are discussed…
▽ More
A simple visual representation of Minkowski spacetime appropriate for a student with a background in geometry and algebra is presented. Minkowski spacetime can be modeled with a Euclidean 4-space to yield accurate visualizations as predicted by special relativity theory. The contributions of relativistic aberration as compared to classical pre-relativistic aberration to the geometry are discussed in the context of its visual representation.
△ Less
Submitted 17 January, 2012;
originally announced January 2012.
