-
Retargeting Visual Data with Deformation Fields
Authors:
Tim Elsner,
Julia Berger,
Tong Wu,
Victor Czech,
Lin Gao,
Leif Kobbelt
Abstract:
Seam carving is an image editing method that enable content-aware resizing, including operations like removing objects. However, the seam-finding strategy based on dynamic programming or graph-cut limits its applications to broader visual data formats and degrees of freedom for editing. Our observation is that describing the editing and retargeting of images more generally by a displacement field…
▽ More
Seam carving is an image editing method that enable content-aware resizing, including operations like removing objects. However, the seam-finding strategy based on dynamic programming or graph-cut limits its applications to broader visual data formats and degrees of freedom for editing. Our observation is that describing the editing and retargeting of images more generally by a displacement field yields a generalisation of content-aware deformations. We propose to learn a deformation with a neural network that keeps the output plausible while trying to deform it only in places with low information content. This technique applies to different kinds of visual data, including images, 3D scenes given as neural radiance fields, or even polygon meshes. Experiments conducted on different visual data show that our method achieves better content-aware retargeting compared to previous methods.
△ Less
Submitted 22 November, 2023;
originally announced November 2023.
-
Adaptive Voronoi NeRFs
Authors:
Tim Elsner,
Victor Czech,
Julia Berger,
Zain Selman,
Isaak Lim,
Leif Kobbelt
Abstract:
Neural Radiance Fields (NeRFs) learn to represent a 3D scene from just a set of registered images. Increasing sizes of a scene demands more complex functions, typically represented by neural networks, to capture all details. Training and inference then involves querying the neural network millions of times per image, which becomes impractically slow. Since such complex functions can be replaced by…
▽ More
Neural Radiance Fields (NeRFs) learn to represent a 3D scene from just a set of registered images. Increasing sizes of a scene demands more complex functions, typically represented by neural networks, to capture all details. Training and inference then involves querying the neural network millions of times per image, which becomes impractically slow. Since such complex functions can be replaced by multiple simpler functions to improve speed, we show that a hierarchy of Voronoi diagrams is a suitable choice to partition the scene. By equip** each Voronoi cell with its own NeRF, our approach is able to quickly learn a scene representation. We propose an intuitive partitioning of the space that increases quality gains during training by distributing information evenly among the networks and avoids artifacts through a top-down adaptive refinement. Our framework is agnostic to the underlying NeRF method and easy to implement, which allows it to be applied to various NeRF variants for improved learning and rendering speeds.
△ Less
Submitted 30 March, 2023; v1 submitted 28 March, 2023;
originally announced March 2023.
-
Intuitive Shape Editing in Latent Space
Authors:
Tim Elsner,
Moritz Ibing,
Victor Czech,
Julius Nehring-Wirxel,
Leif Kobbelt
Abstract:
The use of autoencoders for shape editing or generation through latent space manipulation suffers from unpredictable changes in the output shape. Our autoencoder-based method enables intuitive shape editing in latent space by disentangling latent sub-spaces into style variables and control points on the surface that can be manipulated independently. The key idea is adding a Lipschitz-type constrai…
▽ More
The use of autoencoders for shape editing or generation through latent space manipulation suffers from unpredictable changes in the output shape. Our autoencoder-based method enables intuitive shape editing in latent space by disentangling latent sub-spaces into style variables and control points on the surface that can be manipulated independently. The key idea is adding a Lipschitz-type constraint to the loss function, i.e. bounding the change of the output shape proportionally to the change in latent space, leading to interpretable latent space representations. The control points on the surface that are part of the latent code of an object can then be freely moved, allowing for intuitive shape editing directly in latent space. We evaluate our method by comparing to state-of-the-art data-driven shape editing methods. We further demonstrate the expressiveness of our learned latent space by leveraging it for unsupervised part segmentation.
△ Less
Submitted 21 June, 2022; v1 submitted 24 November, 2021;
originally announced November 2021.
-
Highly accurate digital traffic recording as a basis for future mobility research: Methods and concepts of the research project HDV-Mess
Authors:
Laurent Kloeker,
Fabian Thomsen,
Lutz Eckstein,
Philip Trettner,
Tim Elsner,
Julius Nehring-Wirxel,
Kersten Schuster,
Leif Kobbelt,
Michael Hoesch
Abstract:
The research project HDV-Mess aims at a currently missing, but very crucial component for addressing important challenges in the field of connected and automated driving on public roads. The goal is to record traffic events at various relevant locations with high accuracy and to collect real traffic data as a basis for the development and validation of current and future sensor technologies as wel…
▽ More
The research project HDV-Mess aims at a currently missing, but very crucial component for addressing important challenges in the field of connected and automated driving on public roads. The goal is to record traffic events at various relevant locations with high accuracy and to collect real traffic data as a basis for the development and validation of current and future sensor technologies as well as automated driving functions. For this purpose, it is necessary to develop a concept for a mobile modular system of measuring stations for highly accurate traffic data acquisition, which enables a temporary installation of a sensor and communication infrastructure at different locations. Within this paper, we first discuss the project goals before we present our traffic detection concept using mobile modular intelligent transport systems stations (ITS-Ss). We then explain the approaches for data processing of sensor raw data to refined trajectories, data communication, and data validation.
△ Less
Submitted 8 June, 2021;
originally announced June 2021.
-
Square complexes and simplicial nonpositive curvature
Authors:
Tomasz Elsner,
Piotr Przytycki
Abstract:
We prove that each nonpositively curved square VH-complex can be turned functorially into a locally 6-large simplicial complex of the same homotopy type. It follows that any group acting geometrically on a CAT(0) square VH-complex is systolic. In particular the product of two finitely generated free groups is systolic, which answers a question of Daniel Wise. On the other hand, we exhibit an examp…
▽ More
We prove that each nonpositively curved square VH-complex can be turned functorially into a locally 6-large simplicial complex of the same homotopy type. It follows that any group acting geometrically on a CAT(0) square VH-complex is systolic. In particular the product of two finitely generated free groups is systolic, which answers a question of Daniel Wise. On the other hand, we exhibit an example of a compact non-VH nonpositively curved square complex, whose fundamental group is neither systolic, nor even virtually systolic.
△ Less
Submitted 21 July, 2011;
originally announced July 2011.
