Showing 1–17 of 17 results for author: Velho, L

Implicit Neural Representation of Tileable Material Textures

Authors: Hallison Paz, Tiago Novello, Luiz Velho

Abstract: We explore sinusoidal neural networks to represent periodic tileable textures. Our approach leverages the Fourier series by initializing the first layer of a sinusoidal neural network with integer frequencies with a period $P$. We prove that the compositions of sinusoidal layers generate only integer frequencies with period $P$. As a result, our network learns a continuous representation of a peri… ▽ More We explore sinusoidal neural networks to represent periodic tileable textures. Our approach leverages the Fourier series by initializing the first layer of a sinusoidal neural network with integer frequencies with a period $P$. We prove that the compositions of sinusoidal layers generate only integer frequencies with period $P$. As a result, our network learns a continuous representation of a periodic pattern, enabling direct evaluation at any spatial coordinate without the need for interpolation. To enforce the resulting pattern to be tileable, we add a regularization term, based on the Poisson equation, to the loss function. Our proposed neural implicit representation is compact and enables efficient reconstruction of high-resolution textures with high visual fidelity and sharpness across multiple levels of detail. We present applications of our approach in the domain of anti-aliased surface. △ Less

Submitted 3 February, 2024; originally announced February 2024.

A simple and complete discrete exterior calculus on general polygonal meshes

Authors: Lenka Ptackova, Luiz Velho

Abstract: Discrete exterior calculus (DEC) offers a coordinate-free discretization of exterior calculus especially suited for computations on curved spaces. In this work, we present an extended version of DEC on surface meshes formed by general polygons that bypasses the need for combinatorial subdivision and does not involve any dual mesh. At its core, our approach introduces a new polygonal wedge product… ▽ More Discrete exterior calculus (DEC) offers a coordinate-free discretization of exterior calculus especially suited for computations on curved spaces. In this work, we present an extended version of DEC on surface meshes formed by general polygons that bypasses the need for combinatorial subdivision and does not involve any dual mesh. At its core, our approach introduces a new polygonal wedge product that is compatible with the discrete exterior derivative in the sense that it satisfies the Leibniz product rule. Based on the discrete wedge product, we then derive a novel primal-to-primal Hodge star operator. Combining these three `basic operators' we then define new discrete versions of the contraction operator and Lie derivative, codifferential and Laplace operator. We discuss the numerical convergence of each one of these proposed operators and compare them to existing DEC methods. Finally, we show simple applications of our operators on Helmholtz-Hodge decomposition, Laplacian surface fairing, and Lie advection of functions and vector fields on meshes formed by general polygons. △ Less

Submitted 27 January, 2024; originally announced January 2024.

Journal ref: Computer Aided Geometric Design 88 (2021) 102002

Neural Implicit Morphing of Face Images

Authors: Guilherme Schardong, Tiago Novello, Hallison Paz, Iurii Medvedev, Vinícius da Silva, Luiz Velho, Nuno Gonçalves

Abstract: Face morphing is a problem in computer graphics with numerous artistic and forensic applications. It is challenging due to variations in pose, lighting, gender, and ethnicity. This task consists of a war** for feature alignment and a blending for a seamless transition between the warped images. We propose to leverage coord-based neural networks to represent such war**s and blendings of face im… ▽ More Face morphing is a problem in computer graphics with numerous artistic and forensic applications. It is challenging due to variations in pose, lighting, gender, and ethnicity. This task consists of a war** for feature alignment and a blending for a seamless transition between the warped images. We propose to leverage coord-based neural networks to represent such war**s and blendings of face images. During training, we exploit the smoothness and flexibility of such networks by combining energy functionals employed in classical approaches without discretizations. Additionally, our method is time-dependent, allowing a continuous war**/blending of the images. During morphing inference, we need both direct and inverse transformations of the time-dependent war**. The first (second) is responsible for war** the target (source) image into the source (target) image. Our neural war** stores those maps in a single network dismissing the need for inverting them. The results of our experiments indicate that our method is competitive with both classical and generative models under the lens of image quality and face-morphing detectors. Aesthetically, the resulting images present a seamless blending of diverse faces not yet usual in the literature. △ Less

Submitted 13 June, 2024; v1 submitted 26 August, 2023; originally announced August 2023.

Comments: 14 pages, 20 figures, accepted for CVPR 2024

ACM Class: I.4.8; I.4.10

Multiresolution Neural Networks for Imaging

Authors: Hallison Paz, Tiago Novello, Vinicius Silva, Luiz Schirmer, Guilherme Schardong, Fabio Chagas, Helio Lopes, Luiz Velho

Abstract: We present MR-Net, a general architecture for multiresolution neural networks, and a framework for imaging applications based on this architecture. Our coordinate-based networks are continuous both in space and in scale as they are composed of multiple stages that progressively add finer details. Besides that, they are a compact and efficient representation. We show examples of multiresolution ima… ▽ More We present MR-Net, a general architecture for multiresolution neural networks, and a framework for imaging applications based on this architecture. Our coordinate-based networks are continuous both in space and in scale as they are composed of multiple stages that progressively add finer details. Besides that, they are a compact and efficient representation. We show examples of multiresolution image representation and applications to texturemagnification, minification, and antialiasing. This document is the extended version of the paper [PNS+22]. It includes additional material that would not fit the page limitations of the conference track for publication. △ Less

Submitted 10 September, 2022; v1 submitted 24 August, 2022; originally announced August 2022.

MSC Class: 68T07; 68U10 ACM Class: I.4.10; I.3.3

Neural Implicit Surface Evolution

Authors: Tiago Novello, Vinicius da Silva, Guilherme Schardong, Luiz Schirmer, Helio Lopes, Luiz Velho

Abstract: This work investigates the use of smooth neural networks for modeling dynamic variations of implicit surfaces under the level set equation (LSE). For this, it extends the representation of neural implicit surfaces to the space-time $\mathbb{R}^3\times \mathbb{R}$, which opens up mechanisms for continuous geometric transformations. Examples include evolving an initial surface towards general vector… ▽ More This work investigates the use of smooth neural networks for modeling dynamic variations of implicit surfaces under the level set equation (LSE). For this, it extends the representation of neural implicit surfaces to the space-time $\mathbb{R}^3\times \mathbb{R}$, which opens up mechanisms for continuous geometric transformations. Examples include evolving an initial surface towards general vector fields, smoothing and sharpening using the mean curvature equation, and interpolations of initial conditions. The network training considers two constraints. A data term is responsible for fitting the initial condition to the corresponding time instant, usually $\mathbb{R}^3 \times \{0\}$. Then, a LSE term forces the network to approximate the underlying geometric evolution given by the LSE, without any supervision. The network can also be initialized based on previously trained initial conditions, resulting in faster convergence compared to the standard approach. △ Less

Submitted 20 August, 2023; v1 submitted 24 January, 2022; originally announced January 2022.

Exploring Differential Geometry in Neural Implicits

Authors: Tiago Novello, Guilherme Schardong, Luiz Schirmer, Vinicius da Silva, Helio Lopes, Luiz Velho

Abstract: We introduce a neural implicit framework that exploits the differentiable properties of neural networks and the discrete geometry of point-sampled surfaces to approximate them as the level sets of neural implicit functions. To train a neural implicit function, we propose a loss functional that approximates a signed distance function, and allows terms with high-order derivatives, such as the alig… ▽ More We introduce a neural implicit framework that exploits the differentiable properties of neural networks and the discrete geometry of point-sampled surfaces to approximate them as the level sets of neural implicit functions. To train a neural implicit function, we propose a loss functional that approximates a signed distance function, and allows terms with high-order derivatives, such as the alignment between the principal directions of curvature, to learn more geometric details. During training, we consider a non-uniform sampling strategy based on the curvatures of the point-sampled surface to prioritize points with more geometric details. This sampling implies faster learning while preserving geometric accuracy when compared with previous approaches. We also use the analytical derivatives of a neural implicit function to estimate the differential measures of the underlying point-sampled surface. △ Less

Submitted 20 August, 2022; v1 submitted 23 January, 2022; originally announced January 2022.

Neural Implicit Map** via Nested Neighborhoods

Authors: Vinícius da Silva, Tiago Novello, Guilherme Schardong, Luiz Schirmer, Hélio Lopes, Luiz Velho

Abstract: We introduce a novel approach for rendering static and dynamic 3D neural signed distance functions (SDF) in real-time. We rely on nested neighborhoods of zero-level sets of neural SDFs, and map**s between them. This framework supports animations and achieves real-time performance without the use of spatial data-structures. It consists of three uncoupled algorithms representing the rendering step… ▽ More We introduce a novel approach for rendering static and dynamic 3D neural signed distance functions (SDF) in real-time. We rely on nested neighborhoods of zero-level sets of neural SDFs, and map**s between them. This framework supports animations and achieves real-time performance without the use of spatial data-structures. It consists of three uncoupled algorithms representing the rendering steps. The multiscale sphere tracing focuses on minimizing iteration time by using coarse approximations on earlier iterations. The neural normal map** transfers details from a fine neural SDF to a surface nested on a neighborhood of its zero-level set. It is smooth and it does not depend on surface parametrizations. As a result, it can be used to fetch smooth normals for discrete surfaces such as meshes and to skip later iterations when sphere tracing level sets. Finally, we propose an algorithm for analytic normal calculation for MLPs and describe ways to obtain sequences of neural SDFs to use with the algorithms. △ Less

Submitted 6 December, 2022; v1 submitted 22 January, 2022; originally announced January 2022.

Comments: 9 pages, 8 figures

ACM Class: I.3.7; I.3.5

Can We Use Neural Regularization to Solve Depth Super-Resolution?

Authors: Milena Gazdieva, Oleg Voynov, Alexey Artemov, Youyi Zheng, Luiz Velho, Evgeny Burnaev

Abstract: Depth maps captured with commodity sensors often require super-resolution to be used in applications. In this work we study a super-resolution approach based on a variational problem statement with Tikhonov regularization where the regularizer is parametrized with a deep neural network. This approach was previously applied successfully in photoacoustic tomography. We experimentally show that its a… ▽ More Depth maps captured with commodity sensors often require super-resolution to be used in applications. In this work we study a super-resolution approach based on a variational problem statement with Tikhonov regularization where the regularizer is parametrized with a deep neural network. This approach was previously applied successfully in photoacoustic tomography. We experimentally show that its application to depth map super-resolution is difficult, and provide suggestions about the reasons for that. △ Less

Submitted 21 December, 2021; originally announced December 2021.

Comments: 9 pages

Real-time rendering of complex fractals

Authors: Vinícius da Silva, Tiago Novello, Hélio Lopes, Luiz Velho

Abstract: This chapter describes how to use intersection and closest-hit shaders to implement real-time visualizations of complex fractals using distance functions. The Mandelbulb and Julia Sets are used as examples. This chapter describes how to use intersection and closest-hit shaders to implement real-time visualizations of complex fractals using distance functions. The Mandelbulb and Julia Sets are used as examples. △ Less

Submitted 2 February, 2021; originally announced February 2021.

Comments: 11 pages, 4 figures

MSC Class: 68U05 (Primary) 37-04; 37F10 (Secondary) ACM Class: I.3.7

Proceduray -- A light-weight engine for procedural primitive ray tracing

Authors: Vinícius da Silva, Tiago Novello, Hélio Lopes, Luiz Velho

Abstract: We introduce Proceduray, an engine for real-time ray tracing of procedural geometry. Its motivation is the current lack of mid-level abstraction tools for scenes with primitives involving intersection shaders. Those scenes impose strict engine design choices since they need flexibility in the shader table setup. Proceduray aims at providing a fair tradeoff between that flexibility and productivity… ▽ More We introduce Proceduray, an engine for real-time ray tracing of procedural geometry. Its motivation is the current lack of mid-level abstraction tools for scenes with primitives involving intersection shaders. Those scenes impose strict engine design choices since they need flexibility in the shader table setup. Proceduray aims at providing a fair tradeoff between that flexibility and productivity. It also aims to be didactic. Shader table behavior can be confusing because parameters for indexing come from different parts of a system, involving both host and device code. This is different in essence from ray tracing triangle meshes (which must use a built-in intersection shader for all objects) or rendering with the traditional graphics or compute pipelines. Additionals goals of the project include fomenting deeper discussions about DirectX RayTracing (DXR) host code and providing a good starting point for developers trying to deal with procedural geometry using DXR. △ Less

Submitted 21 May, 2021; v1 submitted 18 December, 2020; originally announced December 2020.

Comments: 23 pages, 6 figures

MSC Class: 68U05 (Primary) 37-04; 37F10 (Secondary) ACM Class: I.3.7

Ray-VR: Ray Tracing Virtual Reality in Falcor

Authors: Vinicius da Silva, Luiz Velho

Abstract: NVidia RTX platform has been changing and extending the possibilities for real time Computer Graphics applications. It is the first time in history that retail graphics cards have full hardware support for ray tracing primitives. It still a long way to fully understand and optimize its use and this task itself is a fertile field for scientific progression. However, another path is to explore the p… ▽ More NVidia RTX platform has been changing and extending the possibilities for real time Computer Graphics applications. It is the first time in history that retail graphics cards have full hardware support for ray tracing primitives. It still a long way to fully understand and optimize its use and this task itself is a fertile field for scientific progression. However, another path is to explore the platform as an expansion of paradigms for other problems. For example, the integration of real time Ray Tracing and Virtual Reality can result in interesting applications for visualization of Non-Euclidean Geometry and 3D Manifolds. In this paper we present Ray-VR, a novel algorithm for real time stereo ray tracing, constructed on top of Falcor, NVidia's scientific prototy** framework. △ Less

Submitted 19 June, 2020; originally announced June 2020.

Comments: 8 pages, 7 figures

ACM Class: I.3.7

How to see the eight Thurston geometries

Authors: Tiago Novello, Vinícius da Silva, Luiz Velho, Mikhail Belolipetsky

Abstract: In this expository paper, we present a survey about the history of the geometrization conjecture and the background material on the classification of Thurston's eight geometries. We also discuss recent techniques for immersive visualization of relevant three-dimensional manifolds in the context of the Geometrization Conjecture. In this expository paper, we present a survey about the history of the geometrization conjecture and the background material on the classification of Thurston's eight geometries. We also discuss recent techniques for immersive visualization of relevant three-dimensional manifolds in the context of the Geometrization Conjecture. △ Less

Submitted 13 September, 2021; v1 submitted 26 May, 2020; originally announced May 2020.

Deep Reinforcement Learning for High Level Character Control

Authors: Caio Souza, Luiz Velho

Abstract: In this paper, we propose the use of traditional animations, heuristic behavior and reinforcement learning in the creation of intelligent characters for computational media. The traditional animation and heuristic gives artistic control over the behavior while the reinforcement learning adds generalization. The use case presented is a dog character with a high-level controller in a 3D environment… ▽ More In this paper, we propose the use of traditional animations, heuristic behavior and reinforcement learning in the creation of intelligent characters for computational media. The traditional animation and heuristic gives artistic control over the behavior while the reinforcement learning adds generalization. The use case presented is a dog character with a high-level controller in a 3D environment which is built around the desired behaviors to be learned, such as fetching an item. As the development of the environment is the key for learning, further analysis is conducted of how to build those learning environments, the effects of environment and agent modeling choices, training procedures and generalization of the learned behavior. This analysis builds insight of the aforementioned factors and may serve as guide in the development of environments in general. △ Less

Submitted 20 May, 2020; originally announced May 2020.

Design and visualization of Riemannian metrics

Authors: Tiago Novello, Vinícius da Silva, Luiz Velho

Abstract: Local and global illumination were recently defined in Riemannian manifolds to visualize classical Non-Euclidean spaces. This work focuses on Riemannian metric construction in $\mathbb{R}^3$ to explore special effects like war**, mirages, and deformations. We investigate the possibility of using graphs of functions and diffeomorphism to produce such effects. For these, their Riemannian metrics a… ▽ More Local and global illumination were recently defined in Riemannian manifolds to visualize classical Non-Euclidean spaces. This work focuses on Riemannian metric construction in $\mathbb{R}^3$ to explore special effects like war**, mirages, and deformations. We investigate the possibility of using graphs of functions and diffeomorphism to produce such effects. For these, their Riemannian metrics and geodesics derivations are provided, and ways of accumulating such metrics. We visualize, in "real-time", the resulting Riemannian manifolds using a ray tracing implemented on top of Nvidia RTX GPUs. △ Less

Submitted 11 May, 2020; originally announced May 2020.

Global Illumination of non-Euclidean spaces

Authors: Tiago Novello, Vinicius da Silva, Luiz Velho

Abstract: This paper presents a path tracer algorithm to compute the global illumination of non-Euclidean manifolds. We use the 3D torus as an example. This paper presents a path tracer algorithm to compute the global illumination of non-Euclidean manifolds. We use the 3D torus as an example. △ Less

Submitted 24 March, 2020; originally announced March 2020.

Latent-Space Laplacian Pyramids for Adversarial Representation Learning with 3D Point Clouds

Authors: Vage Egiazarian, Savva Ignatyev, Alexey Artemov, Oleg Voynov, Andrey Kravchenko, Youyi Zheng, Luiz Velho, Evgeny Burnaev

Abstract: Constructing high-quality generative models for 3D shapes is a fundamental task in computer vision with diverse applications in geometry processing, engineering, and design. Despite the recent progress in deep generative modelling, synthesis of finely detailed 3D surfaces, such as high-resolution point clouds, from scratch has not been achieved with existing approaches. In this work, we propose to… ▽ More Constructing high-quality generative models for 3D shapes is a fundamental task in computer vision with diverse applications in geometry processing, engineering, and design. Despite the recent progress in deep generative modelling, synthesis of finely detailed 3D surfaces, such as high-resolution point clouds, from scratch has not been achieved with existing approaches. In this work, we propose to employ the latent-space Laplacian pyramid representation within a hierarchical generative model for 3D point clouds. We combine the recently proposed latent-space GAN and Laplacian GAN architectures to form a multi-scale model capable of generating 3D point clouds at increasing levels of detail. Our evaluation demonstrates that our model outperforms the existing generative models for 3D point clouds. △ Less

Submitted 13 December, 2019; originally announced December 2019.

Real-time correction of panoramic images using hyperbolic Möbius transformations

Authors: Luis Peñaranda, Luiz Velho, Leonardo Sacht

Abstract: Wide-angle images gained a huge popularity in the last years due to the development of computational photography and imaging technological advances. They present the information of a scene in a way which is more natural for the human eye but, on the other hand, they introduce artifacts such as bent lines. These artifacts become more and more unnatural as the field of view increases. In this work… ▽ More Wide-angle images gained a huge popularity in the last years due to the development of computational photography and imaging technological advances. They present the information of a scene in a way which is more natural for the human eye but, on the other hand, they introduce artifacts such as bent lines. These artifacts become more and more unnatural as the field of view increases. In this work, we present a technique aimed to improve the perceptual quality of panorama visualization. The main ingredients of our approach are, on one hand, considering the viewing sphere as a Riemann sphere, what makes natural the application of Möbius (complex) transformations to the input image, and, on the other hand, a projection scheme which changes in function of the field of view used. We also introduce an implementation of our method, compare it against images produced with other methods and show that the transformations can be done in real-time, which makes our technique very appealing for new settings, as well as for existing interactive panorama applications. △ Less

Submitted 17 April, 2015; originally announced April 2015.

Comments: 25 pages, 13 figures, 1 table, 1 algorithm. In "Real-time Image Processing"