-
Harmonics Virtual Lights : fast projection of luminance field on spherical harmonics for efficient rendering
Authors:
Pierre Mézières,
François Desrichard,
David Vanderhaeghe,
Mathias Paulin
Abstract:
In this paper, we introduce Harmonics Virtual Lights (HVL), to model indirect light sources for interactive global illumination of dynamic 3D scenes. Virtual Point Lights (VPL) are an efficient approach to define indirect light sources and to evaluate the resulting indirect lighting. Nonetheless, VPL suffer from disturbing artifacts, especially with high frequency materials. Virtual Spherical Ligh…
▽ More
In this paper, we introduce Harmonics Virtual Lights (HVL), to model indirect light sources for interactive global illumination of dynamic 3D scenes. Virtual Point Lights (VPL) are an efficient approach to define indirect light sources and to evaluate the resulting indirect lighting. Nonetheless, VPL suffer from disturbing artifacts, especially with high frequency materials. Virtual Spherical Lights (VSL) avoid these artifacts by considering spheres instead of points but estimates the lighting integral using Monte Carlo which results to noise in the final image. We define HVL as an extension of VSL in a Spherical Harmonics (SH) framework, defining a closed form of the lighting integral evaluation. We propose an efficient SH projection of spherical lights contribution faster than existing methods. Computing the outgoing luminance requires $\mathcal{O}(n)$ operations when using materials with circular symmetric lobes, and $\mathcal{O}(n^2)$ operations for the general case, where $n$ is the number of SH bands. HVL can be used with either parametric or measured BRDF without extra cost and offers control over rendering time and image quality, by either decreasing or increasing the band limit used for SH projection. Our approach is particularly well designed to render medium-frequency one-bounce global illumination with arbitrary BRDF in interactive time.
△ Less
Submitted 5 January, 2022;
originally announced January 2022.
-
PCEDNet : A Lightweight Neural Network for Fast and Interactive Edge Detection in 3D Point Clouds
Authors:
Chems-Eddine Himeur,
Thibault Lejemble,
Thomas Pellegrini,
Mathias Paulin,
Loic Barthe,
Nicolas Mellado
Abstract:
In recent years, Convolutional Neural Networks (CNN) have proven to be efficient analysis tools for processing point clouds, e.g., for reconstruction, segmentation and classification. In this paper, we focus on the classification of edges in point clouds, where both edges and their surrounding are described. We propose a new parameterization adding to each point a set of differential information o…
▽ More
In recent years, Convolutional Neural Networks (CNN) have proven to be efficient analysis tools for processing point clouds, e.g., for reconstruction, segmentation and classification. In this paper, we focus on the classification of edges in point clouds, where both edges and their surrounding are described. We propose a new parameterization adding to each point a set of differential information on its surrounding shape reconstructed at different scales. These parameters, stored in a Scale-Space Matrix (SSM), provide a well suited information from which an adequate neural network can learn the description of edges and use it to efficiently detect them in acquired point clouds. After successfully applying a multi-scale CNN on SSMs for the efficient classification of edges and their neighborhood, we propose a new lightweight neural network architecture outperforming the CNN in learning time, processing time and classification capabilities. Our architecture is compact, requires small learning sets, is very fast to train and classifies millions of points in seconds.
△ Less
Submitted 28 September, 2021; v1 submitted 3 November, 2020;
originally announced November 2020.
-
Convolutional Patch Representations for Image Retrieval: an Unsupervised Approach
Authors:
Mattis Paulin,
Julien Mairal,
Matthijs Douze,
Zaid Harchaoui,
Florent Perronnin,
Cordelia Schmid
Abstract:
Convolutional neural networks (CNNs) have recently received a lot of attention due to their ability to model local stationary structures in natural images in a multi-scale fashion, when learning all model parameters with supervision. While excellent performance was achieved for image classification when large amounts of labeled visual data are available, their success for un-supervised tasks such…
▽ More
Convolutional neural networks (CNNs) have recently received a lot of attention due to their ability to model local stationary structures in natural images in a multi-scale fashion, when learning all model parameters with supervision. While excellent performance was achieved for image classification when large amounts of labeled visual data are available, their success for un-supervised tasks such as image retrieval has been moderate so far. Our paper focuses on this latter setting and explores several methods for learning patch descriptors without supervision with application to matching and instance-level retrieval. To that effect, we propose a new family of convolutional descriptors for patch representation , based on the recently introduced convolutional kernel networks. We show that our descriptor, named Patch-CKN, performs better than SIFT as well as other convolutional networks learned by artificially introducing supervision and is significantly faster to train. To demonstrate its effectiveness, we perform an extensive evaluation on standard benchmarks for patch and image retrieval where we obtain state-of-the-art results. We also introduce a new dataset called RomePatches, which allows to simultaneously study descriptor performance for patch and image retrieval.
△ Less
Submitted 1 March, 2016;
originally announced March 2016.
