-
Neural Semantic Surface Maps
Authors:
Luca Morreale,
Noam Aigerman,
Vladimir G. Kim,
Niloy J. Mitra
Abstract:
We present an automated technique for computing a map between two genus-zero shapes, which matches semantically corresponding regions to one another. Lack of annotated data prohibits direct inference of 3D semantic priors; instead, current State-of-the-art methods predominantly optimize geometric properties or require varying amounts of manual annotation. To overcome the lack of annotated training…
▽ More
We present an automated technique for computing a map between two genus-zero shapes, which matches semantically corresponding regions to one another. Lack of annotated data prohibits direct inference of 3D semantic priors; instead, current State-of-the-art methods predominantly optimize geometric properties or require varying amounts of manual annotation. To overcome the lack of annotated training data, we distill semantic matches from pre-trained vision models: our method renders the pair of 3D shapes from multiple viewpoints; the resulting renders are then fed into an off-the-shelf image-matching method which leverages a pretrained visual model to produce feature points. This yields semantic correspondences, which can be projected back to the 3D shapes, producing a raw matching that is inaccurate and inconsistent between different viewpoints. These correspondences are refined and distilled into an inter-surface map by a dedicated optimization scheme, which promotes bijectivity and continuity of the output map. We illustrate that our approach can generate semantic surface-to-surface maps, eliminating manual annotations or any 3D training data requirement. Furthermore, it proves effective in scenarios with high semantic complexity, where objects are non-isometrically related, as well as in situations where they are nearly isometric.
△ Less
Submitted 8 March, 2024; v1 submitted 9 September, 2023;
originally announced September 2023.
-
Neural Convolutional Surfaces
Authors:
Luca Morreale,
Noam Aigerman,
Paul Guerrero,
Vladimir G. Kim,
Niloy J. Mitra
Abstract:
This work is concerned with a representation of shapes that disentangles fine, local and possibly repeating geometry, from global, coarse structures. Achieving such disentanglement leads to two unrelated advantages: i) a significant compression in the number of parameters required to represent a given geometry; ii) the ability to manipulate either global geometry, or local details, without harming…
▽ More
This work is concerned with a representation of shapes that disentangles fine, local and possibly repeating geometry, from global, coarse structures. Achieving such disentanglement leads to two unrelated advantages: i) a significant compression in the number of parameters required to represent a given geometry; ii) the ability to manipulate either global geometry, or local details, without harming the other. At the core of our approach lies a novel pipeline and neural architecture, which are optimized to represent one specific atlas, representing one 3D surface. Our pipeline and architecture are designed so that disentanglement of global geometry from local details is accomplished through optimization, in a completely unsupervised manner. We show that this approach achieves better neural shape compression than the state of the art, as well as enabling manipulation and transfer of shape details. Project page at http://geometry.cs.ucl.ac.uk/projects/2022/cnnmaps/ .
△ Less
Submitted 5 April, 2022;
originally announced April 2022.
-
Neural Surface Maps
Authors:
Luca Morreale,
Noam Aigerman,
Vladimir Kim,
Niloy J. Mitra
Abstract:
Maps are arguably one of the most fundamental concepts used to define and operate on manifold surfaces in differentiable geometry. Accordingly, in geometry processing, maps are ubiquitous and are used in many core applications, such as paramterization, shape analysis, remeshing, and deformation. Unfortunately, most computational representations of surface maps do not lend themselves to manipulatio…
▽ More
Maps are arguably one of the most fundamental concepts used to define and operate on manifold surfaces in differentiable geometry. Accordingly, in geometry processing, maps are ubiquitous and are used in many core applications, such as paramterization, shape analysis, remeshing, and deformation. Unfortunately, most computational representations of surface maps do not lend themselves to manipulation and optimization, usually entailing hard, discrete problems. While algorithms exist to solve these problems, they are problem-specific, and a general framework for surface maps is still in need. In this paper, we advocate considering neural networks as encoding surface maps. Since neural networks can be composed on one another and are differentiable, we show it is easy to use them to define surfaces via atlases, compose them for surface-to-surface map**s, and optimize differentiable objectives relating to them, such as any notion of distortion, in a trivial manner. In our experiments, we represent surfaces by generating a neural map that approximates a UV parameterization of a 3D model. Then, we compose this map with other neural maps which we optimize with respect to distortion measures. We show that our formulation enables trivial optimization of rather elusive map** tasks, such as maps between a collection of surfaces.
△ Less
Submitted 31 March, 2021;
originally announced March 2021.
-
Dense 3D Visual Map** via Semantic Simplification
Authors:
Luca Morreale,
Andrea Romanoni,
Matteo Matteucci
Abstract:
Dense 3D visual map** estimates as many as possible pixel depths, for each image. This results in very dense point clouds that often contain redundant and noisy information, especially for surfaces that are roughly planar, for instance, the ground or the walls in the scene. In this paper we leverage on semantic image segmentation to discriminate which regions of the scene require simplification…
▽ More
Dense 3D visual map** estimates as many as possible pixel depths, for each image. This results in very dense point clouds that often contain redundant and noisy information, especially for surfaces that are roughly planar, for instance, the ground or the walls in the scene. In this paper we leverage on semantic image segmentation to discriminate which regions of the scene require simplification and which should be kept at high level of details. We propose four different point cloud simplification methods which decimate the perceived point cloud by relying on class-specific local and global statistics still maintaining more points in the proximity of class boundaries to preserve the infra-class edges and discontinuities. 3D dense model is obtained by fusing the point clouds in a 3D Delaunay Triangulation to deal with variable point cloud density. In the experimental evaluation we have shown that, by leveraging on semantics, it is possible to simplify the model and diminish the noise affecting the point clouds.
△ Less
Submitted 20 February, 2019;
originally announced February 2019.
-
Predicting the Next Best View for 3D Mesh Refinement
Authors:
Luca Morreale,
Andrea Romanoni,
Matteo Matteucci
Abstract:
3D reconstruction is a core task in many applications such as robot navigation or sites inspections. Finding the best poses to capture part of the scene is one of the most challenging topic that goes under the name of Next Best View. Recently, many volumetric methods have been proposed; they choose the Next Best View by reasoning over a 3D voxelized space and by finding which pose minimizes the un…
▽ More
3D reconstruction is a core task in many applications such as robot navigation or sites inspections. Finding the best poses to capture part of the scene is one of the most challenging topic that goes under the name of Next Best View. Recently, many volumetric methods have been proposed; they choose the Next Best View by reasoning over a 3D voxelized space and by finding which pose minimizes the uncertainty decoded into the voxels. Such methods are effective, but they do not scale well since the underlaying representation requires a huge amount of memory. In this paper we propose a novel mesh-based approach which focuses on the worst reconstructed region of the environment mesh. We define a photo-consistent index to evaluate the 3D mesh accuracy, and an energy function over the worst regions of the mesh which takes into account the mutual parallax with respect to the previous cameras, the angle of incidence of the viewing ray to the surface and the visibility of the region. We test our approach over a well known dataset and achieve state-of-the-art results.
△ Less
Submitted 16 May, 2018;
originally announced May 2018.
-
Spectral Content of 22Na/44Ti Decay Data: Implications for a Solar Influence
Authors:
Daniel O'Keefe,
Brittany L. Morreale,
Robert H. Lee,
John B. Buncher,
Ephraim Fischbach,
Tom Gruenwald,
Jere H. Jenkins,
Daniel Javorsek II,
Peter A. Sturrock
Abstract:
We report a reanalysis of data on the measured decay rate ratio $^{22}$Na/$^{44}$Ti which were originally published by Norman et al., and interpreted as supporting the conventional hypothesis that nuclear decay rates are constant and not affected by outside influences. We find upon a more detailed analysis of both the amplitude and the phase of the Norman data that they actually favor the presence…
▽ More
We report a reanalysis of data on the measured decay rate ratio $^{22}$Na/$^{44}$Ti which were originally published by Norman et al., and interpreted as supporting the conventional hypothesis that nuclear decay rates are constant and not affected by outside influences. We find upon a more detailed analysis of both the amplitude and the phase of the Norman data that they actually favor the presence of an annual variation in $^{22}$Na/$^{44}$Ti, albeit weakly. Moreover, this conclusion holds for a broad range of parameters describing the amplitude and phase of an annual sinusoidal variation in these data. The results from this and related analyses underscore the growing importance of phase considerations in understanding the possible influence of the Sun on nuclear decays. Our conclusions with respect to the phase of the Norman data are consistent with independent analyses of solar neutrino data obtained at Super-Kamiokande-I and the Sudbury Neutrino Observatory (SNO).
△ Less
Submitted 10 December, 2012;
originally announced December 2012.
-
Power Spectrum Analyses of Nuclear Decay Rates
Authors:
D. Javorsek II,
P. A. Sturrock,
R. N. Lasenby,
A. N. Lasenby,
J. B. Buncher,
E. Fischbach,
J. T. Gruenwald,
A. W. Hoft,
T. J. Horan,
J. H. Jenkins,
J. L. Kerford,
R. H. Lee,
A. Longman,
J. J. Mattes,
B. L. Morreale,
D. B. Morris,
R. N. Mudry,
J. R. Newport,
D. O'Keefe,
M. A. Petrelli,
M. A. Silver,
C. A. Stewart,
B. Terry
Abstract:
We provide the results from a spectral analysis of nuclear decay data displaying annually varying periodic fluctuations. The analyzed data were obtained from three distinct data sets: 32Si and 36Cl decays reported by an experiment performed at the Brookhaven National Laboratory (BNL), 56Mn decay reported by the Children's Nutrition Research Center (CNRC), but also performed at BNL, and 226Ra decay…
▽ More
We provide the results from a spectral analysis of nuclear decay data displaying annually varying periodic fluctuations. The analyzed data were obtained from three distinct data sets: 32Si and 36Cl decays reported by an experiment performed at the Brookhaven National Laboratory (BNL), 56Mn decay reported by the Children's Nutrition Research Center (CNRC), but also performed at BNL, and 226Ra decay reported by an experiment performed at the Physikalisch-Technische Bundesanstalt (PTB) in Germany. All three data sets exhibit the same primary frequency mode consisting of an annual period. Additional spectral comparisons of the data to local ambient temperature, atmospheric pressure, relative humidity, Earth-Sun distance, and their reciprocals were performed. No common phases were found between the factors investigated and those exhibited by the nuclear decay data. This suggests that either a combination of factors was responsible, or that, if it was a single factor, its effects on the decay rate experiments are not a direct synchronous modulation. We conclude that the annual periodicity in these data sets is a real effect, but that further study involving additional carefully controlled experiments will be needed to establish its origin.
△ Less
Submitted 6 July, 2010;
originally announced July 2010.
