-
Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizer
Authors:
Eric Brachmann,
Jamie Wynn,
Shuai Chen,
Tommaso Cavallari,
Áron Monszpart,
Daniyar Turmukhambetov,
Victor Adrian Prisacariu
Abstract:
We address the task of estimating camera parameters from a set of images depicting a scene. Popular feature-based structure-from-motion (SfM) tools solve this task by incremental reconstruction: they repeat triangulation of sparse 3D points and registration of more camera views to the sparse point cloud. We re-interpret incremental structure-from-motion as an iterated application and refinement of…
▽ More
We address the task of estimating camera parameters from a set of images depicting a scene. Popular feature-based structure-from-motion (SfM) tools solve this task by incremental reconstruction: they repeat triangulation of sparse 3D points and registration of more camera views to the sparse point cloud. We re-interpret incremental structure-from-motion as an iterated application and refinement of a visual relocalizer, that is, of a method that registers new views to the current state of the reconstruction. This perspective allows us to investigate alternative visual relocalizers that are not rooted in local feature matching. We show that scene coordinate regression, a learning-based relocalization approach, allows us to build implicit, neural scene representations from unposed images. Different from other learning-based reconstruction methods, we do not require pose priors nor sequential inputs, and we optimize efficiently over thousands of images. Our method, ACE0 (ACE Zero), estimates camera poses to an accuracy comparable to feature-based SfM, as demonstrated by novel view synthesis. Project page: https://nianticlabs.github.io/acezero/
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
-
Chemical Classification of Spherules Recovered From The Pacific Ocean Site of The CNEOS 2014-01-08 (IM1) Bolide
Authors:
A. Loeb,
S. B. Jacobsen,
R. Tagle,
T. Adamson,
S. Bergstrom,
R. Cloete,
S. Cohen,
Laura Domine,
H. Fu,
C. Hoskinson,
E. Hyung,
M. Kelly,
E. Lard,
F. Laukien,
J. Lem,
R. McCallum,
R. Millsap,
C. Parendo,
M. I. Pataev,
C. Peddeti,
J. Pugh,
S. Samuha,
D. D. Sasselov,
M. Schlereth,
J. Siler
, et al. (6 additional authors not shown)
Abstract:
We have conducted an extensive towed-magnetic-sled survey during the period of June 14-28, 2023, over the seafloor about 85 km north of Manus Island, Papua New Guinea, centered around the calculated path of the bolide CNEOS 2014-01-08 (IM1). We found about 850 spherules of diameter 0.1-1.3 millimeters in our samples. The samples were analyzed by micro-XRF, Electron Probe Microanalyzer and ICP Mass…
▽ More
We have conducted an extensive towed-magnetic-sled survey during the period of June 14-28, 2023, over the seafloor about 85 km north of Manus Island, Papua New Guinea, centered around the calculated path of the bolide CNEOS 2014-01-08 (IM1). We found about 850 spherules of diameter 0.1-1.3 millimeters in our samples. The samples were analyzed by micro-XRF, Electron Probe Microanalyzer and ICP Mass spectrometry. Here we report major and trace element compositions of the samples and classify spherules based on that analysis. We identified 78% of the spherules as primitive, in that their compositions have not been affected by planetary differentiation. We divided these into four groups corresponding to previously described cosmic spherule types. The remaining 22% appear to all reflect planetary igneous differentiation and are all different from previously described spherules. We call them D-type spherules. A portion of the D-spherules show an excess of Be, La and U, by up to three orders of magnitude relative to the solar system standard of CI chondrites. Detailed mass spectroscopy of 12 of these BeLaU-type spherules, the population of which may constitute up to ~10% of our entire collected sample, suggests that they are derived from material formed by planetary igneous fractionation. Their chemical composition is unlike any known solar system material. We compare these compositions to known differentiated bodies in the solar system and find them similar to evolved planetary materials - with lunar KREEP the closest in terms of its trace element enrichment pattern, but unusual in terms of their elevated CI-normalized incompatible elements. The BeLaU-type spherules reflect a highly differentiated, extremely evolved composition of an unknown source.
△ Less
Submitted 14 February, 2024; v1 submitted 18 January, 2024;
originally announced January 2024.
-
Discovery of Spherules of Likely Extrasolar Composition in the Pacific Ocean Site of the CNEOS 2014-01-08 (IM1) Bolide
Authors:
Abraham Loeb,
Toby Adamson,
Sophie Bergstrom,
Richard Cloete,
Shai Cohen,
Kevin Conrad,
Laura Domine,
Hairuo Fu,
Charles Hoskinson,
Eugenia Hyung,
Stein Jacobsen,
Mike Kelly,
Jason Kohn,
Edwin Lard,
Sebastian Lam,
Frank Laukien,
Jim Lem,
Rob McCallum,
Rob Millsap,
Christopher Parendo,
Michail Pataev,
Chaitanya Peddeti,
Jeff Pugh,
Shmuel Samuha,
Dimitar Sasselov
, et al. (9 additional authors not shown)
Abstract:
We have conducted an extensive towed-magnetic-sled survey during the period 14-28 June, 2023, over the seafloor centered around the calculated path of the bolide CNEOS 2014-01-08 (IM1) about 85 km north of Manus Island, Papua New Guinea. We found about 700 spherules of diameter 0.05-1.3 millimeters in our samples, of which 57 were analyzed so far. The spherules were significantly concentrated alon…
▽ More
We have conducted an extensive towed-magnetic-sled survey during the period 14-28 June, 2023, over the seafloor centered around the calculated path of the bolide CNEOS 2014-01-08 (IM1) about 85 km north of Manus Island, Papua New Guinea. We found about 700 spherules of diameter 0.05-1.3 millimeters in our samples, of which 57 were analyzed so far. The spherules were significantly concentrated along the expected meteor path. Mass spectrometry of 47 spherules near the high-yield regions along IM1's path reveals a distinct extra-solar abundance pattern for 5 of them, while background spherules have abundances consistent with a solar system origin. The unique spherules show an excess of Be, La and U, by up to three orders of magnitude relative to the solar system standard of CI chondrites. These "BeLaU"-type spherules, never seen before, also have very low refractory siderophile elements such as Re. Volatile elements, such as Mn, Zn, Pb, are depleted as expected from evaporation losses during a meteor's airburst. In addition, the mass-dependent variations in $^{57}$Fe/$^{54}$Fe and $^{56}$Fe/$^{54}$Fe are also consistent with evaporative loss of the light isotopes during the spherules' travel in the atmosphere. The "BeLaU" abundance pattern is not found in control regions outside of IM1's path and does not match commonly manufactured alloys or natural meteorites in the solar system. This evidence points towards an association of "BeLaU"-type spherules with IM1, supporting its interstellar origin independently of the high velocity and unusual material strength implied from the CNEOS data. We suggest that the "BeLaU" abundance pattern could have originated from a highly differentiated magma ocean of a planet with an iron core outside the solar system or from more exotic sources.
△ Less
Submitted 29 August, 2023;
originally announced August 2023.
-
DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Models
Authors:
Jamie Wynn,
Daniyar Turmukhambetov
Abstract:
Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and differentiable renderings of the scene. Once trained from a sufficient set of views, NeRFs can generate novel views from arbitrary camera positions. However, the scene g…
▽ More
Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and differentiable renderings of the scene. Once trained from a sufficient set of views, NeRFs can generate novel views from arbitrary camera positions. However, the scene geometry and color fields are severely under-constrained, which can lead to artifacts, especially when trained with few input views.
To alleviate this problem we learn a prior over scene geometry and color, using a denoising diffusion model (DDM). Our DDM is trained on RGBD patches of the synthetic Hypersim dataset and can be used to predict the gradient of the logarithm of a joint probability distribution of color and depth patches. We show that, these gradients of logarithms of RGBD patch priors serve to regularize geometry and color of a scene. During NeRF training, random RGBD patches are rendered and the estimated gradient of the log-likelihood is backpropagated to the color and density fields. Evaluations on LLFF, the most relevant dataset, show that our learned prior achieves improved quality in the reconstructed geometry and improved generalization to novel views. Evaluations on DTU show improved reconstruction quality among NeRF methods.
△ Less
Submitted 8 November, 2023; v1 submitted 23 February, 2023;
originally announced February 2023.
-
Map-free Visual Relocalization: Metric Pose Relative to a Single Image
Authors:
Eduardo Arnold,
Jamie Wynn,
Sara Vicente,
Guillermo Garcia-Hernando,
Áron Monszpart,
Victor Adrian Prisacariu,
Daniyar Turmukhambetov,
Eric Brachmann
Abstract:
Can we relocalize in a scene represented by a single reference image? Standard visual relocalization requires hundreds of images and scale calibration to build a scene-specific 3D map. In contrast, we propose Map-free Relocalization, i.e., using only one photo of a scene to enable instant, metric scaled relocalization. Existing datasets are not suitable to benchmark map-free relocalization, due to…
▽ More
Can we relocalize in a scene represented by a single reference image? Standard visual relocalization requires hundreds of images and scale calibration to build a scene-specific 3D map. In contrast, we propose Map-free Relocalization, i.e., using only one photo of a scene to enable instant, metric scaled relocalization. Existing datasets are not suitable to benchmark map-free relocalization, due to their focus on large scenes or their limited variability. Thus, we have constructed a new dataset of 655 small places of interest, such as sculptures, murals and fountains, collected worldwide. Each place comes with a reference image to serve as a relocalization anchor, and dozens of query images with known, metric camera poses. The dataset features changing conditions, stark viewpoint changes, high variability across places, and queries with low to no visual overlap with the reference image. We identify two viable families of existing methods to provide baseline results: relative pose regression, and feature matching combined with single-image depth prediction. While these methods show reasonable performance on some favorable scenes in our dataset, map-free relocalization proves to be a challenge that requires new, innovative solutions.
△ Less
Submitted 11 October, 2022;
originally announced October 2022.
-
Single-Atom Scale Structural Selectivity in Te Nanowires Encapsulated inside Ultra-Narrow, Single-Walled Carbon Nanotubes
Authors:
Paulo V. C. Medeiros,
Samuel Marks,
Jamie M. Wynn,
Andrij Vasylenko,
Quentin M. Ramasse,
David Quigley,
Jeremy Sloan,
Andrew J. Morris
Abstract:
Extreme nanowires (ENs) represent the ultimate class of crystals: They are the smallest possible periodic materials. With atom-wide motifs repeated in one dimension (1D), they offer a privileged perspective into the Physics and Chemistry of low-dimensional systems. Single-walled carbon nanotubes (SWCNTs) provide ideal environments for the creation of such materials. Here we present a comprehensive…
▽ More
Extreme nanowires (ENs) represent the ultimate class of crystals: They are the smallest possible periodic materials. With atom-wide motifs repeated in one dimension (1D), they offer a privileged perspective into the Physics and Chemistry of low-dimensional systems. Single-walled carbon nanotubes (SWCNTs) provide ideal environments for the creation of such materials. Here we present a comprehensive study of Te ENs encapsulated inside ultra- narrow SWCNTs with diameters between 0.7 nm and 1.1 nm. We combine state-of-the-art imaging techniques and 1D-adapted ab initio structure prediction to treat both confinement and periodicity effects. The studied Te ENs adopt a variety of structures, exhibiting a true 1D realisation of a Peierls structural distortion and transition from metallic to insulating behaviour as a function of encapsulating diameter. We analyse the mechanical stability of the encapsulated ENs and show that nanoconfinement is not only a useful means to produce ENs, but may actually be necessary, in some cases, to prevent them from disintegrating. The ability to control functional properties of these ENs with confinement has numerous applications in future device technologies, and we anticipate that our study will set the basic paradigm to be adopted in the characterisation and understanding of such systems.
△ Less
Submitted 3 May, 2017; v1 submitted 17 January, 2017;
originally announced January 2017.
-
Encapsulated Nanowires: Boosting Electronic Transport in Carbon Nanotubes
Authors:
Andrij Vasylenko,
Jamie Wynn,
Paulo Medeiros,
Andrew J. Morris,
Jeremy Sloan,
David Quigley
Abstract:
The electrical conductivity of metallic carbon nanotubes (CNTs) quickly saturates with respect to bias voltage due to scattering from a large population of optical phonons. Decay of these dominant scatterers in pristine CNTs is too slow to offset an increased generation rate at high voltage bias. We demonstrate from first principles that encapsulation of 1D atomic chains within a single-walled CNT…
▽ More
The electrical conductivity of metallic carbon nanotubes (CNTs) quickly saturates with respect to bias voltage due to scattering from a large population of optical phonons. Decay of these dominant scatterers in pristine CNTs is too slow to offset an increased generation rate at high voltage bias. We demonstrate from first principles that encapsulation of 1D atomic chains within a single-walled CNT can enhance decay of "hot" phonons by providing additional channels for thermalisation. Pacification of the phonon population growth reduces electrical resistivity of metallic CNTs by 51% for an example system with encapsulated beryllium.
△ Less
Submitted 8 February, 2017; v1 submitted 15 November, 2016;
originally announced November 2016.
-
Structures and finite-temperature abundances of defects in In$_2$O$_3$-II from first-principles calculations
Authors:
Jamie M. Wynn,
Richard J. Needs,
Andrew J. Morris
Abstract:
We have studied intrinsic defect complexes in In$_2$O$_3$ using ab initio random structure searching (AIRSS). Our first-principles density-functional-theory calculations predict the thermodynamic stability of several novel defect structures. We combine the static lattice energy and harmonic vibrational energy with the often-neglected configurational entropy to construct the free energy, which is m…
▽ More
We have studied intrinsic defect complexes in In$_2$O$_3$ using ab initio random structure searching (AIRSS). Our first-principles density-functional-theory calculations predict the thermodynamic stability of several novel defect structures. We combine the static lattice energy and harmonic vibrational energy with the often-neglected configurational entropy to construct the free energy, which is minimised to predict defect abundances at finite temperatures. We predict that some of our new defect structures - in particular our {In,2V$_\mathrm{O}$} and {2In,3V$_\mathrm{O}$} defects - can exist in significant abundances at finite temperatures, and their densities of electronic states indicate that they could play an important role in the unexpectedly high density of n-type charge carriers observed in In$_2$O$_3$.
△ Less
Submitted 15 September, 2016;
originally announced September 2016.
-
Gain in a quantum wire laser of high uniformity
Authors:
Hidefumi Akiyama,
Loren N. Pfeiffer,
Masahiro Yoshita,
Aron Pinczuk,
Peter B. Littlewood,
Ken W. West,
Manyalibo J. Matthews,
James Wynn
Abstract:
A multi-quantum wire laser operating in the 1-D ground state has been achieved in a very high uniformity structure that shows free exciton emission with unprecedented narrow width and low lasing threshold. Under optical pum** the spontaneous emission evolves from a sharp free exciton peak to a red-shifted broad band. The lasing photon energy occurs about 5 meV below the free exciton. The obser…
▽ More
A multi-quantum wire laser operating in the 1-D ground state has been achieved in a very high uniformity structure that shows free exciton emission with unprecedented narrow width and low lasing threshold. Under optical pum** the spontaneous emission evolves from a sharp free exciton peak to a red-shifted broad band. The lasing photon energy occurs about 5 meV below the free exciton. The observed shift excludes free excitons in lasing and our results show that Coulomb interactions in the 1-D electron-hole system shift the spontaneous emission and play significant roles in laser gain.
△ Less
Submitted 8 June, 2002;
originally announced June 2002.
-
Preparation and Characterization of Homogeneous YBCO Single Crystals with Do** Level near the SC-AFM Boundary
Authors:
Ruixing Liang,
D. A. Bonn,
W. N. Hardy,
Janice C. Wynn,
K. A. Moler,
L. Lu,
S. Larochelle,
L. Zhou,
M. Greven,
L. Lurio,
S. G. J. Mochrie
Abstract:
High-purity and homogeneous YBa2Cu3Oy single crystals with carrier do** level near the AFM-SC boundary have been obtained in the oxygen content range between y = 6.340 and 6.370. The crystals are ortho-II phase at room temperature and undergo the orthorhombic to tetragonal transition at about 140_Degree_C. They show sharp superconducting transitions, with Tc between 4 and 20 K. Tc changes by 0…
▽ More
High-purity and homogeneous YBa2Cu3Oy single crystals with carrier do** level near the AFM-SC boundary have been obtained in the oxygen content range between y = 6.340 and 6.370. The crystals are ortho-II phase at room temperature and undergo the orthorhombic to tetragonal transition at about 140_Degree_C. They show sharp superconducting transitions, with Tc between 4 and 20 K. Tc changes by 0.8 K when the oxygen content y is changed by 0.001, and is also sensitive to annealing conditions near room temperature, due to the dependence of do** on oxygen ordering correlation lengths. Crystals with oxygen content y lower than 6.345 are non-superconducting.
△ Less
Submitted 20 November, 2001;
originally announced November 2001.
