-
Collaborative Large-Scale Dense 3D Reconstruction with Online Inter-Agent Pose Optimisation
Authors:
Stuart Golodetz,
Tommaso Cavallari,
Nicholas A Lord,
Victor A Prisacariu,
David W Murray,
Philip H S Torr
Abstract:
Reconstructing dense, volumetric models of real-world 3D scenes is important for many tasks, but capturing large scenes can take significant time, and the risk of transient changes to the scene goes up as the capture time increases. These are good reasons to want instead to capture several smaller sub-scenes that can be joined to make the whole scene. Achieving this has traditionally been difficul…
▽ More
Reconstructing dense, volumetric models of real-world 3D scenes is important for many tasks, but capturing large scenes can take significant time, and the risk of transient changes to the scene goes up as the capture time increases. These are good reasons to want instead to capture several smaller sub-scenes that can be joined to make the whole scene. Achieving this has traditionally been difficult: joining sub-scenes that may never have been viewed from the same angle requires a high-quality camera relocaliser that can cope with novel poses, and tracking drift in each sub-scene can prevent them from being joined to make a consistent overall scene. Recent advances, however, have significantly improved our ability to capture medium-sized sub-scenes with little to no tracking drift: real-time globally consistent reconstruction systems can close loops and re-integrate the scene surface on the fly, whilst new visual-inertial odometry approaches can significantly reduce tracking drift during live reconstruction. Moreover, high-quality regression forest-based relocalisers have recently been made more practical by the introduction of a method to allow them to be trained and used online. In this paper, we leverage these advances to present what to our knowledge is the first system to allow multiple users to collaborate interactively to reconstruct dense, voxel-based models of whole buildings using only consumer-grade hardware, a task that has traditionally been both time-consuming and dependent on the availability of specialised hardware. Using our system, an entire house or lab can be reconstructed in under half an hour and at a far lower cost than was previously possible.
△ Less
Submitted 2 July, 2019; v1 submitted 25 January, 2018;
originally announced January 2018.
-
InfiniTAM v3: A Framework for Large-Scale 3D Reconstruction with Loop Closure
Authors:
Victor Adrian Prisacariu,
Olaf Kähler,
Stuart Golodetz,
Michael Sapienza,
Tommaso Cavallari,
Philip H S Torr,
David W Murray
Abstract:
Volumetric models have become a popular representation for 3D scenes in recent years. One breakthrough leading to their popularity was KinectFusion, which focuses on 3D reconstruction using RGB-D sensors. However, monocular SLAM has since also been tackled with very similar approaches. Representing the reconstruction volumetrically as a TSDF leads to most of the simplicity and efficiency that can…
▽ More
Volumetric models have become a popular representation for 3D scenes in recent years. One breakthrough leading to their popularity was KinectFusion, which focuses on 3D reconstruction using RGB-D sensors. However, monocular SLAM has since also been tackled with very similar approaches. Representing the reconstruction volumetrically as a TSDF leads to most of the simplicity and efficiency that can be achieved with GPU implementations of these systems. However, this representation is memory-intensive and limits applicability to small-scale reconstructions. Several avenues have been explored to overcome this. With the aim of summarizing them and providing for a fast, flexible 3D reconstruction pipeline, we propose a new, unifying framework called InfiniTAM. The idea is that steps like camera tracking, scene representation and integration of new data can easily be replaced and adapted to the user's needs.
This report describes the technical implementation details of InfiniTAM v3, the third version of our InfiniTAM system. We have added various new features, as well as making numerous enhancements to the low-level code that significantly improve our camera tracking performance. The new features that we expect to be of most interest are (i) a robust camera tracking module; (ii) an implementation of Glocker et al.'s keyframe-based random ferns camera relocaliser; (iii) a novel approach to globally-consistent TSDF-based reconstruction, based on dividing the scene into rigid submaps and optimising the relative poses between them; and (iv) an implementation of Keller et al.'s surfel-based reconstruction approach.
△ Less
Submitted 2 August, 2017;
originally announced August 2017.
-
SemanticPaint: A Framework for the Interactive Segmentation of 3D Scenes
Authors:
Stuart Golodetz,
Michael Sapienza,
Julien P. C. Valentin,
Vibhav Vineet,
Ming-Ming Cheng,
Anurag Arnab,
Victor A. Prisacariu,
Olaf Kähler,
Carl Yuheng Ren,
David W. Murray,
Shahram Izadi,
Philip H. S. Torr
Abstract:
We present an open-source, real-time implementation of SemanticPaint, a system for geometric reconstruction, object-class segmentation and learning of 3D scenes. Using our system, a user can walk into a room wearing a depth camera and a virtual reality headset, and both densely reconstruct the 3D scene and interactively segment the environment into object classes such as 'chair', 'floor' and 'tabl…
▽ More
We present an open-source, real-time implementation of SemanticPaint, a system for geometric reconstruction, object-class segmentation and learning of 3D scenes. Using our system, a user can walk into a room wearing a depth camera and a virtual reality headset, and both densely reconstruct the 3D scene and interactively segment the environment into object classes such as 'chair', 'floor' and 'table'. The user interacts physically with the real-world scene, touching objects and using voice commands to assign them appropriate labels. These user-generated labels are leveraged by an online random forest-based machine learning algorithm, which is used to predict labels for previously unseen parts of the scene. The entire pipeline runs in real time, and the user stays 'in the loop' throughout the process, receiving immediate feedback about the progress of the labelling and interacting with the scene as necessary to refine the predicted segmentation.
△ Less
Submitted 13 October, 2015;
originally announced October 2015.
-
Collapse in Self-gravitating Turbulent Fluids
Authors:
Daniel W. Murray,
Philip Chang,
Norman W. Murray,
John Pittman
Abstract:
Motivated by the nonlinear star formation efficiency found in recent numerical simulations by a number of workers, we perform high-resolution adaptive mesh refinement simulations of star formation in self-gravitating turbulently driven gas. As we follow the collapse of this gas, we find that the character of the flow changes at two radii, the disk radius $r_d$, and the radius $r_*$ where the enclo…
▽ More
Motivated by the nonlinear star formation efficiency found in recent numerical simulations by a number of workers, we perform high-resolution adaptive mesh refinement simulations of star formation in self-gravitating turbulently driven gas. As we follow the collapse of this gas, we find that the character of the flow changes at two radii, the disk radius $r_d$, and the radius $r_*$ where the enclosed gas mass exceeds the stellar mass. Accretion starts at large scales and works inwards. In line with recent analytical work, we find that the density evolves to a fixed attractor, $ρ(r,t ) \rightarrow ρ(r)$, for $r_d<r<r_*$; mass flows through this structure onto a sporadically gravitationally unstable disk, and from thence onto the star. In the bulk of the simulation box we find that the random motions $v_T \sim r^p$ with $p \sim 0.5$, in agreement with Larson's size-linewidth relation. In the vicinity of massive star forming regions we find $ p \sim 0.2-0.3$, as seen in observations. For $r<r_*$, $v_T$ increases inward, with $p=-1/2$. Finally, we find that the total stellar mass $M_*(t)\sim t^2$ in line with previous numerical and analytic work that suggests a nonlinear rate of star formation.
△ Less
Submitted 28 October, 2016; v1 submitted 19 September, 2015;
originally announced September 2015.
-
A Framework for the Volumetric Integration of Depth Images
Authors:
Victor Adrian Prisacariu,
Olaf Kähler,
Ming Ming Cheng,
Carl Yuheng Ren,
Julien Valentin,
Philip H. S. Torr,
Ian D. Reid,
David W. Murray
Abstract:
Volumetric models have become a popular representation for 3D scenes in recent years. One of the breakthroughs leading to their popularity was KinectFusion, where the focus is on 3D reconstruction using RGB-D sensors. However, monocular SLAM has since also been tackled with very similar approaches. Representing the reconstruction volumetrically as a truncated signed distance function leads to most…
▽ More
Volumetric models have become a popular representation for 3D scenes in recent years. One of the breakthroughs leading to their popularity was KinectFusion, where the focus is on 3D reconstruction using RGB-D sensors. However, monocular SLAM has since also been tackled with very similar approaches. Representing the reconstruction volumetrically as a truncated signed distance function leads to most of the simplicity and efficiency that can be achieved with GPU implementations of these systems. However, this representation is also memory-intensive and limits the applicability to small scale reconstructions. Several avenues have been explored for overcoming this limitation. With the aim of summarizing them and providing for a fast and flexible 3D reconstruction pipeline, we propose a new, unifying framework called InfiniTAM. The core idea is that individual steps like camera tracking, scene representation and integration of new data can easily be replaced and adapted to the needs of the user. Along with the framework we also provide a set of components for scalable reconstruction: two implementations of camera trackers, based on RGB data and on depth data, two representations of the 3D volumetric data, a dense volume and one based on hashes of subblocks, and an optional module for swap** subblocks in and out of the typically limited GPU memory.
△ Less
Submitted 23 October, 2014; v1 submitted 3 October, 2014;
originally announced October 2014.
-
Enhancement factor for the electron electric dipole moment in francium and gold atoms
Authors:
T. M. R. Byrnes,
V. A. Dzuba,
V. V. Flambaum,
D. W. Murray
Abstract:
If electrons had an electric dipole moment (EDM) they would induce EDMs of atoms. The ratio of the atomic EDM to the electron EDM for a particular atom is called the enhancement factor, R. We calculate the enhancement factor for the francium and gold atoms, with the results 910 plus/minus 5% for Fr and 260 plus/minus 15% for Au. The large values of these enhancement factors make these atoms attr…
▽ More
If electrons had an electric dipole moment (EDM) they would induce EDMs of atoms. The ratio of the atomic EDM to the electron EDM for a particular atom is called the enhancement factor, R. We calculate the enhancement factor for the francium and gold atoms, with the results 910 plus/minus 5% for Fr and 260 plus/minus 15% for Au. The large values of these enhancement factors make these atoms attractive for electron EDM measurements, and hence the search for time-reversal invariance violation.
△ Less
Submitted 25 November, 1998; v1 submitted 22 November, 1998;
originally announced November 1998.
-
Dyons as a source of CP and time invariance violation: electric dipole moments and K-meson decays
Authors:
D. W. Murray,
V. V. Flambaum
Abstract:
We consider a mechanism by which dyons (electrically charged magnetic monopoles) can produce both a T- and P-odd (i.e. time reversal invariance and parity violating) mixed polarizability beta [defined by Delta E = -beta E.B, where Delta E is the energy change when electric (E) and magnetic (B) fields are applied to a system] and a T- and P-odd interaction between two particles: psi_1-bar gamma_5…
▽ More
We consider a mechanism by which dyons (electrically charged magnetic monopoles) can produce both a T- and P-odd (i.e. time reversal invariance and parity violating) mixed polarizability beta [defined by Delta E = -beta E.B, where Delta E is the energy change when electric (E) and magnetic (B) fields are applied to a system] and a T- and P-odd interaction between two particles: psi_1-bar gamma_5 psi_1 psi_2-bar psi_2, where the psi_i are electron and quark spinors. The latter can create atomic and neutron electric dipole moments (EDMs). From experimental bounds on these we find limits on the properties of dyons. Our best limit, using the experimental limit for the EDM of the Tl atom, is M |Q g (Q^2 - g^2)|^(-1/4) > 6 GeV, where M is the dyon mass and Q is the electric and g the magnetic charge of the dyons. The contribution of dyons to CP violation in K-meson decays is also estimated.
△ Less
Submitted 22 July, 1998;
originally announced July 1998.
-
Time invariance violating nuclear electric octupole moments
Authors:
V. V. Flambaum,
D. W. Murray,
S. R. Orton
Abstract:
The existence of a nuclear electric octupole moment (EOM) requires both parity and time invariance violation. The EOMs of odd $Z$ nuclei that are induced by a particular T- and P-odd interaction are calculated. We compare such octupole moments with the collective EOMs that can occur in nuclei having a static octupole deformation. A nuclear EOM can induce a parity and time invariance violating at…
▽ More
The existence of a nuclear electric octupole moment (EOM) requires both parity and time invariance violation. The EOMs of odd $Z$ nuclei that are induced by a particular T- and P-odd interaction are calculated. We compare such octupole moments with the collective EOMs that can occur in nuclei having a static octupole deformation. A nuclear EOM can induce a parity and time invariance violating atomic electric dipole moment, and the magnitude of this effect is calculated. The contribution of a nuclear EOM to such a dipole moment is found, in most cases, to be smaller than that of other mechanisms of atomic electric dipole moment production.
△ Less
Submitted 11 April, 1997;
originally announced April 1997.
-
The anapole moment and nucleon weak interactions
Authors:
V. V. Flambaum,
D. W. Murray
Abstract:
From the recent measurement of parity nonconservation (PNC) in the Cs atom we have extracted the constant of the nuclear spin dependent electron-nucleon PNC interaction, $κ= 0.442 (63)$; the anapole moment constant, $κ_a = 0.364 (62)$; the strength of the PNC proton-nucleus potential, $g_p = 7.3 \pm 1.2 (exp.) \pm 1.5 (theor.)$; the $π$-meson-nucleon interaction constant,…
▽ More
From the recent measurement of parity nonconservation (PNC) in the Cs atom we have extracted the constant of the nuclear spin dependent electron-nucleon PNC interaction, $κ= 0.442 (63)$; the anapole moment constant, $κ_a = 0.364 (62)$; the strength of the PNC proton-nucleus potential, $g_p = 7.3 \pm 1.2 (exp.) \pm 1.5 (theor.)$; the $π$-meson-nucleon interaction constant, $f_π\equiv h_π^{1} = [9.5 \pm 2.1 (exp.) \pm 3.5 (theor.)] \times 10^{-7}$; and the strength of the neutron-nucleus potential, $g_n = -1.7 \pm 0.8 (exp.) \pm 1.3 (theor.)$.
△ Less
Submitted 3 April, 1997; v1 submitted 24 March, 1997;
originally announced March 1997.
-
Limits on the monopole magnetic field from measurements of the electric dipole moments of atoms, molecules and the neutron
Authors:
V. V. Flambaum,
D. W. Murray
Abstract:
A radial magnetic field can induce a time invariance violating electric dipole moment (EDM) in quantum systems. The EDMs of the Tl, Cs, Xe and Hg atoms and the neutron that are produced by such a field are estimated. The contributions of such a field to the constants, $χ$ of the T,P-odd interactions $χ_e {\bf N} \cdot {\bf s}/s$ and $χ_N {\bf N} \cdot {\bf I}/I$ are also estimated for the TlF, H…
▽ More
A radial magnetic field can induce a time invariance violating electric dipole moment (EDM) in quantum systems. The EDMs of the Tl, Cs, Xe and Hg atoms and the neutron that are produced by such a field are estimated. The contributions of such a field to the constants, $χ$ of the T,P-odd interactions $χ_e {\bf N} \cdot {\bf s}/s$ and $χ_N {\bf N} \cdot {\bf I}/I$ are also estimated for the TlF, HgF and YbF molecules (where ${\bf s}$ (${\bf I}$) is the electron (nuclear) spin and ${\bf N}$ is the molecular axis). The best limit on the contact monopole field can be obtained from the measured value of the Tl EDM. The possibility of such a field being produced from polarization of the vacuum of electrically charged magnetic monopoles (dyons) by a Coulomb field is discussed, as well as the limit on these dyons. An alternative mechanism involves chromomagnetic and chromoelectric fields in QCD.
△ Less
Submitted 16 July, 1996; v1 submitted 22 April, 1996;
originally announced April 1996.
-
Quantum Monte Carlo study of the one-dimensional Holstein model of spinless fermions
Authors:
Ross H. McKenzie,
C. J. Hamer,
D. W. Murray
Abstract:
The Holstein model of spinless fermions interacting with dispersionless phonons in one dimension is studied by a Green's function Monte Carlo technique. The ground state energy, first fermionic excited state, density wave correlations, and mean lattice displacement are calculated for lattices of up to 16 sites, for one fermion per two sites, i.e., a half-filled band. Results are obtained for val…
▽ More
The Holstein model of spinless fermions interacting with dispersionless phonons in one dimension is studied by a Green's function Monte Carlo technique. The ground state energy, first fermionic excited state, density wave correlations, and mean lattice displacement are calculated for lattices of up to 16 sites, for one fermion per two sites, i.e., a half-filled band. Results are obtained for values of the fermion hop** parameter of $t=0.1 ω$, $ω$, and $10 ω$ where $ω$ is the phonon frequency. At a finite fermion-phonon coupling $g$ there is a transition from a metallic phase to an insulating phase in which there is charge-density-wave order. Finite size scaling is found to hold in the metallic phase and is used to extract the coupling dependence of the Luttinger liquid parameters, $u_ρ$ and $K_ρ$, the velocity of charge excitations and the correlation exponent, respectively. For free fermions ($g=0$) and for strong coupling ($g^2 \gg t ω$) our results agree well with known analytic results. For $t=ω$ and $t=10ω$ our results are inconsistent with the metal-insulator transition being a Kosterlitz-Thouless transition.\\
△ Less
Submitted 31 January, 1996; v1 submitted 6 December, 1995;
originally announced December 1995.
-
The incoherent part of the spin-wave polarization operator in the t-J model
Authors:
D. W. Murray,
O. P. Sushkov
Abstract:
A calculation of the spin-wave polarization operator is very important for the analysis of the magnetic structure of high temperature superconductors. We analyze the significance of the incoherent part of the spin-wave polarization operator within the framework of the t-J model. This part is calculated analytically for small do** with logarithmic accuracy. We conclude that the incoherent part…
▽ More
A calculation of the spin-wave polarization operator is very important for the analysis of the magnetic structure of high temperature superconductors. We analyze the significance of the incoherent part of the spin-wave polarization operator within the framework of the t-J model. This part is calculated analytically for small do** with logarithmic accuracy. We conclude that the incoherent part of the spin-wave polarization operator is negligible in comparison with the coherent part.
△ Less
Submitted 18 November, 1995; v1 submitted 16 November, 1995;
originally announced November 1995.
