-
Using Deep Reinforcement Learning with Automatic Curriculum Learning for Mapless Navigation in Intralogistics
Authors:
Honghu Xue,
Benedikt Hein,
Mohamed Bakr,
Georg Schildbach,
Bengt Abel,
Elmar Rueckert
Abstract:
We propose a deep reinforcement learning approach for solving a mapless navigation problem in warehouse scenarios. In our approach, an automation guided vehicle is equipped with LiDAR and frontal RGB sensors and learns to perform a targeted navigation task. The challenges reside in the sparseness of positive samples for learning, multi-modal sensor perception with partial observability, the demand…
▽ More
We propose a deep reinforcement learning approach for solving a mapless navigation problem in warehouse scenarios. In our approach, an automation guided vehicle is equipped with LiDAR and frontal RGB sensors and learns to perform a targeted navigation task. The challenges reside in the sparseness of positive samples for learning, multi-modal sensor perception with partial observability, the demand for accurate steering maneuvers together with long training cycles. To address these points, we propose NavACL-Q as a method for automatic curriculum learning in combination with a distributed version of the soft actor-critic algorithm. The performance of the learning algorithm is evaluated exhaustively in an unseen warehouse environment to validate both robustness and generalizability of the learned policy. Results in NVIDIA Isaac Sim demonstrates that our trained agent significantly outperforms a map-based navigation pipeline provided by NVIDIA Isaac Sim with an increased agent-goal distance of 3m and wider initial relative agent-goal rotations of 45 degree. The ablation studies also suggests that NavACL-Q greatly facilitates the learning process with a performance gain of roughly 40% compared to training with random starts and that the utilization of a pre-trained feature extractor manifestly boosts the performance by approximately 60%.
△ Less
Submitted 16 March, 2022; v1 submitted 23 February, 2022;
originally announced February 2022.
-
Weak electron irradiation suppresses the anomalous magnetization of N-doped diamond crystals
Authors:
Annette Setzer,
Pablo D. Esquinazi,
Olesya Daikos,
Tom Scherzer,
Andreas Pöppl,
Robert Staacke,
Tobias Lühmann,
Sebastien Pezzagna,
Wolfgang Knolle,
Sergei Buga,
Bernd Abel,
Jan Meijer
Abstract:
Several diamond bulk crystals with a concentration of electrically neutral single substitutional nitrogen atoms of $\lesssim 80~$ppm, the so-called C- or P1-centres, were irradiated with electrons at 10 MeV energy and low fluence. The results show a complete suppression of the irreversible behavior in field and temperature of the magnetization below $\sim 30$~K, after a decrease of $\lesssim 40~$p…
▽ More
Several diamond bulk crystals with a concentration of electrically neutral single substitutional nitrogen atoms of $\lesssim 80~$ppm, the so-called C- or P1-centres, were irradiated with electrons at 10 MeV energy and low fluence. The results show a complete suppression of the irreversible behavior in field and temperature of the magnetization below $\sim 30$~K, after a decrease of $\lesssim 40~$ppm in the concentration of C-centres produced by the electron irradiation. This result indicates that magnetic C-centres are at the origin of the large hysteretic behavior found recently in nitrogen-doped diamond crystals. This is remarkable because of the relatively low density of C-centres, stressing the extraordinary role of the C-centres in triggering those phenomena in diamond at relatively high temperatures. After annealing the samples at high temperatures in vacuum, the hysteretic behavior is partially recovered.
△ Less
Submitted 31 August, 2021;
originally announced August 2021.
-
Efficient Conversion of Nitrogen to Nitrogen-Vacancy Centers in Diamond Particles with High-Temperature Electron Irradiation
Authors:
Yuliya Mindarava,
Rémi Blinder,
Christian Laube,
Wolfgang Knolle,
Bernd Abel,
Christian Jentgens,
Junichi Isoya,
Jochen Scheuer,
Johannes Lang,
Ilai Schwartz,
Boris Naydenov,
Fedor Jelezko
Abstract:
Fluorescent nanodiamonds containing negatively-charged nitrogen-vacancy (NV$^-$) centers are promising for a wide range of applications, such as for sensing, as fluorescence biomarkers, or to hyperpolarize nuclear spins. NV$^-$ centers are formed from substitutional nitrogen (P1 centers) defects and vacancies in the diamond lattice. Maximizing the concentration of NVs is most beneficial, which jus…
▽ More
Fluorescent nanodiamonds containing negatively-charged nitrogen-vacancy (NV$^-$) centers are promising for a wide range of applications, such as for sensing, as fluorescence biomarkers, or to hyperpolarize nuclear spins. NV$^-$ centers are formed from substitutional nitrogen (P1 centers) defects and vacancies in the diamond lattice. Maximizing the concentration of NVs is most beneficial, which justifies the search for methods with a high yield of conversion from P1 to NV$^-$. We report here the characterization of surface cleaned fluorescent micro- and nanodiamonds, obtained by irradiation of commercial diamond powder with high-energy (10 MeV) electrons and simultaneous annealing at 800°C. Using this technique and increasing the irradiation dose, we demonstrate the creation of NV$^-$ with up to 25 % conversion yield. Finally, we monitor the creation of irradiation-induced spin-1 defects in microdiamond particles, which we associate with W16 and W33 centers, and investigate the effects of irradiation dose and particle size on the coherence time of NV$^-$.
△ Less
Submitted 24 July, 2020;
originally announced July 2020.
-
Investigation of room temperature multispin-assisted bulk diamond 13C hyperpolarization at low magnetic fields
Authors:
Ralf Wunderlich,
Jonas Kohlrautz,
Bernd Abel,
Jürgen Haase,
Jan Meijer
Abstract:
In this work we investigated the time behavior of the polarization of bulk 13C nuclei in diamond above the thermal equilibrium. This nonthermal nuclear hyperpolarization is achieved by cross relaxation between two nitrogen related paramagnetic defect species in diamond in combination with optical pum**. The decay of the hyperpolarization at four different magnetic fields is measured. Furthermore…
▽ More
In this work we investigated the time behavior of the polarization of bulk 13C nuclei in diamond above the thermal equilibrium. This nonthermal nuclear hyperpolarization is achieved by cross relaxation between two nitrogen related paramagnetic defect species in diamond in combination with optical pum**. The decay of the hyperpolarization at four different magnetic fields is measured. Furthermore, we use the comparison with conventional nuclear resonance measurements to identify the involved distances of the nuclear spin with respect to the defects and therefore the coupling strengths. Also, a careful look at the linewidth of the signal give valuable information to piece together the puzzle of the hyperpolarization mechanism.
△ Less
Submitted 14 February, 2018;
originally announced February 2018.
-
Functionalization of atomic force microscopy Akiyama tips for magnetic force microscopy measurements
Authors:
Markus Stiller,
Jose Barzola-Quiquia,
Pablo D. Esquinazi,
Soraya Sangiao,
Jose M. De Teresa,
Jan Meijer,
Bernd Abel
Abstract:
In this work we have used focused electron beam induced deposition of cobalt to functionalize atomic force microscopy Akiyama tips for application in magnetic force microscopy. The grown tips have a content of 90% Co after exposure to ambient air. The magnetic tips were characterized using energy dispersive X-ray spectroscopy and scanning electron microscopy. In order to investigate the magnetic p…
▽ More
In this work we have used focused electron beam induced deposition of cobalt to functionalize atomic force microscopy Akiyama tips for application in magnetic force microscopy. The grown tips have a content of 90% Co after exposure to ambient air. The magnetic tips were characterized using energy dispersive X-ray spectroscopy and scanning electron microscopy. In order to investigate the magnetic properties, current loops were prepared by electron beam lithography. Measurements at room temperature as well as 4.2K were carried out and the coercive field of 68 Oe of the Co tip was estimated by applying several external fields in the opposite direction of the tip magnetization. Magnetic Akiyama tips open new possibilities for low to room-temperature magnetic force microscopy measurements.
△ Less
Submitted 17 September, 2017;
originally announced September 2017.
-
Room temperature bulk diamond 13-C hyperpolarisation -- Strong evidence for a complex four spin coupling
Authors:
Ralf Wunderlich,
Jonas Kohlrautz,
Bernd Abel,
Jürgen Haase,
Jan Meijer
Abstract:
Hyperpolarisation at room temperature is one of the most important research fields in order to improve liquid, gas or nanoparticle tracer for Magnetic Resonance Imaging (MRI) in medical applications. In this paper we utilize nuclear magnetic resonance (NMR) to investigate the hyperpolarisation effect of negatively charged nitrogen vacancy (NV) centres on carbon-13 nuclei and their spin diffusion i…
▽ More
Hyperpolarisation at room temperature is one of the most important research fields in order to improve liquid, gas or nanoparticle tracer for Magnetic Resonance Imaging (MRI) in medical applications. In this paper we utilize nuclear magnetic resonance (NMR) to investigate the hyperpolarisation effect of negatively charged nitrogen vacancy (NV) centres on carbon-13 nuclei and their spin diffusion in a diamond single crystal close to the excited state level anti crossing (ESLAC) around 50 mT. Whereas the electron spins of the NV centre can be easily polarized in its m = 0 ground state at room temperature just by irradiation with green light , the swop of the NV electron spin polarization to a carbon-13 nuclei is a complex task. We found that the coupling between the polarized NV electron spin, the electron spin of a substitutional nitrogen impurity (P1) as well as its nitrogen-14 nuclei and the carbon-13 nuclear spin has to be considered. Here we show that through an optimization of this procedure, in about two minutes a signal to noise ratio which corresponds to a 23 hour standard measurement without hyperpolarisation and an accumulation of 460 single scans can be obtained. Furthermore we were able to identify several polarisation peaks of different sign at different magnetic fields in a region of some tens of gauss. Most of the peaks can be attributed to a coupling of the NV centres to nearby P1 centres. We present a new theoretical model in a framework of cross polarisation of a four spin dynamic model in good agreement with our experimental data. The results demonstrate the opportunities and power as well as limitations of hyperpolarisation in diamond via NV centres. We expect that the current work may have a significant impact on future applications.
△ Less
Submitted 27 March, 2017;
originally announced March 2017.
-
Temperature dependent creation of nitrogen-vacancy centers in CVD diamond layers
Authors:
A. Tallaire,
M. Lesik,
V. Jacques,
S. Pezzagna,
V. Mille,
O. Brinza,
J. Meijer,
B. Abel,
J. -F. Roch,
A. Gicquel,
J. Achard
Abstract:
In this work, we explore the ability of plasma assisted chemical vapor deposition (PACVD) operating under high power densities to produce thin high-quality diamond layers with a controlled do** with negatively-charged nitrogen-vacancy (NV-) centers. This luminescent defect possesses specific physical characteristics that make it suitable as an addressable solid-state electron spin for measuring…
▽ More
In this work, we explore the ability of plasma assisted chemical vapor deposition (PACVD) operating under high power densities to produce thin high-quality diamond layers with a controlled do** with negatively-charged nitrogen-vacancy (NV-) centers. This luminescent defect possesses specific physical characteristics that make it suitable as an addressable solid-state electron spin for measuring magnetic fields with unprecedented sensitivity. To this aim, a relatively large number of NV- centers (> 10^12 cm^-3) should ideally be located in a thin diamond layer (a few tens of nm) close to the surface which is particularly challenging to achieve with the PACVD technique. Here we show that intentional temperature variations can be exploited to tune NV- creation efficiency during growth, allowing engineering complex stacking structures with a variable do**. Because such a temperature variation can be performed quickly and without any change of the gas phase composition, thin layers can be grown. Measurements show that despite the temperature variations, the luminescent centers incorporated using this technique exhibit spin coherence properties similar to those reached in ultra-pure bulk crystals, which suggests that they could be successfully employed in magnetometry applications.
△ Less
Submitted 6 October, 2014; v1 submitted 29 September, 2014;
originally announced September 2014.
-
Recent progress in open quantum systems: Non-Gaussian noise and decoherence in fermionic systems
Authors:
Clemens Neuenhahn,
B. Kubala,
B. Abel,
Florian Marquardt
Abstract:
We review our recent contributions to two topics that have become of interest in the field of open, dissipative quantum systems: non-Gaussian noise and decoherence in fermionic systems. Decoherence by non-Gaussian noise, i.e. by an environment that cannot be approximated as a bath of harmonic oscillators, is important in nanostructures (e.g. qubits) where there might be strong coupling to a smal…
▽ More
We review our recent contributions to two topics that have become of interest in the field of open, dissipative quantum systems: non-Gaussian noise and decoherence in fermionic systems. Decoherence by non-Gaussian noise, i.e. by an environment that cannot be approximated as a bath of harmonic oscillators, is important in nanostructures (e.g. qubits) where there might be strong coupling to a small number of fluctuators. We first revisit the pedagogical example of dephasing by classical telegraph noise. Then we address two models where the quantum nature of the noise becomes essential: "quantum telegraph noise" and dephasing by electronic shot noise. In fermionic systems, many-body aspects and the Pauli principle have to be taken care of when describing the loss of phase coherence. This is relevant in electronic quantum transport through metallic and semiconducting structures. Specifically, we recount our recent results regarding dephasing in a chiral interacting electron liquid, as it is realized in the electronic Mach-Zehnder interferometer. This model can be solved employing the technique of bosonization as well as a physically transparent semiclassical method.
△ Less
Submitted 25 September, 2008;
originally announced September 2008.
-
LSST: from Science Drivers to Reference Design and Anticipated Data Products
Authors:
Željko Ivezić,
Steven M. Kahn,
J. Anthony Tyson,
Bob Abel,
Emily Acosta,
Robyn Allsman,
David Alonso,
Yusra AlSayyad,
Scott F. Anderson,
John Andrew,
James Roger P. Angel,
George Z. Angeli,
Reza Ansari,
Pierre Antilogus,
Constanza Araujo,
Robert Armstrong,
Kirk T. Arndt,
Pierre Astier,
Éric Aubourg,
Nicole Auza,
Tim S. Axelrod,
Deborah J. Bard,
Jeff D. Barr,
Aurelian Barrau,
James G. Bartlett
, et al. (288 additional authors not shown)
Abstract:
(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the…
▽ More
(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and map** the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pachón in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$σ$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $δ<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.
△ Less
Submitted 23 May, 2018; v1 submitted 15 May, 2008;
originally announced May 2008.
-
Decoherence by Quantum Telegraph Noise
Authors:
Benjamin Abel,
Florian Marquardt
Abstract:
We investigate the time-evolution of a charge qubit subject to quantum telegraph noise produced by a single electronic defect level. We obtain results for the time-evolution of the coherence that are strikingly different from the usual case of a harmonic oscillator bath (Gaussian noise). When the coupling strength crosses a certain temperature-dependent threshold, we observe coherence oscillatio…
▽ More
We investigate the time-evolution of a charge qubit subject to quantum telegraph noise produced by a single electronic defect level. We obtain results for the time-evolution of the coherence that are strikingly different from the usual case of a harmonic oscillator bath (Gaussian noise). When the coupling strength crosses a certain temperature-dependent threshold, we observe coherence oscillations in the strong-coupling regime. Moreover, we present the time-evolution of the echo signal in a spin-echo experiment. Our analysis relies on a numerical evaluation of the exact solution for the density matrix of the qubit.
△ Less
Submitted 25 June, 2008; v1 submitted 7 May, 2008;
originally announced May 2008.
-
Measuring the size of a Schroedinger cat state
Authors:
Florian Marquardt,
Benjamin Abel,
Jan von Delft
Abstract:
We propose a measure for the "size" of a Schroedinger cat state, i.e. a quantum superposition of two many-body states with (supposedly) macroscopically distinct properties, by counting how many single-particle operations are needed to map one state onto the other. This definition gives sensible results for simple, analytically tractable cases and is consistent with a previous definition restrict…
▽ More
We propose a measure for the "size" of a Schroedinger cat state, i.e. a quantum superposition of two many-body states with (supposedly) macroscopically distinct properties, by counting how many single-particle operations are needed to map one state onto the other. This definition gives sensible results for simple, analytically tractable cases and is consistent with a previous definition restricted to Greenberger-Horne-Zeilinger-like states. We apply our measure to the experimentally relevant, nontrivial example of a superconducting three-junction flux qubit put into a superposition of left- and right-circulating supercurrent states and find this Schroedinger cat to be surprisingly small.
△ Less
Submitted 1 September, 2006;
originally announced September 2006.
