Showing 1–28 of 28 results for author: Wirtz, T

Roadmap for focused ion beam technologies

Authors: Katja Höflich, Gerhard Hobler, Frances I. Allen, Tom Wirtz, Gemma Rius, Lisa McElwee-White, Arkady V. Krasheninnikov, Matthias Schmidt, Ivo Utke, Nico Klingner, Markus Osenberg, Rosa Córdoba, Flyura Djurabekova, Ingo Manke, Philip Moll, Mariachiara Manoccio, José Marıa De Teresa, Lothar Bischoff, Johann Michler, Olivier De Castro, Anne Delobbe, Peter Dunne, Oleksandr V. Dobrovolskiy, Natalie Frese, Armin Gölzhäuser , et al. (7 additional authors not shown)

Abstract: The focused ion beam (FIB) is a powerful tool for the fabrication, modification and characterization of materials down to the nanoscale. Starting with the gallium FIB, which was originally intended for photomask repair in the semiconductor industry, there are now many different types of FIB that are commercially available. These instruments use a range of ion species and are applied broadly in mat… ▽ More The focused ion beam (FIB) is a powerful tool for the fabrication, modification and characterization of materials down to the nanoscale. Starting with the gallium FIB, which was originally intended for photomask repair in the semiconductor industry, there are now many different types of FIB that are commercially available. These instruments use a range of ion species and are applied broadly in materials science, physics, chemistry, biology, medicine, and even archaeology. The goal of this roadmap is to provide an overview of FIB instrumentation, theory, techniques and applications. By viewing FIB developments through the lens of the various research communities, we aim to identify future pathways for ion source and instrumentation development as well as emerging applications, and the scope for improved understanding of the complex interplay of ion-solid interactions. We intend to provide a guide for all scientists in the field that identifies common research interests and will support future fruitful interactions connecting tool development, experiment and theory. While a comprehensive overview of the field is sought, it is not possible to cover all research related to FIB technologies in detail. We give examples of specific projects within the broader context, referencing original works and previous review articles throughout. △ Less

Submitted 6 October, 2023; v1 submitted 31 May, 2023; originally announced May 2023.

Comments: This publication is based upon work from the COST Action FIT4NANO CA19140, supported by COST (European Cooperation in Science and Technology) https://www.cost.eu/. Financial support from COST Action CA19140 is acknowledged http://www.fit4nano.eu/ Version 3 has many text and language edits as well as layout tuning but no substantial new content

Multi-Agent Neural Rewriter for Vehicle Routing with Limited Disclosure of Costs

Authors: Nathalie Paul, Tim Wirtz, Stefan Wrobel, Alexander Kister

Abstract: We interpret solving the multi-vehicle routing problem as a team Markov game with partially observable costs. For a given set of customers to serve, the playing agents (vehicles) have the common goal to determine the team-optimal agent routes with minimal total cost. Each agent thereby observes only its own cost. Our multi-agent reinforcement learning approach, the so-called multi-agent Neural Rew… ▽ More We interpret solving the multi-vehicle routing problem as a team Markov game with partially observable costs. For a given set of customers to serve, the playing agents (vehicles) have the common goal to determine the team-optimal agent routes with minimal total cost. Each agent thereby observes only its own cost. Our multi-agent reinforcement learning approach, the so-called multi-agent Neural Rewriter, builds on the single-agent Neural Rewriter to solve the problem by iteratively rewriting solutions. Parallel agent action execution and partial observability require new rewriting rules for the game. We propose the introduction of a so-called pool in the system which serves as a collection point for unvisited nodes. It enables agents to act simultaneously and exchange nodes in a conflict-free manner. We realize limited disclosure of agent-specific costs by only sharing them during learning. During inference, each agents acts decentrally, solely based on its own cost. First empirical results on small problem sizes demonstrate that we reach a performance close to the employed OR-Tools benchmark which operates in the perfect cost information setting. △ Less

Submitted 13 June, 2022; originally announced June 2022.

Tailored Uncertainty Estimation for Deep Learning Systems

Authors: Joachim Sicking, Maram Akila, Jan David Schneider, Fabian Hüger, Peter Schlicht, Tim Wirtz, Stefan Wrobel

Abstract: Uncertainty estimation bears the potential to make deep learning (DL) systems more reliable. Standard techniques for uncertainty estimation, however, come along with specific combinations of strengths and weaknesses, e.g., with respect to estimation quality, generalization abilities and computational complexity. To actually harness the potential of uncertainty quantification, estimators are requir… ▽ More Uncertainty estimation bears the potential to make deep learning (DL) systems more reliable. Standard techniques for uncertainty estimation, however, come along with specific combinations of strengths and weaknesses, e.g., with respect to estimation quality, generalization abilities and computational complexity. To actually harness the potential of uncertainty quantification, estimators are required whose properties closely match the requirements of a given use case. In this work, we propose a framework that, firstly, structures and shapes these requirements, secondly, guides the selection of a suitable uncertainty estimation method and, thirdly, provides strategies to validate this choice and to uncover structural weaknesses. By contributing tailored uncertainty estimation in this sense, our framework helps to foster trustworthy DL systems. Moreover, it anticipates prospective machine learning regulations that require, e.g., in the EU, evidences for the technical appropriateness of machine learning systems. Our framework provides such evidences for system components modeling uncertainty. △ Less

Submitted 29 April, 2022; originally announced April 2022.

Validation of Simulation-Based Testing: Bypassing Domain Shift with Label-to-Image Synthesis

Authors: Julia Rosenzweig, Eduardo Brito, Hans-Ulrich Kobialka, Maram Akila, Nico M. Schmidt, Peter Schlicht, Jan David Schneider, Fabian Hüger, Matthias Rottmann, Sebastian Houben, Tim Wirtz

Abstract: Many machine learning applications can benefit from simulated data for systematic validation - in particular if real-life data is difficult to obtain or annotate. However, since simulations are prone to domain shift w.r.t. real-life data, it is crucial to verify the transferability of the obtained results. We propose a novel framework consisting of a generative label-to-image synthesis model toget… ▽ More Many machine learning applications can benefit from simulated data for systematic validation - in particular if real-life data is difficult to obtain or annotate. However, since simulations are prone to domain shift w.r.t. real-life data, it is crucial to verify the transferability of the obtained results. We propose a novel framework consisting of a generative label-to-image synthesis model together with different transferability measures to inspect to what extent we can transfer testing results of semantic segmentation models from synthetic data to equivalent real-life data. With slight modifications, our approach is extendable to, e.g., general multi-class classification tasks. Grounded on the transferability analysis, our approach additionally allows for extensive testing by incorporating controlled simulations. We validate our approach empirically on a semantic segmentation task on driving scenes. Transferability is tested using correlation analysis of IoU and a learned discriminator. Although the latter can distinguish between real-life and synthetic tests, in the former we observe surprisingly strong correlations of 0.7 for both cars and pedestrians. △ Less

Submitted 10 June, 2021; originally announced June 2021.

Comments: The first two authors contributed equally. Accepted at the 4th Workshop on "Ensuring and Validating Safety for Automated Vehicles" (WS13), IV2021. Under IEEE Copyright

Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safety

Authors: Sebastian Houben, Stephanie Abrecht, Maram Akila, Andreas Bär, Felix Brockherde, Patrick Feifel, Tim Fingscheidt, Sujan Sai Gannamaneni, Seyed Eghbal Ghobadi, Ahmed Hammam, Anselm Haselhoff, Felix Hauser, Christian Heinzemann, Marco Hoffmann, Nikhil Kapoor, Falk Kappel, Marvin Klingner, Jan Kronenberger, Fabian Küppers, Jonas Löhdefink, Michael Mlynarski, Michael Mock, Firas Mualla, Svetlana Pavlitskaya, Maximilian Poretschkin , et al. (16 additional authors not shown)

Abstract: The use of deep neural networks (DNNs) in safety-critical applications like mobile health and autonomous driving is challenging due to numerous model-inherent shortcomings. These shortcomings are diverse and range from a lack of generalization over insufficient interpretability to problems with malicious inputs. Cyber-physical systems employing DNNs are therefore likely to suffer from safety conce… ▽ More The use of deep neural networks (DNNs) in safety-critical applications like mobile health and autonomous driving is challenging due to numerous model-inherent shortcomings. These shortcomings are diverse and range from a lack of generalization over insufficient interpretability to problems with malicious inputs. Cyber-physical systems employing DNNs are therefore likely to suffer from safety concerns. In recent years, a zoo of state-of-the-art techniques aiming to address these safety concerns has emerged. This work provides a structured and broad overview of them. We first identify categories of insufficiencies to then describe research activities aiming at their detection, quantification, or mitigation. Our paper addresses both machine learning experts and safety engineers: The former ones might profit from the broad range of machine learning topics covered and discussions on limitations of recent methods. The latter ones might gain insights into the specifics of modern ML methods. We moreover hope that our contribution fuels discussions on desiderata for ML systems and strategies on how to propel existing approaches accordingly. △ Less

Submitted 29 April, 2021; originally announced April 2021.

Comments: 94 pages

Journal ref: Fingscheidt, T., Gottschalk, H., Houben, S. (eds) Deep Neural Networks and Data for Automated Driving, Springer, Cham (2022)

Plants Don't Walk on the Street: Common-Sense Reasoning for Reliable Semantic Segmentation

Authors: Linara Adilova, Elena Schulz, Maram Akila, Sebastian Houben, Jan David Schneider, Fabian Hueger, Tim Wirtz

Abstract: Data-driven sensor interpretation in autonomous driving can lead to highly implausible predictions as can most of the time be verified with common-sense knowledge. However, learning common knowledge only from data is hard and approaches for knowledge integration are an active research area. We propose to use a partly human-designed, partly learned set of rules to describe relations between objects… ▽ More Data-driven sensor interpretation in autonomous driving can lead to highly implausible predictions as can most of the time be verified with common-sense knowledge. However, learning common knowledge only from data is hard and approaches for knowledge integration are an active research area. We propose to use a partly human-designed, partly learned set of rules to describe relations between objects of a traffic scene on a high level of abstraction. In doing so, we improve and robustify existing deep neural networks consuming low-level sensor information. We present an initial study adapting the well-established Probabilistic Soft Logic (PSL) framework to validate and improve on the problem of semantic segmentation. We describe in detail how we integrate common knowledge into the segmentation pipeline using PSL and verify our approach in a set of experiments demonstrating the increase in robustness against several severe image distortions applied to the A2D2 autonomous driving data set. △ Less

Submitted 19 April, 2021; originally announced April 2021.

Comments: Published at SAIAD (Safe Artificial Intelligence for Automated Driving) workshop at CVPR2021

Street-Map Based Validation of Semantic Segmentation in Autonomous Driving

Authors: Laura von Rueden, Tim Wirtz, Fabian Hueger, Jan David Schneider, Nico Piatkowski, Christian Bauckhage

Abstract: Artificial intelligence for autonomous driving must meet strict requirements on safety and robustness, which motivates the thorough validation of learned models. However, current validation approaches mostly require ground truth data and are thus both cost-intensive and limited in their applicability. We propose to overcome these limitations by a model agnostic validation using a-priori knowledge… ▽ More Artificial intelligence for autonomous driving must meet strict requirements on safety and robustness, which motivates the thorough validation of learned models. However, current validation approaches mostly require ground truth data and are thus both cost-intensive and limited in their applicability. We propose to overcome these limitations by a model agnostic validation using a-priori knowledge from street maps. In particular, we show how to validate semantic segmentation masks and demonstrate the potential of our approach using OpenStreetMap. We introduce validation metrics that indicate false positive or negative road segments. Besides the validation approach, we present a method to correct the vehicle's GPS position so that a more accurate localization can be used for the street-map based validation. Lastly, we present quantitative results on the Cityscapes dataset indicating that our validation approach can indeed uncover errors in semantic segmentation masks. △ Less

Submitted 15 April, 2021; originally announced April 2021.

Comments: Final version accepted at the International Conference on Pattern Recognition (ICPR). arXiv admin note: substantial text overlap with arXiv:2011.08008

Supporting verification of news articles with automated search for semantically similar articles

Authors: Vishwani Gupta, Katharina Beckh, Sven Giesselbach, Dennis Wegener, Tim Wirtz

Abstract: Fake information poses one of the major threats for society in the 21st century. Identifying misinformation has become a key challenge due to the amount of fake news that is published daily. Yet, no approach is established that addresses the dynamics and versatility of fake news editorials. Instead of classifying content, we propose an evidence retrieval approach to handle fake news. The learning… ▽ More Fake information poses one of the major threats for society in the 21st century. Identifying misinformation has become a key challenge due to the amount of fake news that is published daily. Yet, no approach is established that addresses the dynamics and versatility of fake news editorials. Instead of classifying content, we propose an evidence retrieval approach to handle fake news. The learning task is formulated as an unsupervised machine learning problem. For validation purpose, we provide the user with a set of news articles from reliable news sources supporting the hypothesis of the news article in query and the final decision is left to the user. Technically we propose a two-step process: (i) Aggregation-step: With information extracted from the given text we query for similar content from reliable news sources. (ii) Refining-step: We narrow the supporting evidence down by measuring the semantic distance of the text with the collection from step (i). The distance is calculated based on Word2Vec and the Word Mover's Distance. In our experiments, only content that is below a certain distance threshold is considered as supporting evidence. We find that our approach is agnostic to concept drifts, i.e. the machine learning task is independent of the hypotheses in a text. This makes it highly adaptable in times where fake news is as diverse as classical news is. Our pipeline offers the possibility for further analysis in the future, such as investigating bias and differences in news reporting. △ Less

Submitted 29 March, 2021; originally announced March 2021.

Patterning enhanced tetragonality in BiFeO3 thin films with effective negative pressure by helium implantation

Authors: C. Toulouse, J. Fischer, S. Farokhipoor, L. Yedra, F. Carla, A. Jarnac, E. Elkaim, P. Fertey, J. -N. Audinot, T. Wirtz, B. Noheda, V. Garcia, S. Fusil, I. Peral Alonso, M. Guennou, J. Kreisel

Abstract: Helium implantation in epitaxial thin films is a way to control the out-of-plane deformation independently from the in-plane strain controlled by epitaxy. In particular, implantation by means of a helium microscope allows for local implantation and patterning down to the nanometer resolution, which is of interest for device applications. We present here a study of bismuth ferrite (BiFeO3) films wh… ▽ More Helium implantation in epitaxial thin films is a way to control the out-of-plane deformation independently from the in-plane strain controlled by epitaxy. In particular, implantation by means of a helium microscope allows for local implantation and patterning down to the nanometer resolution, which is of interest for device applications. We present here a study of bismuth ferrite (BiFeO3) films where strain was patterned locally by helium implantation. Our combined Raman, XRD and TEM study shows that the implantation causes an elongation of the BiFeO3 unit cell and ultimately a transition towards the so-called super-tetragonal polymorph via states with mixed phases. In addition, TEM reveals the onset of amorphization at a threshold dose that does not seem to impede the overall increase in tetragonality. The phase transition from the R-like to T-like BiFeO3 appears as first-order in character, with regions of phase coexistence and abrupt changes in lattice parameters. △ Less

Submitted 15 February, 2021; originally announced February 2021.

Journal ref: Physical Review Materials, 5, 024404, 2021

Approaching Neural Network Uncertainty Realism

Authors: Joachim Sicking, Alexander Kister, Matthias Fahrland, Stefan Eickeler, Fabian Hüger, Stefan Rü**, Peter Schlicht, Tim Wirtz

Abstract: Statistical models are inherently uncertain. Quantifying or at least upper-bounding their uncertainties is vital for safety-critical systems such as autonomous vehicles. While standard neural networks do not report this information, several approaches exist to integrate uncertainty estimates into them. Assessing the quality of these uncertainty estimates is not straightforward, as no direct ground… ▽ More Statistical models are inherently uncertain. Quantifying or at least upper-bounding their uncertainties is vital for safety-critical systems such as autonomous vehicles. While standard neural networks do not report this information, several approaches exist to integrate uncertainty estimates into them. Assessing the quality of these uncertainty estimates is not straightforward, as no direct ground truth labels are available. Instead, implicit statistical assessments are required. For regression, we propose to evaluate uncertainty realism -- a strict quality criterion -- with a Mahalanobis distance-based statistical test. An empirical evaluation reveals the need for uncertainty measures that are appropriate to upper-bound heavy-tailed empirical errors. Alongside, we transfer the variational U-Net classification architecture to standard supervised image-to-image tasks. We adopt it to the automotive domain and show that it significantly improves uncertainty realism compared to a plain encoder-decoder model. △ Less

Submitted 8 January, 2021; originally announced January 2021.

Comments: Accepted at the NeurIPS 2019 Workshop on Machine Learning for Autonomous Driving (ML4AD)

A Novel Regression Loss for Non-Parametric Uncertainty Optimization

Authors: Joachim Sicking, Maram Akila, Maximilian Pintz, Tim Wirtz, Asja Fischer, Stefan Wrobel

Abstract: Quantification of uncertainty is one of the most promising approaches to establish safe machine learning. Despite its importance, it is far from being generally solved, especially for neural networks. One of the most commonly used approaches so far is Monte Carlo dropout, which is computationally cheap and easy to apply in practice. However, it can underestimate the uncertainty. We propose a new o… ▽ More Quantification of uncertainty is one of the most promising approaches to establish safe machine learning. Despite its importance, it is far from being generally solved, especially for neural networks. One of the most commonly used approaches so far is Monte Carlo dropout, which is computationally cheap and easy to apply in practice. However, it can underestimate the uncertainty. We propose a new objective, referred to as second-moment loss (SML), to address this issue. While the full network is encouraged to model the mean, the dropout networks are explicitly used to optimize the model variance. We intensively study the performance of the new objective on various UCI regression datasets. Comparing to the state-of-the-art of deep ensembles, SML leads to comparable prediction accuracies and uncertainty estimates while only requiring a single model. Under distribution shift, we observe moderate improvements. As a side result, we introduce an intuitive Wasserstein distance-based uncertainty measure that is non-saturating and thus allows to resolve quality differences between any two uncertainty estimates. △ Less

Submitted 7 January, 2021; originally announced January 2021.

Comments: Accepted at the 3rd Symposium on Advances in Approximate Bayesian Inference (AABI), code is available on: https://github.com/fraunhofer-iais/second-moment-loss. arXiv admin note: substantial text overlap with arXiv:2012.12687

Wasserstein Dropout

Authors: Joachim Sicking, Maram Akila, Maximilian Pintz, Tim Wirtz, Asja Fischer, Stefan Wrobel

Abstract: Despite of its importance for safe machine learning, uncertainty quantification for neural networks is far from being solved. State-of-the-art approaches to estimate neural uncertainties are often hybrid, combining parametric models with explicit or implicit (dropout-based) ensembling. We take another pathway and propose a novel approach to uncertainty quantification for regression tasks, Wasserst… ▽ More Despite of its importance for safe machine learning, uncertainty quantification for neural networks is far from being solved. State-of-the-art approaches to estimate neural uncertainties are often hybrid, combining parametric models with explicit or implicit (dropout-based) ensembling. We take another pathway and propose a novel approach to uncertainty quantification for regression tasks, Wasserstein dropout, that is purely non-parametric. Technically, it captures aleatoric uncertainty by means of dropout-based sub-network distributions. This is accomplished by a new objective which minimizes the Wasserstein distance between the label distribution and the model distribution. An extensive empirical analysis shows that Wasserstein dropout outperforms state-of-the-art methods, on vanilla test data as well as under distributional shift, in terms of producing more accurate and stable uncertainty estimates. △ Less

Submitted 2 December, 2021; v1 submitted 23 December, 2020; originally announced December 2020.

DenseHMM: Learning Hidden Markov Models by Learning Dense Representations

Authors: Joachim Sicking, Maximilian Pintz, Maram Akila, Tim Wirtz

Abstract: We propose DenseHMM - a modification of Hidden Markov Models (HMMs) that allows to learn dense representations of both the hidden states and the observables. Compared to the standard HMM, transition probabilities are not atomic but composed of these representations via kernelization. Our approach enables constraint-free and gradient-based optimization. We propose two optimization schemes that make… ▽ More We propose DenseHMM - a modification of Hidden Markov Models (HMMs) that allows to learn dense representations of both the hidden states and the observables. Compared to the standard HMM, transition probabilities are not atomic but composed of these representations via kernelization. Our approach enables constraint-free and gradient-based optimization. We propose two optimization schemes that make use of this: a modification of the Baum-Welch algorithm and a direct co-occurrence optimization. The latter one is highly scalable and comes empirically without loss of performance compared to standard HMMs. We show that the non-linearity of the kernelization is crucial for the expressiveness of the representations. The properties of the DenseHMM like learned co-occurrences and log-likelihoods are studied empirically on synthetic and biomedical datasets. △ Less

Submitted 17 December, 2020; originally announced December 2020.

Comments: Accepted at LMRL workshop at NeurIPS 2020. Code is available on: https://github.com/fraunhofer-iais/dense-hmm

Synthetic Image Rendering Solves Annotation Problem in Deep Learning Nanoparticle Segmentation

Authors: Leonid Mill, David Wolff, Nele Gerrits, Patrick Philipp, Lasse Kling, Florian Vollnhals, Andrew Ignatenko, Christian Jaremenko, Yixing Huang, Olivier De Castro, Jean-Nicolas Audinot, Inge Nelissen, Tom Wirtz, Andreas Maier, Silke Christiansen

Abstract: Nanoparticles occur in various environments as a consequence of man-made processes, which raises concerns about their impact on the environment and human health. To allow for proper risk assessment, a precise and statistically relevant analysis of particle characteristics (such as e.g. size, shape and composition) is required that would greatly benefit from automated image analysis procedures. Whi… ▽ More Nanoparticles occur in various environments as a consequence of man-made processes, which raises concerns about their impact on the environment and human health. To allow for proper risk assessment, a precise and statistically relevant analysis of particle characteristics (such as e.g. size, shape and composition) is required that would greatly benefit from automated image analysis procedures. While deep learning shows impressive results in object detection tasks, its applicability is limited by the amount of representative, experimentally collected and manually annotated training data. Here, we present an elegant, flexible and versatile method to bypass this costly and tedious data acquisition process. We show that using a rendering software allows to generate realistic, synthetic training data to train a state-of-the art deep neural network. Using this approach, we derive a segmentation accuracy that is comparable to man-made annotations for toxicologically relevant metal-oxide nanoparticle ensembles which we chose as examples. Our study paves the way towards the use of deep learning for automated, high-throughput particle detection in a variety of imaging techniques such as microscopies and spectroscopies, for a wide variety of studies and applications, including the detection of plastic micro- and nanoparticles. △ Less

Submitted 20 November, 2020; originally announced November 2020.

Towards Map-Based Validation of Semantic Segmentation Masks

Authors: Laura von Rueden, Tim Wirtz, Fabian Hueger, Jan David Schneider, Christian Bauckhage

Abstract: Artificial intelligence for autonomous driving must meet strict requirements on safety and robustness. We propose to validate machine learning models for self-driving vehicles not only with given ground truth labels, but also with additional a-priori knowledge. In particular, we suggest to validate the drivable area in semantic segmentation masks using given street map data. We present first resul… ▽ More Artificial intelligence for autonomous driving must meet strict requirements on safety and robustness. We propose to validate machine learning models for self-driving vehicles not only with given ground truth labels, but also with additional a-priori knowledge. In particular, we suggest to validate the drivable area in semantic segmentation masks using given street map data. We present first results, which indicate that prediction errors can be uncovered by map-based validation. △ Less

Submitted 26 November, 2020; v1 submitted 3 November, 2020; originally announced November 2020.

Characteristics of Monte Carlo Dropout in Wide Neural Networks

Authors: Joachim Sicking, Maram Akila, Tim Wirtz, Sebastian Houben, Asja Fischer

Abstract: Monte Carlo (MC) dropout is one of the state-of-the-art approaches for uncertainty estimation in neural networks (NNs). It has been interpreted as approximately performing Bayesian inference. Based on previous work on the approximation of Gaussian processes by wide and deep neural networks with random weights, we study the limiting distribution of wide untrained NNs under dropout more rigorously a… ▽ More Monte Carlo (MC) dropout is one of the state-of-the-art approaches for uncertainty estimation in neural networks (NNs). It has been interpreted as approximately performing Bayesian inference. Based on previous work on the approximation of Gaussian processes by wide and deep neural networks with random weights, we study the limiting distribution of wide untrained NNs under dropout more rigorously and prove that they as well converge to Gaussian processes for fixed sets of weights and biases. We sketch an argument that this property might also hold for infinitely wide feed-forward networks that are trained with (full-batch) gradient descent. The theory is contrasted by an empirical analysis in which we find correlations and non-Gaussian behaviour for the pre-activations of finite width NNs. We therefore investigate how (strongly) correlated pre-activations can induce non-Gaussian behavior in NNs with strongly correlated weights. △ Less

Submitted 10 July, 2020; originally announced July 2020.

Comments: Accepted at the ICML 2020 workshop for Uncertainty and Robustness in Deep Learning

Analysis of hydrogen distribution and migration in fired passivating contacts (FPC)

Authors: Mario Lehmann, Nathalie Valle, Jörg Horzel, Alisa Pshenova, Philippe Wyss, Max Döbeli, Matthieu Despeisse, Santhana Eswara, Tom Wirtz, Quentin Jeangros, Aïcha Hessler-Wyser, Franz-Josef Haug, Andrea Ingenito, Christophe Ballif

Abstract: In this work, the hydrogenation mechanism of fired passivating contacts (FPC) based on c-Si/SiO$_{x}$/nc-SiC$_{x}$(p) stacks was investigated, by correlating the passivation and local re-distribution of hydrogen. Secondary ion mass spectroscopy (SIMS) depth profiling was used to assess the hydrogen (/deuterium) content. The SIMS profiles show that hydrogen almost completely effuses out of the SiC… ▽ More In this work, the hydrogenation mechanism of fired passivating contacts (FPC) based on c-Si/SiO$_{x}$/nc-SiC$_{x}$(p) stacks was investigated, by correlating the passivation and local re-distribution of hydrogen. Secondary ion mass spectroscopy (SIMS) depth profiling was used to assess the hydrogen (/deuterium) content. The SIMS profiles show that hydrogen almost completely effuses out of the SiC$_{x}$(p) during firing, but can be re-introduced by hydrogenation via forming gas anneal (FGA) or by release from a hydrogen containing layer such as SiN$_{x}$:H. A pile-up of H at the c-Si/SiO$_{x}$ interface was observed and identified as a key element in the FPC's passivation mechanism. Moreover, the samples hydrogenated with SiN$_{x}$:H exhibited higher H content compared to those treated by FGA, resulting in higher iV$_{OC}$ values. Further investigations revealed that the do** of the SiC$_{x}$ layer does not affect the amount of interfacial defects passivated by the hydrogenation process presented in this work. Eventually, an effect of the oxide's nature on passivation quality is evidenced. iV$_{OC}$ values of up to 706 mV and 720 mV were reached with FPC test structures using chemical and UV-O$_{3}$ tunneling oxides, respectively, and up to 739 mV using a reference passivation sample featuring a ~25 nm thick thermal oxide. △ Less

Submitted 30 July, 2019; originally announced July 2019.

Comments: 13 pages, 5 figures

Journal ref: Sol. Energy Mater. Sol. Cells. 200 (2019) 110018

ASIME 2018 White Paper. In-Space Utilisation of Asteroids: Asteroid Composition -- Answers to Questions from the Asteroid Miners

Authors: Amara L. Graps, Angel Abbud-Madrid, Paul Abell, Antonella Barucci, Pierre Beck, Lydie Bonal, Grant Bonin, Øystein Risan Borgersen, Daniel Britt, Humberto Campins, Kevin Cannon, Ian Carnelli, Benoît Carry, Ian Crawford, Julia de Leon, Line Drube, Kerri Donaldson-Hanna, Martin Elvis, Alan Fitzsimmons, JL Galache, Simon F. Green, Jan Thimo Grundmann, Alan Herique, Daniel Hestroffer, Henry Hsieh , et al. (19 additional authors not shown)

Abstract: In kee** with the Luxembourg government's initiative to support the future use of space resources, ASIME 2018 was held in Belval, Luxembourg on April 16-17, 2018. The goal of ASIME 2018: Asteroid Intersections with Mine Engineering, was to focus on asteroid composition for advancing the asteroid in-space resource utilisation domain. What do we know about asteroid composition from remote-sensin… ▽ More In kee** with the Luxembourg government's initiative to support the future use of space resources, ASIME 2018 was held in Belval, Luxembourg on April 16-17, 2018. The goal of ASIME 2018: Asteroid Intersections with Mine Engineering, was to focus on asteroid composition for advancing the asteroid in-space resource utilisation domain. What do we know about asteroid composition from remote-sensing observations? What are the potential caveats in the interpretation of Earth-based spectral observations? What are the next steps to improve our knowledge on asteroid composition by means of ground-based and space-based observations and asteroid rendez-vous and sample return missions? How can asteroid mining companies use this knowledge? ASIME 2018 was a two-day workshop of almost 70 scientists and engineers in the context of the engineering needs of space missions with in-space asteroid utilisation. The 21 Questions from the asteroid mining companies were sorted into the four asteroid science themes: 1) Potential Targets, 2) Asteroid-Meteorite Links, 3) In-Situ Measurements and 4) Laboratory Measurements. The Answers to those Questions were provided by the scientists with their conference presentations and collected by A. Graps or edited directly into an open-access collaborative Google document or inserted by A. Graps using additional reference materials. During the ASIME 2018, first day and second day Wrap-Ups, the answers to the questions were discussed further. New readers to the asteroid mining topic may find the Conversation boxes and the Mission Design discussions especially interesting. △ Less

Submitted 25 April, 2019; originally announced April 2019.

Comments: Outcome from the ASIME 2018: Asteroid Intersections with Mine Engineering, Luxembourg. April 16-17, 2018. 65 Pages. arXiv admin note: substantial text overlap with arXiv:1612.00709

Efficient Decentralized Deep Learning by Dynamic Model Averaging

Authors: Michael Kamp, Linara Adilova, Joachim Sicking, Fabian Hüger, Peter Schlicht, Tim Wirtz, Stefan Wrobel

Abstract: We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept drifts. This leads to a reduction of communication by an order of magnitude compared to periodically communicating state-of-the-art approaches. Moreover, we derive a… ▽ More We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept drifts. This leads to a reduction of communication by an order of magnitude compared to periodically communicating state-of-the-art approaches. Moreover, we derive a communication bound that scales well with the hardness of the serialized learning problem. The reduction in communication comes at almost no cost, as the predictive performance remains virtually unchanged. Indeed, the proposed protocol retains loss bounds of periodically averaging schemes. An extensive empirical evaluation validates major improvement of the trade-off between model performance and communication which could be beneficial for numerous decentralized learning applications, such as autonomous driving, or voice recognition and image classification on mobile phones. △ Less

Submitted 13 November, 2018; v1 submitted 9 July, 2018; originally announced July 2018.

The Correlated Jacobi and the Correlated Cauchy-Lorentz ensembles

Authors: Tim Wirtz, Daniel Waltner, Mario Kieburg, Santosh Kumar

Abstract: We calculate the $k$-point generating function of the correlated Jacobi ensemble using supersymmetric methods. We use the result for complex matrices for $k=1$ to derive a closed-form expression for eigenvalue density. For real matrices we obtain the density in terms of a twofold integral that we evaluate numerically. For both expressions we find agreement when comparing with Monte Carlo simulatio… ▽ More We calculate the $k$-point generating function of the correlated Jacobi ensemble using supersymmetric methods. We use the result for complex matrices for $k=1$ to derive a closed-form expression for eigenvalue density. For real matrices we obtain the density in terms of a twofold integral that we evaluate numerically. For both expressions we find agreement when comparing with Monte Carlo simulations. Relations between these quantities for the Jacobi and the Cauchy-Lorentz ensemble are derived. △ Less

Submitted 4 May, 2015; originally announced May 2015.

Comments: 29 pages, 3 figures

Journal ref: J. Stat Phys 162 (2016) 495

Asymptotic Coincidence of the Statistics for Degenerate and Non-Degenerate Correlated Real Wishart Ensembles

Authors: Tim Wirtz, Mario Kieburg, Thomas Guhr

Abstract: The correlated Wishart model provides the standard benchmark when analyzing time series of any kind. Unfortunately, the real case, which is the most relevant one in applications, poses serious challenges for analytical calculations. Often these challenges are due to square root singularities which cannot be handled using common random matrix techniques. We present a new way to tackle this issue. U… ▽ More The correlated Wishart model provides the standard benchmark when analyzing time series of any kind. Unfortunately, the real case, which is the most relevant one in applications, poses serious challenges for analytical calculations. Often these challenges are due to square root singularities which cannot be handled using common random matrix techniques. We present a new way to tackle this issue. Using supersymmetry, we carry out an anlaytical study which we support by numerical simulations. For large but finite matrix dimensions, we show that statistical properties of the fully correlated real Wishart model generically approach those of a correlated real Wishart model with doubled matrix dimensions and doubly degenerate empirical eigenvalues. This holds for the local and global spectral statistics. With Monte Carlo simulations we show that this is even approximately true for small matrix dimensions. We explicitly investigate the $k$-point correlation function as well as the distribution of the largest eigenvalue for which we find a surprisingly compact formula in the doubly degenerate case. Moreover we show that on the local scale the $k$-point correlation function exhibits the sine and the Airy kernel in the bulk and at the soft edges, respectively. We also address the positions and the fluctuations of the possible outliers in the data. △ Less

Submitted 26 April, 2017; v1 submitted 13 April, 2015; originally announced April 2015.

Comments: Drastically extended version compared to the first version. New chapters on the analysis of the local and global spectral statistics including approximations on the position and standard deviation of outliers. New numerical simulations comparing the macroscopic level density and the distributions of the largest and the smallest eigenvalue. 24 pages, 5 figures

MSC Class: 05.45.Tp; 02.50.-r; 02.20.-a

Journal ref: J. Phys. A 50, 235203 (2017)

The Smallest Eigenvalue Distribution in the Real Wishart-Laguerre Ensemble with Even Topology

Authors: Tim Wirtz, Gernot Akemann, Thomas Guhr, Mario Kieburg, René Wegner

Abstract: We consider rectangular random matrices of size $p\times n$ belonging to the real Wishart-Laguerre ensemble also known as the chiral Gaussian orthogonal ensemble. This ensemble appears in many applications like QCD, mesoscopic physics, and time series analysis. We are particularly interested in the distribution of the smallest non-zero eigenvalue and the gap probability to find no eigenvalue in an… ▽ More We consider rectangular random matrices of size $p\times n$ belonging to the real Wishart-Laguerre ensemble also known as the chiral Gaussian orthogonal ensemble. This ensemble appears in many applications like QCD, mesoscopic physics, and time series analysis. We are particularly interested in the distribution of the smallest non-zero eigenvalue and the gap probability to find no eigenvalue in an interval $[0,t]$. While for odd topology $ν=n-p$ explicit closed results are known for finite and infinite matrix size, for even $ν>2$ only recursive expressions in $p$ are available.The smallest eigenvalue distribution as well as the gap probability for general even $ν$ is equivalent to expectation values of characteristic polynomials raised to a half-integer. The computation of such averages is done via a combination of skew-orthogonal polynomials and bosonisation methods. The results are given in terms of Pfaffian determinants both at finite $p$ and in the hard edge scaling limit ($p\to\infty$ and $ν$ fixed) for an arbitrary even topology $ν$. Numerical simulations for the correlated Wishart ensemble illustrate the universality of our results in this particular limit. These simulations point to a validity of the hard edge scaling limit beyond the invariant case. △ Less

Submitted 19 May, 2015; v1 submitted 12 February, 2015; originally announced February 2015.

Comments: 28 pages, 5 figures; minor corrections

Journal ref: J. Phys. A: Math. Theor. 48 (2015) 245202

Eigenvalue Density of the Doubly Correlated Wishart Model: Exact Results

Authors: Daniel Waltner, Tim Wirtz, Thomas Guhr

Abstract: Data sets collected at different times and different observing points can possess correlations at different times $and$ at different positions. The doubly correlated Wishart model takes both into account. We calculate the eigenvalue density of the Wishart correlation matrices using supersymmetry. In the complex case we obtain a new closed form expression which we compare to previous results in the… ▽ More Data sets collected at different times and different observing points can possess correlations at different times $and$ at different positions. The doubly correlated Wishart model takes both into account. We calculate the eigenvalue density of the Wishart correlation matrices using supersymmetry. In the complex case we obtain a new closed form expression which we compare to previous results in the literature. In the more relevant and much more complicated real case we derive an expression for the density in terms of a fourfold integral. Finally, we calculate the density in the limit of large correlation matrices. △ Less

Submitted 9 December, 2014; originally announced December 2014.

Comments: 16 pages, 3 figures

Journal ref: J. Phys. A: Math. Theor. 48 (2015) 175204

Limiting Statistics of the Largest and Smallest Eigenvalues in the Correlated Wishart Model

Authors: Tim Wirtz, Mario Kieburg, Thomas Guhr

Abstract: The correlated Wishart model provides a standard tool for the analysis of correlations in a rich variety of systems. Although much is known for complex correlation matrices, the empirically much more important real case still poses substantial challenges. We put forward a new approach, which maps arbitrary statistical quantities, depending on invariants only, to invariant Hermitian matrix models.… ▽ More The correlated Wishart model provides a standard tool for the analysis of correlations in a rich variety of systems. Although much is known for complex correlation matrices, the empirically much more important real case still poses substantial challenges. We put forward a new approach, which maps arbitrary statistical quantities, depending on invariants only, to invariant Hermitian matrix models. For completeness we also include the quaternion case and deal with all three cases in a unified way. As an important application, we study the statistics of the largest eigenvalue and its limiting distributions in the correlated Wishart model, because they help to estimate the behavior of large complex systems. We show that even for fully correlated Wishart ensembles, the Tracy-Widom distribution can be the limiting distribution of the largest as well as the smallest eigenvalue, provided that a certain scaling of the empirical eigenvalues holds. △ Less

Submitted 23 December, 2014; v1 submitted 17 October, 2014; originally announced October 2014.

Comments: 6 pages, 2 figures, minor corrections

Journal ref: Europhysics Letters 109, 20005 (2015)

Completing the picture for the smallest eigenvalue of real Wishart matrices

Authors: G. Akemann, T. Guhr, M. Kieburg, R. Wegner, T. Wirtz

Abstract: Rectangular real $N \times (N + ν)$ matrices $W$ with a Gaussian distribution appear very frequently in data analysis, condensed matter physics and quantum field theory. A central question concerns the correlations encoded in the spectral statistics of $WW^T$. The extreme eigenvalues of $W W^T$ are of particular interest. We explicitly compute the distribution and the gap probability of the smalle… ▽ More Rectangular real $N \times (N + ν)$ matrices $W$ with a Gaussian distribution appear very frequently in data analysis, condensed matter physics and quantum field theory. A central question concerns the correlations encoded in the spectral statistics of $WW^T$. The extreme eigenvalues of $W W^T$ are of particular interest. We explicitly compute the distribution and the gap probability of the smallest non-zero eigenvalue in this ensemble, both for arbitrary fixed $N$ and $ν$, and in the universal large $N$ limit with $ν$ fixed. We uncover an integrable Pfaffian structure valid for all even values of $ν\geq 0$. This extends previous results for odd $ν$ at infinite $N$ and recursive results for finite $N$ and for all $ν$. Our mathematical results include the computation of expectation values of half integer powers of characteristic polynomials. △ Less

Submitted 9 March, 2015; v1 submitted 1 September, 2014; originally announced September 2014.

Comments: 5 pages, 3 figuers; minor corrections; three typos corrected in comparison to the published version in PRL

Journal ref: Phys. Rev. Lett. 113, 250201 (2014)

Distribution of the Smallest Eigenvalue in Complex and Real Correlated Wishart Ensembles

Authors: Tim Wirtz, Thomas Guhr

Abstract: For the correlated Gaussian Wishart ensemble we compute the distribution of the smallest eigenvalue and a related gap probability.We obtain exact results for the complex (β=2) and for the real case (β=1). For a particular set of empirical correlation matrices we find universality in the spectral density, for both real and complex ensembles and all kinds of rectangularity. We calculate the asymptot… ▽ More For the correlated Gaussian Wishart ensemble we compute the distribution of the smallest eigenvalue and a related gap probability.We obtain exact results for the complex (β=2) and for the real case (β=1). For a particular set of empirical correlation matrices we find universality in the spectral density, for both real and complex ensembles and all kinds of rectangularity. We calculate the asymptotic and universal results for the gap probability and the distribution of the smallest eigenvalue. We use the Supersymmetry method, in particular the generalized Hubbard-Stratonovich transformation and superbosonization. △ Less

Submitted 11 April, 2014; v1 submitted 9 October, 2013; originally announced October 2013.

Comments: 30 pages, 2 figures, improving pictures, correcting typos

Journal ref: J. Phys. A: Math. Theor. 47 (2014) 075004

Distribution of the Smallest Eigenvalue in the Correlated Wishart Model

Authors: Tim Wirtz, Thomas Guhr

Abstract: Wishart random matrix theory is of major importance for the analysis of correlated time series. The distribution of the smallest eigenvalue for Wishart correlation matrices is particularly interesting in many applications. In the complex and in the real case, we calculate it exactly for arbitrary empirical eigenvalues, i.e., for fully correlated Gaussian Wishart ensembles. To this end, we derive c… ▽ More Wishart random matrix theory is of major importance for the analysis of correlated time series. The distribution of the smallest eigenvalue for Wishart correlation matrices is particularly interesting in many applications. In the complex and in the real case, we calculate it exactly for arbitrary empirical eigenvalues, i.e., for fully correlated Gaussian Wishart ensembles. To this end, we derive certain dualities of matrix models in ordinary space. We thereby completely avoid the otherwise unsurmountable problem of computing a highly non-trivial group integral. Our results are compact and much easier to handle than previous ones. Furthermore, we obtain a new universality for the distribution of the smallest eigenvalue on the proper local scale. △ Less

Submitted 18 October, 2013; v1 submitted 20 June, 2013; originally announced June 2013.

Comments: 5 pages, 1 figure

Journal ref: Phys. Rev. Lett. 111, 094101 (2013)

Worldsheet operator product expansions and p-point functions in AdS3/CFT2

Authors: Ingo Kirsch, Tim Wirtz

Abstract: We construct the operator product expansions (OPE) of the chiral primary operators in the worldsheet theory for strings on AdS_3 x S^3 x T^4. As an interesting application, we will use the worldsheet OPEs to derive a recursion relation for a particular class of extremal p-point correlators on the sphere. We compare our result with the corresponding recursion relation previously found in the symmet… ▽ More We construct the operator product expansions (OPE) of the chiral primary operators in the worldsheet theory for strings on AdS_3 x S^3 x T^4. As an interesting application, we will use the worldsheet OPEs to derive a recursion relation for a particular class of extremal p-point correlators on the sphere. We compare our result with the corresponding recursion relation previously found in the symmetric orbifold theory on the boundary of AdS_3. △ Less

Submitted 14 October, 2011; v1 submitted 29 June, 2011; originally announced June 2011.

Comments: 21 pages, discussion on poles added in section 3, minor corrections

Report number: DESY 11-111

Journal ref: JHEP10(2011)049