Showing 1–50 of 65 results for author: Bayer, J

Real-time detection and control of correlated charge tunneling in a quantum dot

Authors: Johannes C. Bayer, Fredrik Brange, Adrian Schmidt, Timo Wagner, Eddy P. Rugeramigabo, Christian Flindt, Rolf J. Haug

Abstract: The tunneling of interacting charges in nanostructures is a random and noisy process, which gives rise to a variety of intriguing physical phenomena, including Coulomb blockade, the Kondo effect, and Fermi-edge singularities. Such correlation effects are visible in low-frequency measurements of the electric current or the shot noise, however, they are also expected to leave clear fingerprints in t… ▽ More The tunneling of interacting charges in nanostructures is a random and noisy process, which gives rise to a variety of intriguing physical phenomena, including Coulomb blockade, the Kondo effect, and Fermi-edge singularities. Such correlation effects are visible in low-frequency measurements of the electric current or the shot noise, however, they are also expected to leave clear fingerprints in the tunneling times of individual charges. Here, we experimentally demonstrate the real-time detection and control of correlated charge tunneling in a dynamically driven quantum dot. To this end, we measure the joint distribution of waiting times between tunneling charges, and we show that subsequent waiting times are strongly correlated due to the Coulomb interactions between the tunneling charges and the external periodic drive. Our measurements are in excellent agreement with a theoretical model that allows us to develop a detailed understanding of the correlated tunneling events. We also demonstrate that the degree of correlations can be controlled by the external drive. Our experiment paves the way for systematic real-time investigations of correlated electron transport in low-dimensional nanostructures with potential applications in metrology and sensing. △ Less

Submitted 26 May, 2024; originally announced May 2024.

Comments: 7 pages, 5 figures

Social Media Use is Predictable from App Sequences: Using LSTM and Transformer Neural Networks to Model Habitual Behavior

Authors: Heinrich Peters, Joseph B. Bayer, Sandra C. Matz, Yikun Chi, Sumer S. Vaid, Gabriella M. Harari

Abstract: The present paper introduces a novel approach to studying social media habits through predictive modeling of sequential smartphone user behaviors. While much of the literature on media and technology habits has relied on self-report questionnaires and simple behavioral frequency measures, we examine an important yet understudied aspect of media and technology habits: their embeddedness in repetiti… ▽ More The present paper introduces a novel approach to studying social media habits through predictive modeling of sequential smartphone user behaviors. While much of the literature on media and technology habits has relied on self-report questionnaires and simple behavioral frequency measures, we examine an important yet understudied aspect of media and technology habits: their embeddedness in repetitive behavioral sequences. Leveraging Long Short-Term Memory (LSTM) and transformer neural networks, we show that (i) social media use is predictable at the within and between-person level and that (ii) there are robust individual differences in the predictability of social media use. We examine the performance of several modeling approaches, including (i) global models trained on the pooled data from all participants, (ii) idiographic person-specific models, and (iii) global models fine-tuned on person-specific data. Neither person-specific modeling nor fine-tuning on person-specific data substantially outperformed the global models, indicating that the global models were able to represent a variety of idiosyncratic behavioral patterns. Additionally, our analyses reveal that the person-level predictability of social media use is not substantially related to the frequency of smartphone use in general or the frequency of social media use, indicating that our approach captures an aspect of habits that is distinct from behavioral frequency. Implications for habit modeling and theoretical development are discussed. △ Less

Submitted 23 June, 2024; v1 submitted 20 April, 2024; originally announced April 2024.

Modular Graph Extraction for Handwritten Circuit Diagram Images

Authors: Johannes Bayer, Leo van Waveren, Andreas Dengel

Abstract: As digitization in engineering progressed, circuit diagrams (also referred to as schematics) are typically developed and maintained in computer-aided engineering (CAE) systems, thus allowing for automated verification, simulation and further processing in downstream engineering steps. However, apart from printed legacy schematics, hand-drawn circuit diagrams are still used today in the educational… ▽ More As digitization in engineering progressed, circuit diagrams (also referred to as schematics) are typically developed and maintained in computer-aided engineering (CAE) systems, thus allowing for automated verification, simulation and further processing in downstream engineering steps. However, apart from printed legacy schematics, hand-drawn circuit diagrams are still used today in the educational domain, where they serve as an easily accessible mean for trainees and students to learn drawing this type of diagrams. Furthermore, hand-drawn schematics are typically used in examinations due to legal constraints. In order to harness the capabilities of digital circuit representations, automated means for extracting the electrical graph from raster graphics are required. While respective approaches have been proposed in literature, they are typically conducted on small or non-disclosed datasets. This paper describes a modular end-to-end solution on a larger, public dataset, in which approaches for the individual sub-tasks are evaluated to form a new baseline. These sub-tasks include object detection (for electrical symbols and texts), binary segmentation (drafter's stroke vs. background), handwritten character recognition and orientation regression for electrical symbols and texts. Furthermore, computer-vision graph assembly and rectification algorithms are presented. All methods are integrated in a publicly available prototype. △ Less

Submitted 16 February, 2024; originally announced February 2024.

Comments: As submitted to ICDAR24; 11 pages, 9 figures, 1 table

EUSO-SPB1 Mission and Science

Authors: JEM-EUSO Collaboration, :, G. Abdellaoui, S. Abe, J. H. Adams. Jr., D. Allard, G. Alonso, L. Anchordoqui, A. Anzalone, E. Arnone, K. Asano, R. Attallah, H. Attoui, M. Ave Pernas, R. Bachmann, S. Bacholle, M. Bagheri, M. Bakiri, J. Baláz, D. Barghini, S. Bartocci, M. Battisti, J. Bayer, B. Beldjilali, T. Belenguer , et al. (271 additional authors not shown)

Abstract: The Extreme Universe Space Observatory on a Super Pressure Balloon 1 (EUSO-SPB1) was launched in 2017 April from Wanaka, New Zealand. The plan of this mission of opportunity on a NASA super pressure balloon test flight was to circle the southern hemisphere. The primary scientific goal was to make the first observations of ultra-high-energy cosmic-ray extensive air showers (EASs) by looking down on… ▽ More The Extreme Universe Space Observatory on a Super Pressure Balloon 1 (EUSO-SPB1) was launched in 2017 April from Wanaka, New Zealand. The plan of this mission of opportunity on a NASA super pressure balloon test flight was to circle the southern hemisphere. The primary scientific goal was to make the first observations of ultra-high-energy cosmic-ray extensive air showers (EASs) by looking down on the atmosphere with an ultraviolet (UV) fluorescence telescope from suborbital altitude (33~km). After 12~days and 4~hours aloft, the flight was terminated prematurely in the Pacific Ocean. Before the flight, the instrument was tested extensively in the West Desert of Utah, USA, with UV point sources and lasers. The test results indicated that the instrument had sensitivity to EASs of approximately 3 EeV. Simulations of the telescope system, telescope on time, and realized flight trajectory predicted an observation of about 1 event assuming clear sky conditions. The effects of high clouds were estimated to reduce this value by approximately a factor of 2. A manual search and a machine-learning-based search did not find any EAS signals in these data. Here we review the EUSO-SPB1 instrument and flight and the EAS search. △ Less

Submitted 12 January, 2024; originally announced January 2024.

Comments: 18 pages, 19 figures

Journal ref: Astropart Phys 154 (2024) 102891

Developments and results in the context of the JEM-EUSO program obtained with the ESAF Simulation and Analysis Framework

Authors: S. Abe, J. H. Adams Jr., D. Allard, P. Alldredge, L. Anchordoqui, A. Anzalone, E. Arnone, B. Baret, D. Barghini, M. Battisti, J. Bayer, R. Bellotti, A. A. Belov, M. Bertaina, P. F. Bertone, M. Bianciotto, P. L. Biermann, F. Bisconti, C. Blaksley, S. Blin-Bondil, P. Bobik, K. Bolmgren, S. Briz, J. Burton, F. Cafagna , et al. (150 additional authors not shown)

Abstract: JEM--EUSO is an international program for the development of space-based Ultra-High Energy Cosmic Ray observatories. The program consists of a series of missions which are either under development or in the data analysis phase. All instruments are based on a wide-field-of-view telescope, which operates in the near-UV range, designed to detect the fluorescence light emitted by extensive air showers… ▽ More JEM--EUSO is an international program for the development of space-based Ultra-High Energy Cosmic Ray observatories. The program consists of a series of missions which are either under development or in the data analysis phase. All instruments are based on a wide-field-of-view telescope, which operates in the near-UV range, designed to detect the fluorescence light emitted by extensive air showers in the atmosphere. We describe the simulation software ESAFin the framework of the JEM--EUSO program and explain the physical assumptions used. We present here the implementation of the JEM--EUSO, POEMMA, K--EUSO, TUS, Mini--EUSO, EUSO--SPB1 and EUSO--TA configurations in ESAF. For the first time ESAF simulation outputs are compared with experimental data. △ Less

Submitted 21 November, 2023; originally announced November 2023.

Journal ref: Eur. Phys. J. C 83, 1028 (2023)

Utilizing dataset affinity prediction in object detection to assess training data

Authors: Stefan Becker, Jens Bayer, Ronny Hug, Wolfgang Hübner, Michael Arens

Abstract: Data pooling offers various advantages, such as increasing the sample size, improving generalization, reducing sampling bias, and addressing data sparsity and quality, but it is not straightforward and may even be counterproductive. Assessing the effectiveness of pooling datasets in a principled manner is challenging due to the difficulty in estimating the overall information content of individual… ▽ More Data pooling offers various advantages, such as increasing the sample size, improving generalization, reducing sampling bias, and addressing data sparsity and quality, but it is not straightforward and may even be counterproductive. Assessing the effectiveness of pooling datasets in a principled manner is challenging due to the difficulty in estimating the overall information content of individual datasets. Towards this end, we propose incorporating a data source prediction module into standard object detection pipelines. The module runs with minimal overhead during inference time, providing additional information about the data source assigned to individual detections. We show the benefits of the so-called dataset affinity score by automatically selecting samples from a heterogeneous pool of vehicle datasets. The results show that object detectors can be trained on a significantly sparser set of training samples without losing detection accuracy. △ Less

Submitted 8 May, 2024; v1 submitted 16 November, 2023; originally announced November 2023.

Comments: Accepted at the International Conference on Robotics, Computer Vision and Intelligent Systems (ROBOVIS) 2024

Spot: A Natural Language Interface for Geospatial Searches in OSM

Authors: Lynn Khellaf, Ipek Baris Schlicht, Julia Bayer, Ruben Bouwmeester, Tilman Miraß, Tilman Wagner

Abstract: Investigative journalists and fact-checkers have found OpenStreetMap (OSM) to be an invaluable resource for their work due to its extensive coverage and intricate details of various locations, which play a crucial role in investigating news scenes. Despite its value, OSM's complexity presents considerable accessibility and usability challenges, especially for those without a technical background.… ▽ More Investigative journalists and fact-checkers have found OpenStreetMap (OSM) to be an invaluable resource for their work due to its extensive coverage and intricate details of various locations, which play a crucial role in investigating news scenes. Despite its value, OSM's complexity presents considerable accessibility and usability challenges, especially for those without a technical background. To address this, we introduce 'Spot', a user-friendly natural language interface for querying OSM data. Spot utilizes a semantic map** from natural language to OSM tags, leveraging artificially generated sentence queries and a T5 transformer. This approach enables Spot to extract relevant information from user-input sentences and display candidate locations matching the descriptions on a map. To foster collaboration and future advancement, all code and generated data is available as an open-source repository. △ Less

Submitted 14 November, 2023; originally announced November 2023.

Comments: To be published in the Proceedings of the OSM Science 2023

Direct measurement of spin-flip rates in single-electron tunneling

Authors: Olfa Dani, Robert Hussein, Johannes C. Bayer, Klaus Pierz, Sigmund Kohler, Rolf J. Haug

Abstract: Spin-flips are one of the limiting factors for spin-based information processing. We demonstrate a transport approach for determining the spin-flip rates of a self-assembled InAs double quantum dot occupied by a single electron. In such devices, different Landé factors lead to an inhomogeneous Zeeman splitting, so that the two spin channels can never be at resonance simultaneously, leading to a sp… ▽ More Spin-flips are one of the limiting factors for spin-based information processing. We demonstrate a transport approach for determining the spin-flip rates of a self-assembled InAs double quantum dot occupied by a single electron. In such devices, different Landé factors lead to an inhomogeneous Zeeman splitting, so that the two spin channels can never be at resonance simultaneously, leading to a spin blockade at low temperatures. This blockade is analyzed in terms of spin flips for different temperatures and magnetic fields. Our results are in good agreement with a quantum master equation that combines the dot-lead couplings with ohmic dissipation stemming from spin-flip cotunneling. △ Less

Submitted 1 February, 2024; v1 submitted 17 October, 2023; originally announced October 2023.

Comments: 9 pages, 8 figures

Journal ref: Phys. Rev. B 109, L121404 (2024)

Eigenpatches -- Adversarial Patches from Principal Components

Authors: Jens Bayer, Stefan Becker, David Münch, Michael Arens

Abstract: Adversarial patches are still a simple yet powerful white box attack that can be used to fool object detectors by suppressing possible detections. The patches of these so-called evasion attacks are computational expensive to produce and require full access to the attacked detector. This paper addresses the problem of computational expensiveness by analyzing 375 generated patches, calculating the p… ▽ More Adversarial patches are still a simple yet powerful white box attack that can be used to fool object detectors by suppressing possible detections. The patches of these so-called evasion attacks are computational expensive to produce and require full access to the attacked detector. This paper addresses the problem of computational expensiveness by analyzing 375 generated patches, calculating the principal components of these and show, that linear combinations of the resulting "eigenpatches" can be used to fool object detections successfully. △ Less

Submitted 19 June, 2023; originally announced June 2023.

Category Theory in Isabelle/HOL as a Basis for Meta-logical Investigation

Authors: Jonas Bayer, Aleksey Gonus, Christoph Benzmüller, Dana S. Scott

Abstract: This paper presents meta-logical investigations based on category theory using the proof assistant Isabelle/HOL. We demonstrate the potential of a free logic based shallow semantic embedding of category theory by providing a formalization of the notion of elementary topoi. Additionally, we formalize symmetrical monoidal closed categories expressing the denotational semantic model of intuitionistic… ▽ More This paper presents meta-logical investigations based on category theory using the proof assistant Isabelle/HOL. We demonstrate the potential of a free logic based shallow semantic embedding of category theory by providing a formalization of the notion of elementary topoi. Additionally, we formalize symmetrical monoidal closed categories expressing the denotational semantic model of intuitionistic multiplicative linear logic. Next to these meta-logical-investigations, we contribute to building an Isabelle category theory library, with a focus on ease of use in the formalization beyond category theory itself. This work paves the way for future formalizations based on category theory and demonstrates the power of automated reasoning in investigating meta-logical questions. △ Less

Submitted 16 June, 2023; v1 submitted 15 June, 2023; originally announced June 2023.

Comments: 15 pages. Preprint of paper accepted for CICM 2023 conference

MSC Class: 68T15; 03B35; 03B80; 03B15; 08A05; 03C10; 03C68; 03C75; 20B05; 54H20 ACM Class: F.4; I.2.3

Journal ref: Intelligent Computer Mathematics (CICM 2023). Lecture Notes in Computer Science, vol 14101, pp. 69-83. Springer, Cham

Filter-Aware Model-Predictive Control

Authors: Baris Kayalibay, Atanas Mirchev, Ahmed Agha, Patrick van der Smagt, Justin Bayer

Abstract: Partially-observable problems pose a trade-off between reducing costs and gathering information. They can be solved optimally by planning in belief space, but that is often prohibitively expensive. Model-predictive control (MPC) takes the alternative approach of using a state estimator to form a belief over the state, and then plan in state space. This ignores potential future observations during… ▽ More Partially-observable problems pose a trade-off between reducing costs and gathering information. They can be solved optimally by planning in belief space, but that is often prohibitively expensive. Model-predictive control (MPC) takes the alternative approach of using a state estimator to form a belief over the state, and then plan in state space. This ignores potential future observations during planning and, as a result, cannot actively increase or preserve the certainty of its own state estimate. We find a middle-ground between planning in belief space and completely ignoring its dynamics by only reasoning about its future accuracy. Our approach, filter-aware MPC, penalises the loss of information by what we call "trackability", the expected error of the state estimator. We show that model-based simulation allows condensing trackability into a neural network, which allows fast planning. In experiments involving visual navigation, realistic every-day environments and a two-link robot arm, we show that filter-aware MPC vastly improves regular MPC. △ Less

Submitted 20 April, 2023; originally announced April 2023.

Instance Segmentation Based Graph Extraction for Handwritten Circuit Diagram Images

Authors: Johannes Bayer, Amit Kumar Roy, Andreas Dengel

Abstract: Handwritten circuit diagrams from educational scenarios or historic sources usually exist on analogue media. For deriving their functional principles or flaws automatically, they need to be digitized, extracting their electrical graph. Recently, the base technologies for automated pipelines facilitating this process shifted from computer vision to machine learning. This paper describes an approach… ▽ More Handwritten circuit diagrams from educational scenarios or historic sources usually exist on analogue media. For deriving their functional principles or flaws automatically, they need to be digitized, extracting their electrical graph. Recently, the base technologies for automated pipelines facilitating this process shifted from computer vision to machine learning. This paper describes an approach for extracting both the electrical components (including their terminals and describing texts) as well their interconnections (including junctions and wire hops) by the means of instance segmentation and keypoint extraction. Consequently, the resulting graph extraction process consists of a simple two-step process of model inference and trivial geometric keypoint matching. The dataset itself, its preparation, model training and post-processing are described and publicly available. △ Less

Submitted 18 January, 2023; v1 submitted 8 January, 2023; originally announced January 2023.

Comments: As submitted to ICPRAM23

Study on Domain Name System (DNS) Abuse: Technical Report

Authors: Jan Bayer, Yevheniya Nosyk, Olivier Hureau, Simon Fernandez, Ivett Paulovics, Andrzej Duda, Maciej Korczyński

Abstract: A safe and secure Domain Name System (DNS) is of paramount importance for the digital economy and society. Malicious activities on the DNS, generally referred to as "DNS abuse" are frequent and severe problems affecting online security and undermining users' trust in the Internet. The proposed definition of DNS abuse is as follows: Domain Name System (DNS) abuse is any activity that makes use of d… ▽ More A safe and secure Domain Name System (DNS) is of paramount importance for the digital economy and society. Malicious activities on the DNS, generally referred to as "DNS abuse" are frequent and severe problems affecting online security and undermining users' trust in the Internet. The proposed definition of DNS abuse is as follows: Domain Name System (DNS) abuse is any activity that makes use of domain names or the DNS protocol to carry out harmful or illegal activity. DNS abuse exploits the domain name registration process, the domain name resolution process, or other services associated with the domain name (e.g., shared web hosting service). Notably, we distinguish between: maliciously registered domain names: domain name registered with the malicious intent to carry out harmful or illegal activity compromised domain names: domain name registered by bona fide third-party for legitimate purposes, compromised by malicious actors to carry out harmful and illegal activity. DNS abuse disrupts, damages, or otherwise adversely impacts the DNS and the Internet infrastructure, their users or other persons. △ Less

Submitted 17 December, 2022; originally announced December 2022.

PRISM: Probabilistic Real-Time Inference in Spatial World Models

Authors: Atanas Mirchev, Baris Kayalibay, Ahmed Agha, Patrick van der Smagt, Daniel Cremers, Justin Bayer

Abstract: We introduce PRISM, a method for real-time filtering in a probabilistic generative model of agent motion and visual perception. Previous approaches either lack uncertainty estimates for the map and agent state, do not run in real-time, do not have a dense scene representation or do not model agent dynamics. Our solution reconciles all of these aspects. We start from a predefined state-space model… ▽ More We introduce PRISM, a method for real-time filtering in a probabilistic generative model of agent motion and visual perception. Previous approaches either lack uncertainty estimates for the map and agent state, do not run in real-time, do not have a dense scene representation or do not model agent dynamics. Our solution reconciles all of these aspects. We start from a predefined state-space model which combines differentiable rendering and 6-DoF dynamics. Probabilistic inference in this model amounts to simultaneous localisation and map** (SLAM) and is intractable. We use a series of approximations to Bayesian inference to arrive at probabilistic map and state estimates. We take advantage of well-established methods and closed-form updates, preserving accuracy and enabling real-time capability. The proposed solution runs at 10Hz real-time and is similarly accurate to state-of-the-art SLAM in small to medium-sized indoor environments, with high-speed UAV and handheld camera agents (Blackbird, EuRoC and TUM-RGBD). △ Less

Submitted 6 December, 2022; originally announced December 2022.

Comments: Will appear in PMLR, CoRL 2022

Functional Component Descriptions for Electrical Circuits based on Semantic Technology Reasoning

Authors: Johannes Bayer, Mina Karami Zadeh, Markus Schröder, Andreas Dengel

Abstract: Circuit diagrams have been used in electrical engineering for decades to describe the wiring of devices and facilities. They depict electrical components in a symbolic and graph-based manner. While the circuit design is usually performed electronically, there are still legacy paper-based diagrams that require digitization in order to be used in CAE systems. Generally, knowledge on specific circuit… ▽ More Circuit diagrams have been used in electrical engineering for decades to describe the wiring of devices and facilities. They depict electrical components in a symbolic and graph-based manner. While the circuit design is usually performed electronically, there are still legacy paper-based diagrams that require digitization in order to be used in CAE systems. Generally, knowledge on specific circuits may be lost between engineering projects, making it hard for domain novices to understand a given circuit design. The graph-based nature of these documents can be exploited by semantic technology-based reasoning in order to generate human-understandable descriptions of their functional principles. More precisely, each electrical component (e.g. a diode) of a circuit may be assigned a high-level function label which describes its purpose within the device (e.g. flyback diode for reverse voltage protection). In this paper, forward chaining rules are used for such a generation. The described approach is applicable for both CAE-based circuits as well as raw circuits yielded by an image understanding pipeline. The viability of the approach is demonstrated by application to an existing set of circuits. △ Less

Submitted 23 June, 2022; originally announced September 2022.

Comments: 5 pages, 8 figures

Mathematical Proof Between Generations

Authors: Jonas Bayer, Christoph Benzmüller, Kevin Buzzard, Marco David, Leslie Lamport, Yuri Matiyasevich, Lawrence Paulson, Dierk Schleicher, Benedikt Stock, Efim Zelmanov

Abstract: A proof is one of the most important concepts of mathematics. However, there is a striking difference between how a proof is defined in theory and how it is used in practice. This puts the unique status of mathematics as exact science into peril. Now may be the time to reconcile theory and practice, i.e. precision and intuition, through the advent of computer proof assistants. For the most time th… ▽ More A proof is one of the most important concepts of mathematics. However, there is a striking difference between how a proof is defined in theory and how it is used in practice. This puts the unique status of mathematics as exact science into peril. Now may be the time to reconcile theory and practice, i.e. precision and intuition, through the advent of computer proof assistants. For the most time this has been a topic for experts in specialized communities. However, mathematical proofs have become increasingly sophisticated, stretching the boundaries of what is humanly comprehensible, so that leading mathematicians have asked for formal verification of their proofs. At the same time, major theorems in mathematics have recently been computer-verified by people from outside of these communities, even by beginning students. This article investigates the gap between the different definitions of a proof and possibilities to build bridges. It is written as a polemic or a collage by different members of the communities in mathematics and computer science at different stages of their careers, challenging well-known preconceptions and exploring new perspectives. △ Less

Submitted 8 July, 2022; originally announced July 2022.

Comments: 17 pages, 1 figure

Journal ref: Notices of the American Mathematical Society (January 2024), Vol. 71, No. 1, pp. 79-92

Temperature-dependent broadening of coherent current peaks in InAs double quantum dots

Authors: Olfa Dani, Robert Hussein, Johannes C. Bayer, Sigmund Kohler, Rolf J. Haug

Abstract: Quantum systems as used for quantum computation or quantum sensing are nowadays often realized in solid state devices as e.g. complex Josephson circuits or coupled quantum-dot systems. Condensed matter as an environment influences heavily the quantum coherence of such systems. Here, we investigate electron transport through asymmetrically coupled InAs double quantum dots and observe an extremely s… ▽ More Quantum systems as used for quantum computation or quantum sensing are nowadays often realized in solid state devices as e.g. complex Josephson circuits or coupled quantum-dot systems. Condensed matter as an environment influences heavily the quantum coherence of such systems. Here, we investigate electron transport through asymmetrically coupled InAs double quantum dots and observe an extremely strong temperature dependence of the coherent current peaks of single-electron tunneling. We analyze experimentally and theoretically the broadening of such coherent current peaks up to temperatures of 20 K and we are able to model it with quantum dissipation being due to two different bosonic baths. These bosonic baths mainly originate from substrate phonons. Application of a magnetic field helps us to identify the different quantum dot states through their temperature dependence. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Comments: 10 pages, 6 figures

Journal ref: Comm. Phys. 5, 292 (2022)

JEM-EUSO Collaboration contributions to the 37th International Cosmic Ray Conference

Authors: G. Abdellaoui, S. Abe, J. H. Adams Jr., D. Allard, G. Alonso, L. Anchordoqui, A. Anzalone, E. Arnone, K. Asano, R. Attallah, H. Attoui, M. Ave Pernas, M. Bagheri, J. Baláz, M. Bakiri, D. Barghini, S. Bartocci, M. Battisti, J. Bayer, B. Beldjilali, T. Belenguer, N. Belkhalfa, R. Bellotti, A. A. Belov, K. Benmessai , et al. (267 additional authors not shown)

Abstract: Compilation of papers presented by the JEM-EUSO Collaboration at the 37th International Cosmic Ray Conference (ICRC), held on July 12-23, 2021 (online) in Berlin, Germany. Compilation of papers presented by the JEM-EUSO Collaboration at the 37th International Cosmic Ray Conference (ICRC), held on July 12-23, 2021 (online) in Berlin, Germany. △ Less

Submitted 28 January, 2022; originally announced January 2022.

Comments: html page with links to the JEM-EUSO Collaboration papers presented at ICRC-2021, Berlin, Germany

Tracking and Planning with Spatial World Models

Authors: Baris Kayalibay, Atanas Mirchev, Patrick van der Smagt, Justin Bayer

Abstract: We introduce a method for real-time navigation and tracking with differentiably rendered world models. Learning models for control has led to impressive results in robotics and computer games, but this success has yet to be extended to vision-based navigation. To address this, we transfer advances in the emergent field of differentiable rendering to model-based control. We do this by planning in a… ▽ More We introduce a method for real-time navigation and tracking with differentiably rendered world models. Learning models for control has led to impressive results in robotics and computer games, but this success has yet to be extended to vision-based navigation. To address this, we transfer advances in the emergent field of differentiable rendering to model-based control. We do this by planning in a learned 3D spatial world model, combined with a pose estimation algorithm previously used in the context of TSDF fusion, but now tailored to our setting and improved to incorporate agent dynamics. We evaluate over six simulated environments based on complex human-designed floor plans and provide quantitative results. We achieve up to 92% navigation success rate at a frequency of 15 Hz using only image and depth observations under stochastic, continuous dynamics. △ Less

Submitted 25 January, 2022; originally announced January 2022.

System for multi-robotic exploration of underground environments CTU-CRAS-NORLAB in the DARPA Subterranean Challenge

Authors: Tomáš Rouček, Martin Pecka, Petr Čížek, Tomáš Petříček, Jan Bayer, Vojtěch Šalanský, Teymur Azayev, Daniel Heřt, Matěj Petrlík, Tomáš Báča, Vojtěch Spurný, Vít Krátký, Pavel Petráček, Dominic Baril, Maxime Vaidis, Vladimír Kubelka, François Pomerleau, Jan Faigl, Karel Zimmermann, Martin Saska, Tomáš Svoboda, Tomáš Krajník

Abstract: We present a field report of CTU-CRAS-NORLAB team from the Subterranean Challenge (SubT) organised by the Defense Advanced Research Projects Agency (DARPA). The contest seeks to advance technologies that would improve the safety and efficiency of search-and-rescue operations in GPS-denied environments. During the contest rounds, teams of mobile robots have to find specific objects while operating… ▽ More We present a field report of CTU-CRAS-NORLAB team from the Subterranean Challenge (SubT) organised by the Defense Advanced Research Projects Agency (DARPA). The contest seeks to advance technologies that would improve the safety and efficiency of search-and-rescue operations in GPS-denied environments. During the contest rounds, teams of mobile robots have to find specific objects while operating in environments with limited radio communication, e.g. mining tunnels, underground stations or natural caverns. We present a heterogeneous exploration robotic system of the CTU-CRAS-NORLAB team, which achieved the third rank at the SubT Tunnel and Urban Circuit rounds and surpassed the performance of all other non-DARPA-funded teams. The field report describes the team's hardware, sensors, algorithms and strategies, and discusses the lessons learned by participating at the DARPA SubT contest. △ Less

Submitted 12 October, 2021; originally announced October 2021.

Comments: This paper have already been accepted to be published Filed Robotics special issue about DARPA SubT challange

A Comparison of Deep Saliency Map Generators on Multispectral Data in Object Detection

Authors: Jens Bayer, David Münch, Michael Arens

Abstract: Deep neural networks, especially convolutional deep neural networks, are state-of-the-art methods to classify, segment or even generate images, movies, or sounds. However, these methods lack of a good semantic understanding of what happens internally. The question, why a COVID-19 detector has classified a stack of lung-ct images as positive, is sometimes more interesting than the overall specifici… ▽ More Deep neural networks, especially convolutional deep neural networks, are state-of-the-art methods to classify, segment or even generate images, movies, or sounds. However, these methods lack of a good semantic understanding of what happens internally. The question, why a COVID-19 detector has classified a stack of lung-ct images as positive, is sometimes more interesting than the overall specificity and sensitivity. Especially when human domain expert knowledge disagrees with the given output. This way, human domain experts could also be advised to reconsider their choice, regarding the information pointed out by the system. In addition, the deep learning model can be controlled, and a present dataset bias can be found. Currently, most explainable AI methods in the computer vision domain are purely used on image classification, where the images are ordinary images in the visible spectrum. As a result, there is no comparison on how the methods behave with multimodal image data, as well as most methods have not been investigated on how they behave when used for object detection. This work tries to close the gaps. Firstly, investigating three saliency map generator methods on how their maps differ across the different spectra. This is achieved via accurate and systematic training. Secondly, we examine how they behave when used for object detection. As a practical problem, we chose object detection in the infrared and visual spectrum for autonomous driving. The dataset used in this work is the Multispectral Object Detection Dataset, where each scene is available in the FIR, MIR and NIR as well as visual spectrum. The results show that there are differences between the infrared and visual activation maps. Further, an advanced training with both, the infrared and visual data not only improves the network's output, it also leads to more focused spots in the saliency maps. △ Less

Submitted 26 August, 2021; originally announced August 2021.

Comments: 12 pages, 11 figures

A Public Ground-Truth Dataset for Handwritten Circuit Diagram Images

Authors: Felix Thoma, Johannes Bayer, Yakun Li

Abstract: The development of digitization methods for line drawings (especially in the area of electrical engineering) relies on the availability of publicly available training and evaluation data. This paper presents such an image set along with annotations. The dataset consists of 1152 images of 144 circuits by 12 drafters and 48 563 annotations. Each of these images depicts an electrical circuit diagram,… ▽ More The development of digitization methods for line drawings (especially in the area of electrical engineering) relies on the availability of publicly available training and evaluation data. This paper presents such an image set along with annotations. The dataset consists of 1152 images of 144 circuits by 12 drafters and 48 563 annotations. Each of these images depicts an electrical circuit diagram, taken by consumer grade cameras under varying lighting conditions and perspectives. A variety of different pencil types and surface materials has been used. For each image, all individual electrical components are annotated with bounding boxes and one out of 45 class labels. In order to simplify a graph extraction process, different helper symbols like junction points and crossovers are introduced, while texts are annotated as well. The geometric and taxonomic problems arising from this task as well as the classes themselves and statistics of their appearances are stated. The performance of a standard Faster RCNN on the dataset is provided as an object detection baseline. △ Less

Submitted 21 July, 2021; originally announced July 2021.

Comments: 6 pages, 3 figures, raw version as submitted to GREC2021

Beginners' Quest to Formalize Mathematics: A Feasibility Study in Isabelle

Authors: Jonas Bayer, Marco David, Abhik Pal, Benedikt Stock

Abstract: How difficult are interactive theorem provers to use? We respond by reviewing the formalization of Hilbert's tenth problem in Isabelle/HOL carried out by an undergraduate research group at Jacobs University Bremen. We argue that, as demonstrated by our example, proof assistants are feasible for beginners to formalize mathematics. With the aim to make the field more accessible, we also survey hurdl… ▽ More How difficult are interactive theorem provers to use? We respond by reviewing the formalization of Hilbert's tenth problem in Isabelle/HOL carried out by an undergraduate research group at Jacobs University Bremen. We argue that, as demonstrated by our example, proof assistants are feasible for beginners to formalize mathematics. With the aim to make the field more accessible, we also survey hurdles that arise when learning an interactive theorem prover. Broadly, we advocate for an increased adoption of interactive theorem provers in mathematical research and curricula. △ Less

Submitted 23 June, 2021; originally announced June 2021.

Comments: 11 pages, 1 figure; Published as a conference paper at CICM 2019

Journal ref: Intelligent Computer Mathematics (CICM 2019). Lecture Notes in Computer Science, vol 11617, pp. 16-27. Springer, Cham

Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Models

Authors: Justin Bayer, Maximilian Soelch, Atanas Mirchev, Baris Kayalibay, Patrick van der Smagt

Abstract: Amortised inference enables scalable learning of sequential latent-variable models (LVMs) with the evidence lower bound (ELBO). In this setting, variational posteriors are often only partially conditioned. While the true posteriors depend, e.g., on the entire sequence of observations, approximate posteriors are only informed by past observations. This mimics the Bayesian filter -- a mixture of smo… ▽ More Amortised inference enables scalable learning of sequential latent-variable models (LVMs) with the evidence lower bound (ELBO). In this setting, variational posteriors are often only partially conditioned. While the true posteriors depend, e.g., on the entire sequence of observations, approximate posteriors are only informed by past observations. This mimics the Bayesian filter -- a mixture of smoothing posteriors. Yet, we show that the ELBO objective forces partially-conditioned amortised posteriors to approximate products of smoothing posteriors instead. Consequently, the learned generative model is compromised. We demonstrate these theoretical findings in three scenarios: traffic flow, handwritten digits, and aerial vehicle dynamics. Using fully-conditioned approximate posteriors, performance improves in terms of generative modelling and multi-step prediction. △ Less

Submitted 17 March, 2021; v1 submitted 18 January, 2021; originally announced January 2021.

Comments: Published as a conference paper at ICLR 2021 (Poster)

HOLISMOKES -- V. Microlensing of type II supernovae and time-delay inference through spectroscopic phase retrieval

Authors: J. Bayer, S. Huber, C. Vogl, S. H. Suyu, S. Taubenberger, D. Sluse, J. H. H. Chan, W. E. Kerzendorf

Abstract: We investigate strongly gravitationally lensed type II supernovae (LSNe II) for time-delay cosmography incorporating microlensing effects, which expands on previous microlensing studies of type Ia supernovae (SNe Ia). We use the radiative-transfer code ${\rm \small TARDIS}$ to recreate five spectra of the prototypical SN 1999em at different times within the plateau phase of the light curve. The mi… ▽ More We investigate strongly gravitationally lensed type II supernovae (LSNe II) for time-delay cosmography incorporating microlensing effects, which expands on previous microlensing studies of type Ia supernovae (SNe Ia). We use the radiative-transfer code ${\rm \small TARDIS}$ to recreate five spectra of the prototypical SN 1999em at different times within the plateau phase of the light curve. The microlensing-induced deformations of the spectra and light curves are calculated by placing the SN into magnification maps generated with the code ${\rm \small GERLUMPH}$. We study the impact of microlensing on the color curves and find that there is no strong influence on them during the investigated time interval of the plateau phase. The color curves are only weakly affected by microlensing due to the almost achromatic behavior of the intensity profiles. However, the lack of non-linear structure in the color curves makes time-delay measurements difficult given the possible presence of differential dust extinction. Therefore, we further investigate SN phase inference through spectral absorption lines under the influence of microlensing and Gaussian noise. As the spectral features shift to longer wavelengths with progressing time after explosion, the measured wavelength of a specific absorption line provides information on the epoch of the SN. The comparison between retrieved epochs of two observed lensing images then gives the time delay of the images. We find that the phase retrieval method using spectral features yields accurate delays with uncertainties $\small {\lesssim}$2 days, making it a promising approach. △ Less

Submitted 8 September, 2021; v1 submitted 13 January, 2021; originally announced January 2021.

Comments: 19 pages, 17 figures

Journal ref: A&A 653, A29 (2021)

The Payload Data Handling Unit (PDHU) on-board the HERMES-TP and HERMES-SP CubeSat Missions

Authors: A. Guzman, S. Pliego, J. Bayer, Y. Evangelista, G. La Rosa, G. Sottile, S. Curzel, R. Campana, F. Fiore, F. Fuschino, A. Colagrossi, M. Fiorito, P. Nogara, R. Piazzolla, F. Russo, A. Santangelo, C. Tenzer

Abstract: The High Energy Rapid Modular Ensemble of Satellites (HERMES) Technological and Scientific pathfinder is a space borne mission based on a constellation of LEO nanosatellites. The payloads of these CubeSats consist of miniaturized detectors designed for bright high-energy transients such as Gamma-Ray Bursts (GRBs). This platform aims to impact Gamma Ray Burst (GRB) science and enhance the detection… ▽ More The High Energy Rapid Modular Ensemble of Satellites (HERMES) Technological and Scientific pathfinder is a space borne mission based on a constellation of LEO nanosatellites. The payloads of these CubeSats consist of miniaturized detectors designed for bright high-energy transients such as Gamma-Ray Bursts (GRBs). This platform aims to impact Gamma Ray Burst (GRB) science and enhance the detection of Gravitational Wave (GW) electromagnetic counterparts. This goal will be achieved with a field of view of several steradians, arcmin precision and state of the art timing accuracy. The localization performance for the whole constellation is proportional to the number of components and inversely proportional to the average baseline between them, and therefore is expected to increase as more. In this paper we describe the Payload Data Handling Unit (PDHU) for the HERMES-TP and HERMES SP mission. The PDHU is the main interface between the payload and the satellite bus. The PDHU is also in charge of the on-board control and monitoring of the scintillating crystal detectors. We will explain the TM/TC design and the distinct modes of operation. We also discuss the on-board data processing carried out by the PDHU and its impact on the output data of the detector. △ Less

Submitted 18 January, 2021; v1 submitted 8 January, 2021; originally announced January 2021.

Comments: 11 pages, 10 figures. Proceedings of SPIE "Astronomical Telescopes and Instrumentation" 2020

Journal ref: SPIE Proceedings Volume 11444, Space Telescopes and Instrumentation 2020: Ultraviolet to Gamma Ray; 1144450 (2020)

Extreme Universe Space Observatory on a Super Pressure Balloon 1 calibration: from the laboratory to the desert

Authors: J. H. Adams Jr., L. Allen, R. Bachman, S. Bacholle, P. Barrillon, J. Bayer, M. Bertaina, C. Blaksley, S. Blin-Bondil, F. Cafagna, D. Campana, M. Casolino, M. J. Christl, A. Cummings, S. Dagoret-Campagne, A. Diaz Damian, A. Ebersoldt, T. Ebisuzaki, J. Escobar, J. Eser, J. Evrard, F. Fenu, W. Finch, C. Fornaro, P. Gorodetzky , et al. (41 additional authors not shown)

Abstract: The Extreme Universe Space Observatory on a Super Pressure Balloon 1 (EUSO-SPB1) instrument was launched out of Wanaka, New Zealand, by NASA in April, 2017 as a mission of opportunity. The detector was developed as part of the Joint Experimental Missions for the Extreme Universe Space Observatory (JEM-EUSO) program toward a space-based ultra-high energy cosmic ray (UHECR) telescope with the main o… ▽ More The Extreme Universe Space Observatory on a Super Pressure Balloon 1 (EUSO-SPB1) instrument was launched out of Wanaka, New Zealand, by NASA in April, 2017 as a mission of opportunity. The detector was developed as part of the Joint Experimental Missions for the Extreme Universe Space Observatory (JEM-EUSO) program toward a space-based ultra-high energy cosmic ray (UHECR) telescope with the main objective to make the first observation of UHECRs via the fluorescence technique from suborbital space. The EUSO-SPB1 instrument is a refractive telescope consisting of two 1m$^2$ Fresnel lenses with a high-speed UV camera at the focal plane. The camera has 2304 individual pixels capable of single photoelectron counting with a time resolution of 2.5$μ$s. A detailed performance study including calibration was done on ground. We separately evaluated the properties of the Photo Detector Module (PDM) and the optical system in the laboratory. An end-to-end test of the instrument was performed during a field campaign in the West Desert in Utah, USA at the Telescope Array (TA) site in September 2016. The campaign lasted for 8 nights. In this article we present the results of the preflight laboratory and field tests. Based on the tests performed in the field, it was determined that EUSO-SPB1 has a field of view of 11.1$^\circ$ and an absolute photo-detection efficiency of 10%. We also measured the light flux necessary to obtain a 50% trigger efficiency using laser beams. These measurements were crucial for us to perform an accurate post flight event rate calculation to validate our cosmic ray search. Laser beams were also used to estimated the reconstruction angular resolution. Finally, we performed a flat field measurement in flight configuration at the launch site prior to the launch providing a uniformity of the focal surface better than 6%. △ Less

Submitted 18 November, 2020; originally announced November 2020.

Spectral properties of stochastic resonance in quantum transport

Authors: Robert Hussein, Sigmund Kohler, Johannes C. Bayer, Timo Wagner, Rolf J. Haug

Abstract: We investigate theoretically and experimentally stochastic resonance in a quantum dot coupled to electron source and drain via time-dependent tunnel barriers. A central finding is a transition visible in the current noise spectrum as a bifurcation of a dip originally at zero frequency. The transition occurs close to the stochastic resonance working point and relates to quantized pum**. For the e… ▽ More We investigate theoretically and experimentally stochastic resonance in a quantum dot coupled to electron source and drain via time-dependent tunnel barriers. A central finding is a transition visible in the current noise spectrum as a bifurcation of a dip originally at zero frequency. The transition occurs close to the stochastic resonance working point and relates to quantized pum**. For the evaluation of power spectra from measured waiting times, we generalize a result from renewal theory to the ac driven case. Moreover, we develop a master equation method to obtain phase-averaged current noise spectra for driven quantum transport. △ Less

Submitted 24 June, 2020; originally announced June 2020.

Comments: 10 pages, 6 figures

Journal ref: Phys. Rev. Lett. 125, 206801 (2020)

Variational State-Space Models for Localisation and Dense 3D Map** in 6 DoF

Authors: Atanas Mirchev, Baris Kayalibay, Patrick van der Smagt, Justin Bayer

Abstract: We solve the problem of 6-DoF localisation and 3D dense reconstruction in spatial environments as approximate Bayesian inference in a deep state-space model. Our approach leverages both learning and domain knowledge from multiple-view geometry and rigid-body dynamics. This results in an expressive predictive model of the world, often missing in current state-of-the-art visual SLAM solutions. The c… ▽ More We solve the problem of 6-DoF localisation and 3D dense reconstruction in spatial environments as approximate Bayesian inference in a deep state-space model. Our approach leverages both learning and domain knowledge from multiple-view geometry and rigid-body dynamics. This results in an expressive predictive model of the world, often missing in current state-of-the-art visual SLAM solutions. The combination of variational inference, neural networks and a differentiable raycaster ensures that our model is amenable to end-to-end gradient-based optimisation. We evaluate our approach on realistic unmanned aerial vehicle flight data, nearing the performance of state-of-the-art visual-inertial odometry systems. We demonstrate the applicability of the model to generative prediction and planning. △ Less

Submitted 15 March, 2021; v1 submitted 17 June, 2020; originally announced June 2020.

Comments: Update for ICLR2021

Controlled emission time statistics of a dynamic single-electron transistor

Authors: Fredrik Brange, Adrian Schmidt, Johannes C. Bayer, Timo Wagner, Christian Flindt, Rolf J. Haug

Abstract: Quantum technologies involving qubit measurements based on electronic interferometers rely critically on accurate single-particle emission. However, achieving precisely timed operations requires exquisite control of the single-particle sources in the time domain. Here, we demonstrate accurate control of the emission time statistics of a dynamic single-electron transistor by measuring the waiting t… ▽ More Quantum technologies involving qubit measurements based on electronic interferometers rely critically on accurate single-particle emission. However, achieving precisely timed operations requires exquisite control of the single-particle sources in the time domain. Here, we demonstrate accurate control of the emission time statistics of a dynamic single-electron transistor by measuring the waiting times between emitted electrons. By ram** up the modulation frequency, we controllably drive the system through a crossover from adiabatic to nonadiabatic dynamics, which we visualize by measuring the temporal fluctuations at the single-electron level and explain using detailed theory. Our work paves the way for future technologies based on the ability to control, transmit, and detect single quanta of charge or heat in the form of electrons, photons, or phonons. △ Less

Submitted 7 January, 2021; v1 submitted 13 May, 2020; originally announced May 2020.

Comments: 5+2 pages, 3 figures, published in Science Advances

Journal ref: Sci. Adv. 7, eabe0793 (2021)

Image-based OoD-Detector Principles on Graph-based Input Data in Human Action Recognition

Authors: Jens Bayer, David Münch, Michael Arens

Abstract: Living in a complex world like ours makes it unacceptable that a practical implementation of a machine learning system assumes a closed world. Therefore, it is necessary for such a learning-based system in a real world environment, to be aware of its own capabilities and limits and to be able to distinguish between confident and unconfident results of the inference, especially if the sample cannot… ▽ More Living in a complex world like ours makes it unacceptable that a practical implementation of a machine learning system assumes a closed world. Therefore, it is necessary for such a learning-based system in a real world environment, to be aware of its own capabilities and limits and to be able to distinguish between confident and unconfident results of the inference, especially if the sample cannot be explained by the underlying distribution. This knowledge is particularly essential in safety-critical environments and tasks e.g. self-driving cars or medical applications. Towards this end, we transfer image-based Out-of-Distribution (OoD)-methods to graph-based data and show the applicability in action recognition. The contribution of this work is (i) the examination of the portability of recent image-based OoD-detectors for graph-based input data, (ii) a Metric Learning-based approach to detect OoD-samples, and (iii) the introduction of a novel semi-synthetic action recognition dataset. The evaluation shows that image-based OoD-methods can be applied to graph-based data. Additionally, there is a gap between the performance on intraclass and intradataset results. First methods as the examined baseline or ODIN provide reasonable results. More sophisticated network architectures - in contrast to their image-based application - were surpassed in the intradataset comparison and even lead to less classification accuracy. △ Less

Submitted 3 March, 2020; originally announced March 2020.

Learning Flat Latent Manifolds with VAEs

Authors: Nutan Chen, Alexej Klushyn, Francesco Ferroni, Justin Bayer, Patrick van der Smagt

Abstract: Measuring the similarity between data points often requires domain knowledge, which can in parts be compensated by relying on unsupervised methods such as latent-variable models, where similarity/distance is estimated in a more compact latent space. Prevalent is the use of the Euclidean metric, which has the drawback of ignoring information about similarity of data stored in the decoder, as captur… ▽ More Measuring the similarity between data points often requires domain knowledge, which can in parts be compensated by relying on unsupervised methods such as latent-variable models, where similarity/distance is estimated in a more compact latent space. Prevalent is the use of the Euclidean metric, which has the drawback of ignoring information about similarity of data stored in the decoder, as captured by the framework of Riemannian geometry. We propose an extension to the framework of variational auto-encoders allows learning flat latent manifolds, where the Euclidean metric is a proxy for the similarity between data points. This is achieved by defining the latent space as a Riemannian manifold and by regularising the metric tensor to be a scaled identity matrix. Additionally, we replace the compact prior typically used in variational auto-encoders with a recently presented, more expressive hierarchical one---and formulate the learning problem as a constrained optimisation problem. We evaluate our method on a range of data-sets, including a video-tracking benchmark, where the performance of our unsupervised approach nears that of state-of-the-art supervised approaches, while retaining the computational efficiency of straight-line-based approaches. △ Less

Submitted 12 August, 2020; v1 submitted 12 February, 2020; originally announced February 2020.

Comments: Thirty-seventh International Conference on Machine Learning (ICML) 2020

Journal ref: International Conference on Machine Learning 2020

Contributions to the 36th International Cosmic Ray Conference (ICRC 2019) of the JEM-EUSO Collaboration

Authors: G. Abdellaoui, S. Abe, J. H. Adams Jr., A. Ahriche, D. Allard, L. Allen, G. Alonso, L. Anchordoqui, A. Anzalone, Y. Arai, K. Asano, R. Attallah, H. Attoui, M. Ave Pernas, S. Bacholle, M. Bakiri, P. Baragatti, P. Barrillon, S. Bartocci, J. Bayer, B. Beldjilali, T. Belenguer, N. Belkhalfa, R. Bellotti, A. Belov , et al. (287 additional authors not shown)

Abstract: Compilation of papers presented by the JEM-EUSO Collaboration at the 36th International Cosmic Ray Conference (ICRC), held July 24 through August 1, 2019 in Madison, Wisconsin. Compilation of papers presented by the JEM-EUSO Collaboration at the 36th International Cosmic Ray Conference (ICRC), held July 24 through August 1, 2019 in Madison, Wisconsin. △ Less

Submitted 18 December, 2019; originally announced December 2019.

Comments: links to the 24 papers published in arXiv

Journal ref: all published in PoS(ICRC2019)

Variational Tracking and Prediction with Generative Disentangled State-Space Models

Authors: Adnan Akhundov, Maximilian Soelch, Justin Bayer, Patrick van der Smagt

Abstract: We address tracking and prediction of multiple moving objects in visual data streams as inference and sampling in a disentangled latent state-space model. By encoding objects separately and including explicit position information in the latent state space, we perform tracking via amortized variational Bayesian inference of the respective latent positions. Inference is implemented in a modular neur… ▽ More We address tracking and prediction of multiple moving objects in visual data streams as inference and sampling in a disentangled latent state-space model. By encoding objects separately and including explicit position information in the latent state space, we perform tracking via amortized variational Bayesian inference of the respective latent positions. Inference is implemented in a modular neural framework tailored towards our disentangled latent space. Generative and inference model are jointly learned from observations only. Comparing to related prior work, we empirically show that our Markovian state-space assumption enables faithful and much improved long-term prediction well beyond the training horizon. Further, our inference model correctly decomposes frames into objects, even in the presence of occlusions. Tracking performance is increased significantly over prior art. △ Less

Submitted 14 October, 2019; originally announced October 2019.

Increasing the Generalisation Capacity of Conditional VAEs

Authors: Alexej Klushyn, Nutan Chen, Botond Cseke, Justin Bayer, Patrick van der Smagt

Abstract: We address the problem of one-to-many map**s in supervised learning, where a single instance has many different solutions of possibly equal cost. The framework of conditional variational autoencoders describes a class of methods to tackle such structured-prediction tasks by means of latent variables. We propose to incentivise informative latent representations for increasing the generalisation c… ▽ More We address the problem of one-to-many map**s in supervised learning, where a single instance has many different solutions of possibly equal cost. The framework of conditional variational autoencoders describes a class of methods to tackle such structured-prediction tasks by means of latent variables. We propose to incentivise informative latent representations for increasing the generalisation capacity of conditional variational autoencoders. To this end, we modify the latent variable model by defining the likelihood as a function of the latent variable only and introduce an expressive multimodal prior to enable the model for capturing semantically meaningful features of the data. To validate our approach, we train our model on the Cornell Robot Gras** dataset, and modified versions of MNIST and Fashion-MNIST obtaining results that show a significantly higher generalisation capability. △ Less

Submitted 10 September, 2019; v1 submitted 23 August, 2019; originally announced August 2019.

Defect Modulation Do**

Authors: Mirko Weidner, Anne Fuchs, Thorsten J. M. Bayer, Karsten Rachut, Getnet K. Deyu, Andreas Klein

Abstract: The do** of semiconductor materials is a fundamental part of modern technology, but the classical approaches have in many cases reached their limits both in regard to achievable charge carrier density, as well as mobility. Modulation do**, a mechanism that exploits the energy band alignment at an interface between two materials to induce free charge carriers in one of them, has been shown to c… ▽ More The do** of semiconductor materials is a fundamental part of modern technology, but the classical approaches have in many cases reached their limits both in regard to achievable charge carrier density, as well as mobility. Modulation do**, a mechanism that exploits the energy band alignment at an interface between two materials to induce free charge carriers in one of them, has been shown to circumvent the mobility restriction. Due to an alignment of do** limits by intrinsic defects, however, the carrier density limit cannot be lifted using this approach. Here we present a novel do** strategy using defects in a wide band gap material to dope the surface of a second semiconductor layer of dissimilar nature. We show that by depositing an insulator on a semiconductor material, the conductivity of the layer stack can be increased by seven orders of magnitude, without the necessity of high temperature processes or epitaxial growth. This approach has the potential to circumvent limits to both carrier mobility and density, opening up new possibilities in semiconductor device fabrication, particularly for the emerging field of oxide thin film electronics. △ Less

Submitted 5 July, 2019; originally announced July 2019.

Journal ref: Advanced Functional Materials, Volume 29, Article 1807906, 2019

On Deep Set Learning and the Choice of Aggregations

Authors: Maximilian Soelch, Adnan Akhundov, Patrick van der Smagt, Justin Bayer

Abstract: Recently, it has been shown that many functions on sets can be represented by sum decompositions. These decompositons easily lend themselves to neural approximations, extending the applicability of neural nets to set-valued inputs---Deep Set learning. This work investigates a core component of Deep Set architecture: aggregation functions. We suggest and examine alternatives to commonly used aggreg… ▽ More Recently, it has been shown that many functions on sets can be represented by sum decompositions. These decompositons easily lend themselves to neural approximations, extending the applicability of neural nets to set-valued inputs---Deep Set learning. This work investigates a core component of Deep Set architecture: aggregation functions. We suggest and examine alternatives to commonly used aggregation functions, including learnable recurrent aggregation functions. Empirically, we show that the Deep Set networks are highly sensitive to the choice of aggregation functions: beyond improved performance, we find that learnable aggregations lower hyper-parameter sensitivity and generalize better to out-of-distribution input size. △ Less

Submitted 8 April, 2020; v1 submitted 18 March, 2019; originally announced March 2019.

Bayesian Learning of Neural Network Architectures

Authors: Georgi Dikov, Patrick van der Smagt, Justin Bayer

Abstract: In this paper we propose a Bayesian method for estimating architectural parameters of neural networks, namely layer size and network depth. We do this by learning concrete distributions over these parameters. Our results show that regular networks with a learnt structure can generalise better on small datasets, while fully stochastic networks can be more robust to parameter initialisation. The pro… ▽ More In this paper we propose a Bayesian method for estimating architectural parameters of neural networks, namely layer size and network depth. We do this by learning concrete distributions over these parameters. Our results show that regular networks with a learnt structure can generalise better on small datasets, while fully stochastic networks can be more robust to parameter initialisation. The proposed method relies on standard neural variational learning and, unlike randomised architecture search, does not require a retraining of the model, thus kee** the computational overhead at minimum. △ Less

Submitted 27 January, 2019; v1 submitted 14 January, 2019; originally announced January 2019.

Comments: The 22nd International Conference on Artificial Intelligence and Statistics (AISTATS 2019)

Fast Approximate Geodesics for Deep Generative Models

Authors: Nutan Chen, Francesco Ferroni, Alexej Klushyn, Alexandros Paraschos, Justin Bayer, Patrick van der Smagt

Abstract: The length of the geodesic between two data points along a Riemannian manifold, induced by a deep generative model, yields a principled measure of similarity. Current approaches are limited to low-dimensional latent spaces, due to the computational complexity of solving a non-convex optimisation problem. We propose finding shortest paths in a finite graph of samples from the aggregate approximate… ▽ More The length of the geodesic between two data points along a Riemannian manifold, induced by a deep generative model, yields a principled measure of similarity. Current approaches are limited to low-dimensional latent spaces, due to the computational complexity of solving a non-convex optimisation problem. We propose finding shortest paths in a finite graph of samples from the aggregate approximate posterior, that can be solved exactly, at greatly reduced runtime, and without a notable loss in quality. Our approach, therefore, is hence applicable to high-dimensional problems, e.g., in the visual domain. We validate our approach empirically on a series of experiments using variational autoencoders applied to image data, including the Chair, FashionMNIST, and human movement data sets. △ Less

Submitted 23 May, 2019; v1 submitted 19 December, 2018; originally announced December 2018.

Comments: 28th International Conference on Artificial Neural Networks, 2019

Journal ref: 28th International Conference on Artificial Neural Networks, 2019

The enhanced X-ray Timing and Polarimetry mission - eXTP

Authors: ShuangNan Zhang, Andrea Santangelo, Marco Feroci, YuPeng Xu, FangJun Lu, Yong Chen, Hua Feng, Shu Zhang, Søren Brandt, Margarita Hernanz, Luca Baldini, Enrico Bozzo, Riccardo Campana, Alessandra De Rosa, YongWei Dong, Yuri Evangelista, Vladimir Karas, Norbert Meidinger, Aline Meuris, Kirpal Nandra, Teng Pan, Giovanni Pareschi, Piotr Orleanski, QiuShi Huang, Stephane Schanne , et al. (125 additional authors not shown)

Abstract: In this paper we present the enhanced X-ray Timing and Polarimetry mission - eXTP. eXTP is a space science mission designed to study fundamental physics under extreme conditions of density, gravity and magnetism. The mission aims at determining the equation of state of matter at supra-nuclear density, measuring effects of QED, and understanding the dynamics of matter in strong-field gravity. In ad… ▽ More In this paper we present the enhanced X-ray Timing and Polarimetry mission - eXTP. eXTP is a space science mission designed to study fundamental physics under extreme conditions of density, gravity and magnetism. The mission aims at determining the equation of state of matter at supra-nuclear density, measuring effects of QED, and understanding the dynamics of matter in strong-field gravity. In addition to investigating fundamental physics, eXTP will be a very powerful observatory for astrophysics that will provide observations of unprecedented quality on a variety of galactic and extragalactic objects. In particular, its wide field monitoring capabilities will be highly instrumental to detect the electro-magnetic counterparts of gravitational wave sources. The paper provides a detailed description of: (1) the technological and technical aspects, and the expected performance of the instruments of the scientific payload; (2) the elements and functions of the mission, from the spacecraft to the ground segment. △ Less

Submitted 10 December, 2018; originally announced December 2018.

Comments: Accepted for publication on Sci. China Phys. Mech. Astron. (2019)

First observations of speed of light tracks by a fluorescence detector looking down on the atmosphere

Authors: G. Abdellaoui, S. Abe, J. H. Adams Jr., A. Ahriche, D. Allard, L. Allen, G. Alonso, L. Anchordoqui, A. Anzalone, Y. Arai, K. Asano, R. Attallah, H. Attoui, M. Ave Pernas, S. Bacholle, M. Bakiri, P. Baragatti, P. Barrillon, S. Bartocci, J. Bayer, B. Beldjilali, T. Belenguer, N. Belkhalfa, R. Bellotti, A. Belov , et al. (289 additional authors not shown)

Abstract: EUSO-Balloon is a pathfinder mission for the Extreme Universe Space Observatory onboard the Japanese Experiment Module (JEM-EUSO). It was launched on the moonless night of the 25$^{th}$ of August 2014 from Timmins, Canada. The flight ended successfully after maintaining the target altitude of 38 km for five hours. One part of the mission was a 2.5 hour underflight using a helicopter equipped with… ▽ More EUSO-Balloon is a pathfinder mission for the Extreme Universe Space Observatory onboard the Japanese Experiment Module (JEM-EUSO). It was launched on the moonless night of the 25$^{th}$ of August 2014 from Timmins, Canada. The flight ended successfully after maintaining the target altitude of 38 km for five hours. One part of the mission was a 2.5 hour underflight using a helicopter equipped with three UV light sources (LED, xenon flasher and laser) to perform an inflight calibration and examine the detectors capability to measure tracks moving at the speed of light. We describe the helicopter laser system and details of the underflight as well as how the laser tracks were recorded and found in the data. These are the first recorded laser tracks measured from a fluorescence detector looking down on the atmosphere. Finally, we present a first reconstruction of the direction of the laser tracks relative to the detector. △ Less

Submitted 7 August, 2018; originally announced August 2018.

Comments: 18 pages, 14 figures

Journal ref: 2018 JINST 13 P05023

The Large Area Detector onboard the eXTP mission

Authors: Marco Feroci, Mahdi Ahangarianabhari, Giovanni Ambrosi, Filippo Ambrosino, Andrea Argan, Marco Barbera, Joerg Bayer, Pierluigi Bellutti, Bruna Bertucci, Giuseppe Bertuccio, Giacomo Borghi, Enrico Bozzo, Franck Cadoux, Riccardo Campana, Francesco Ceraudo, Tianxiang Chen, Daniela Cirrincione, Alessandra De Rosa, Ettore Del Monte, Sergio Di Cosimo, Sebastian Diebold, Yuri Evangelista, Qingmei Fan, Yannick Favre, Francesco Ficorella , et al. (46 additional authors not shown)

Abstract: The eXTP (enhanced X-ray Timing and Polarimetry) mission is a major project of the Chinese Academy of Sciences (CAS) and China National Space Administration (CNSA) currently performing an extended phase A study and proposed for a launch by 2025 in a low-earth orbit. The eXTP scientific payload envisages a suite of instruments (Spectroscopy Focusing Array, Polarimetry Focusing Array, Large Area Det… ▽ More The eXTP (enhanced X-ray Timing and Polarimetry) mission is a major project of the Chinese Academy of Sciences (CAS) and China National Space Administration (CNSA) currently performing an extended phase A study and proposed for a launch by 2025 in a low-earth orbit. The eXTP scientific payload envisages a suite of instruments (Spectroscopy Focusing Array, Polarimetry Focusing Array, Large Area Detector and Wide Field Monitor) offering unprecedented simultaneous wide-band X-ray spectral, timing and polarimetry sensitivity. A large European consortium is contributing to the eXTP study and it is expected to provide key hardware elements, including a Large Area Detector (LAD). The LAD instrument for eXTP is based on the design originally proposed for the LOFT mission within the ESA context. The eXTP/LAD envisages a deployed 3.4 m2 effective area in the 2-30 keV energy range, achieved through the technology of the large-area Silicon Drift Detectors - offering a spectral resolution of up to 200 eV FWHM at 6 keV - and of capillary plate collimators - limiting the field of view to about 1 degree. In this paper we provide an overview of the LAD instrument design, including new elements with respect to the earlier LOFT configuration. △ Less

Submitted 30 July, 2018; originally announced July 2018.

Comments: Paper presented at SPIE Space Telescopes and Instrumentation 2018

Journal ref: Proc. of SPIE Vol. 10699, 106991C - Space Telescopes and Instrumentation 2018: Ultraviolet to Gamma Ray, edited by Jan-Willem A. den Herder, Shouleh Nikzad, Kazuhiro Nakazawa

Approximate Bayesian inference in spatial environments

Authors: Atanas Mirchev, Baris Kayalibay, Maximilian Soelch, Patrick van der Smagt, Justin Bayer

Abstract: Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, map**, navigation or autonomous exploration are typically adressed with specialised methods, often relying on detailed knowledge of the system at hand. We express these tasks as probabilistic inferen… ▽ More Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, map**, navigation or autonomous exploration are typically adressed with specialised methods, often relying on detailed knowledge of the system at hand. We express these tasks as probabilistic inference and planning under the umbrella of deep sequential generative models. Using the frameworks of variational inference and neural networks, our method inherits favourable properties such as flexibility, scalability and the ability to learn from data. The method performs comparably to specialised state-of-the-art methodology in two distinct simulated environments. △ Less

Submitted 20 June, 2019; v1 submitted 18 May, 2018; originally announced May 2018.

Comments: Preprint of publication at RSS 2019

ChromaStarAtlas: Browser-based visualization of the ATLAS9 stellar structure and spectrum grid

Authors: C. Ian Short, Jason H. T. Bayer

Abstract: ChromaStaraAtlas (CSA) is a web application that uses the ChromaStar (CS) user interface (UI) to allow users to navigate and display a subset of the uniformly computed comprehensive ATLAS9 grid of atmosphere and spectrum models. It provides almost the same functionality as the CS UI in its more basic display modes, but presents the user with primary and post-processed outputs, including photometri… ▽ More ChromaStaraAtlas (CSA) is a web application that uses the ChromaStar (CS) user interface (UI) to allow users to navigate and display a subset of the uniformly computed comprehensive ATLAS9 grid of atmosphere and spectrum models. It provides almost the same functionality as the CS UI in its more basic display modes, but presents the user with primary and post-processed outputs, including photometric color indices, based on a properly line blanketed spectral energy distribution (SED). CSA interpolates in logarithmic quantities within the subset of the ATLAS9 grid ranging in Teff from 3500 to 25000 K, in log g from 0.0 to 5.0, and in [Fe/H] from 0.0 to -1.0 at a fixed microturbulence parameter of 2 km/s, and presents outputs derived from the monochromatic specific intensity distribution, I_lambda, in the lambda range from 250 to 2500 nm, and performs an approximate continuum rectification of the corresponding flux spectrum F_lambda based on its own internal model of the corresponding continuous extinction distribution, kappa^C_lambda, based on the procedures of CS. Optional advanced plots can be turned on that display both the primary atmospheric structure quantities from the public ATLAS9 data files, and secondary structure quantities computed from internal modeling. Unlike CS, CSA allows for activities in which students derive Teff values from fitting observed colors. The application may be found at www.ap.smu.ca/~ishort/OpenStars. △ Less

Submitted 9 May, 2018; originally announced May 2018.

Comments: 13 pages, 2 figures. Un-refereed

ChromaStarPy: A stellar atmosphere and spectrum modeling and visualization lab in python

Authors: C. Ian Short, Jason H. T. Bayer, Lindsey M. Burns

Abstract: We announce ChromaStarPy, an integrated general stellar atmospheric modeling and spectrum synthesis code written entirely in python V. 3. ChromaStarPy is a direct port of the ChromaStarServer (CSServ) Java modeling code described in earlier papers in this series, and many of the associated JavaScript (JS) post-processing procedures have been ported and incorporated into CSPy so that students have… ▽ More We announce ChromaStarPy, an integrated general stellar atmospheric modeling and spectrum synthesis code written entirely in python V. 3. ChromaStarPy is a direct port of the ChromaStarServer (CSServ) Java modeling code described in earlier papers in this series, and many of the associated JavaScript (JS) post-processing procedures have been ported and incorporated into CSPy so that students have access to ready-made "data products". A python integrated development environment (IDE) allows a student in a more advanced course to experiment with the code and to graphically visualize intermediate and final results, ad hoc, as they are running it. CSPy allows students and researchers to compare modeled to observed spectra in the same IDE in which they are processing observational data, while having complete control over the stellar parameters affecting the synthetic spectra. We also take the opportunity to describe improvements that have been made to the related codes, ChromaStar (CS), CSServ and ChromaStarDB (CSDB) that, where relevant, have also been incorporated into CSPy. The application may be found at the home page of the OpenStars project: http://www.ap.smu.ca/~ishort/OpenStars/ . △ Less

Submitted 22 January, 2018; originally announced January 2018.

Comments: See DOI zenodo.1095687. Accepted for publication in The Astrophysical Journal

Metrics for Deep Generative Models

Authors: Nutan Chen, Alexej Klushyn, Richard Kurle, Xueyan Jiang, Justin Bayer, Patrick van der Smagt

Abstract: Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution represented by a dataset. While the manifold hypothesis implies that the density induced by a dataset contains large regions of low density, the training crite… ▽ More Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution represented by a dataset. While the manifold hypothesis implies that the density induced by a dataset contains large regions of low density, the training criterions of VAEs and GANs will make the latent space densely covered. Consequently points that are separated by low-density regions in observation space will be pushed together in latent space, making stationary distances poor proxies for similarity. We transfer ideas from Riemannian geometry to this setting, letting the distance between two points be the shortest path on a Riemannian manifold induced by the transformation. The method yields a principled distance measure, provides a tool for visual inspection of deep generative models, and an alternative to linear interpolation in latent space. In addition, it can be applied for robot movement generalization using previously learned skills. The method is evaluated on a synthetic dataset with known ground truth; on a simulated robot arm dataset; on human motion capture data; and on a generative model of handwritten digits. △ Less

Submitted 8 February, 2018; v1 submitted 3 November, 2017; originally announced November 2017.

Comments: Published on the 21st International Conference on Artificial Intelligence and Statistics (AISTATS), 2018

Journal ref: The 21st International Conference on Artificial Intelligence and Statistics, 2018

Unsupervised Real-Time Control through Variational Empowerment

Authors: Maximilian Karl, Maximilian Soelch, Philip Becker-Ehmck, Djalel Benbouzid, Patrick van der Smagt, Justin Bayer

Abstract: We introduce a methodology for efficiently computing a lower bound to empowerment, allowing it to be used as an unsupervised cost function for policy learning in real-time control. Empowerment, being the channel capacity between actions and states, maximises the influence of an agent on its near future. It has been shown to be a good model of biological behaviour in the absence of an extrinsic goa… ▽ More We introduce a methodology for efficiently computing a lower bound to empowerment, allowing it to be used as an unsupervised cost function for policy learning in real-time control. Empowerment, being the channel capacity between actions and states, maximises the influence of an agent on its near future. It has been shown to be a good model of biological behaviour in the absence of an extrinsic goal. But empowerment is also prohibitively hard to compute, especially in nonlinear continuous spaces. We introduce an efficient, amortised method for learning empowerment-maximising policies. We demonstrate that our algorithm can reliably handle continuous dynamical systems using system dynamics learned from raw data. The resulting policies consistently drive the agents into states where they can use their full potential. △ Less

Submitted 13 October, 2017; originally announced October 2017.

Unsupervised preprocessing for Tactile Data

Authors: Maximilian Karl, Justin Bayer, Patrick van der Smagt

Abstract: Tactile information is important for grip**, stable grasp, and in-hand manipulation, yet the complexity of tactile data prevents widespread use of such sensors. We make use of an unsupervised learning algorithm that transforms the complex tactile data into a compact, latent representation without the need to record ground truth reference data. These compact representations can either be used dir… ▽ More Tactile information is important for grip**, stable grasp, and in-hand manipulation, yet the complexity of tactile data prevents widespread use of such sensors. We make use of an unsupervised learning algorithm that transforms the complex tactile data into a compact, latent representation without the need to record ground truth reference data. These compact representations can either be used directly in a reinforcement learning based controller or can be used to calibrate the tactile sensor to physical quantities with only a few datapoints. We show the quality of our latent representation by predicting important features and with a simple control task. △ Less

Submitted 23 June, 2016; originally announced June 2016.

ML-based tactile sensor calibration: A universal approach

Authors: Maximilian Karl, Artur Lohrer, Dhananjay Shah, Frederik Diehl, Max Fiedler, Saahil Ognawala, Justin Bayer, Patrick van der Smagt

Abstract: We study the responses of two tactile sensors, the fingertip sensor from the iCub and the BioTac under different external stimuli. The question of interest is to which degree both sensors i) allow the estimation of force exerted on the sensor and ii) enable the recognition of differing degrees of curvature. Making use of a force controlled linear motor affecting the tactile sensors we acquire seve… ▽ More We study the responses of two tactile sensors, the fingertip sensor from the iCub and the BioTac under different external stimuli. The question of interest is to which degree both sensors i) allow the estimation of force exerted on the sensor and ii) enable the recognition of differing degrees of curvature. Making use of a force controlled linear motor affecting the tactile sensors we acquire several high-quality data sets allowing the study of both sensors under exactly the same conditions. We also examined the structure of the representation of tactile stimuli in the recorded tactile sensor data using t-SNE embeddings. The experiments show that both the iCub and the BioTac excel in different settings. △ Less

Submitted 21 June, 2016; originally announced June 2016.

Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data

Authors: Maximilian Karl, Maximilian Soelch, Justin Bayer, Patrick van der Smagt

Abstract: We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference. Thus, it can handle highly nonlinear input data with temporal and spatial dependencies such as image… ▽ More We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models. Leveraging recent advances in Stochastic Gradient Variational Bayes, DVBF can overcome intractable inference distributions via variational inference. Thus, it can handle highly nonlinear input data with temporal and spatial dependencies such as image sequences without domain knowledge. Our experiments show that enabling backpropagation through transitions enforces state space assumptions and significantly improves information content of the latent embedding. This also enables realistic long-term prediction. △ Less

Submitted 3 March, 2017; v1 submitted 20 May, 2016; originally announced May 2016.

Comments: Published as a conference paper at ICLR 2017