Showing 1–50 of 62 results for author: Meier, K

Emulating insect brains for neuromorphic navigation

Authors: Korbinian Schreiber, Timo Wunderlich, Philipp Spilger, Sebastian Billaudelle, Benjamin Cramer, Yannik Stradmann, Christian Pehle, Eric Müller, Mihai A. Petrovici, Johannes Schemmel, Karlheinz Meier

Abstract: Bees display the remarkable ability to return home in a straight line after meandering excursions to their environment. Neurobiological imaging studies have revealed that this capability emerges from a path integration mechanism implemented within the insect's brain. In the present work, we emulate this neural network on the neuromorphic mixed-signal processor BrainScaleS-2 to guide bees, virtuall… ▽ More Bees display the remarkable ability to return home in a straight line after meandering excursions to their environment. Neurobiological imaging studies have revealed that this capability emerges from a path integration mechanism implemented within the insect's brain. In the present work, we emulate this neural network on the neuromorphic mixed-signal processor BrainScaleS-2 to guide bees, virtually embodied on a digital co-processor, back to their home location after randomly exploring their environment. To realize the underlying neural integrators, we introduce single-neuron spike-based short-term memory cells with axo-axonic synapses. All entities, including environment, sensory organs, brain, actuators, and the virtual body, run autonomously on a single BrainScaleS-2 microchip. The functioning network is fine-tuned for better precision and reliability through an evolution strategy. As BrainScaleS-2 emulates neural processes 1000 times faster than biology, 4800 consecutive bee journeys distributed over 320 generations occur within only half an hour on a single neuromorphic core. △ Less

Submitted 31 December, 2023; originally announced January 2024.

Ab initio Calculation of Fluid Properties for Precision Metrology

Authors: Giovanni Garberoglio, Christof Gaiser, Roberto M. Gavioso, Allan H. Harvey, Robert Hellmann, Bogumił Jeziorski, Karsten Meier, Michael R. Moldover, Laurent Pitre, Krzysztof Szalewicz, Robin Underwood

Abstract: Recent advances regarding the interplay between ab initio calculations and metrology are reviewed, with particular emphasis on gas-based techniques used for temperature and pressure measurements. Since roughly 2010, several thermophysical quantities - in particular, virial and transport coefficients - can be computed from first principles without uncontrolled approximations and with rigorously pro… ▽ More Recent advances regarding the interplay between ab initio calculations and metrology are reviewed, with particular emphasis on gas-based techniques used for temperature and pressure measurements. Since roughly 2010, several thermophysical quantities - in particular, virial and transport coefficients - can be computed from first principles without uncontrolled approximations and with rigorously propagated uncertainties. In the case of helium, computational results have accuracies that exceed the best experimental data by at least one order of magnitude and are suitable to be used in primary metrology. The availability of ab initio virial and transport coefficients contributed to the recent SI definition of temperature by facilitating measurements of the Boltzmann constant with unprecedented accuracy. Presently, they enable the development of primary standards of temperature in the range 2.5-552 K and pressure up to 7 MPa using acoustic gas thermometry, dielectric constant gas thermometry, and refractive index gas thermometry. These approaches will be reviewed, highlighting the effect of first-principles data on their accuracy. The recent advances in electronic structure calculations that enabled highly accurate solutions for the many-body interaction potentials and polarizabilities of atoms - particularly helium - will be described, together with the subsequent computational methods, most often based on quantum statistical mechanics and its path-integral formulation, that provide thermophysical properties and their uncertainties. Similar approaches for molecular systems, and their applications, are briefly discussed. Current limitations and expected future lines of research are assessed. △ Less

Submitted 27 April, 2023; originally announced April 2023.

Comments: 59 pages, 9 figures

Journal ref: J. Phys. Chem. Ref. Data 52, 031502 (2023)

Second-order properties for planar Mondrian tessellations

Authors: Carina Betken, Tom Kaufmann, Kathrin Meier, Christoph Thäle

Abstract: In this paper planar STIT tesselations with weighted axis-parallel cutting directions are considered. They are known also as weighted planar Mondrian tesselations in the machine learning literature, where they are used in random forest learning and kernel methods. Various second-order properties of such random tessellations are derived, in particular, explicit formulas are obtained for suitably ad… ▽ More In this paper planar STIT tesselations with weighted axis-parallel cutting directions are considered. They are known also as weighted planar Mondrian tesselations in the machine learning literature, where they are used in random forest learning and kernel methods. Various second-order properties of such random tessellations are derived, in particular, explicit formulas are obtained for suitably adapted versions of the pair- and cross-correlation functions of the length measure on the edge skeleton and the vertex point process. Also, explicit formulas and the asymptotic behaviour of variances are discussed in detail. △ Less

Submitted 28 April, 2022; originally announced April 2022.

MSC Class: 60D05

Central limit theorems for generalized descents and generalized inversions in finite root systems

Authors: Kathrin Meier, Christian Stump

Abstract: We consider generalized inversions and descents in finite Weyl groups. We establish Coxeter-theoretic properties of indicator random variables of positive roots such as the covariance of two such indicator random variables. We then compute the variances of generalized inversions and descents in classical types. We finally use the dependency graph method to prove central limit theorems for general… ▽ More We consider generalized inversions and descents in finite Weyl groups. We establish Coxeter-theoretic properties of indicator random variables of positive roots such as the covariance of two such indicator random variables. We then compute the variances of generalized inversions and descents in classical types. We finally use the dependency graph method to prove central limit theorems for general antichains in root posets and in particular for generalized descents, and then for generalized inversions. △ Less

Submitted 28 September, 2023; v1 submitted 11 February, 2022; originally announced February 2022.

Comments: 23 pages, v2: added Theorem 3.4 filling a gap in the dependency graph method. Final version to appear in Electron. J. Probab

MSC Class: Primary 20F55; secondary 05A15; 05A16; 60F05

Superradiant many-qubit absorption refrigerator

Authors: Michal Kloc, Kurt Meier, Kimon Hadjikyriakos, Gernot Schaller

Abstract: We show that the lower levels of a large-spin network with a collective anti-ferromagnetic interaction and collective couplings to three reservoirs may function as a quantum absorption refrigerator. In appropriate regimes, the steady-state cooling current of this refrigerator scales quadratically with the size of the working medium, i.e., the number of spins. The same scaling is observed for the n… ▽ More We show that the lower levels of a large-spin network with a collective anti-ferromagnetic interaction and collective couplings to three reservoirs may function as a quantum absorption refrigerator. In appropriate regimes, the steady-state cooling current of this refrigerator scales quadratically with the size of the working medium, i.e., the number of spins. The same scaling is observed for the noise and the entropy production rate. △ Less

Submitted 18 September, 2021; v1 submitted 8 June, 2021; originally announced June 2021.

Comments: 7+4+2 pages, 7 figures, extended discussion (v2 suffered from omissions due to unfortunate tex errors)

Report number: HZDR-ID 32744

Journal ref: Phys. Rev. Applied 16, 044061 (2021)

Cortical oscillations implement a backbone for sampling-based computation in spiking neural networks

Authors: Agnes Korcsak-Gorzo, Michael G. Müller, Andreas Baumbach, Luziwei Leng, Oliver Julien Breitwieser, Sacha J. van Albada, Walter Senn, Karlheinz Meier, Robert Legenstein, Mihai A. Petrovici

Abstract: Being permanently confronted with an uncertain world, brains have faced evolutionary pressure to represent this uncertainty in order to respond appropriately. Often, this requires visiting multiple interpretations of the available information or multiple solutions to an encountered problem. This gives rise to the so-called mixing problem: since all of these "valid" states represent powerful attrac… ▽ More Being permanently confronted with an uncertain world, brains have faced evolutionary pressure to represent this uncertainty in order to respond appropriately. Often, this requires visiting multiple interpretations of the available information or multiple solutions to an encountered problem. This gives rise to the so-called mixing problem: since all of these "valid" states represent powerful attractors, but between themselves can be very dissimilar, switching between such states can be difficult. We propose that cortical oscillations can be effectively used to overcome this challenge. By acting as an effective temperature, background spiking activity modulates exploration. Rhythmic changes induced by cortical oscillations can then be interpreted as a form of simulated tempering. We provide a rigorous mathematical discussion of this link and study some of its phenomenological implications in computer simulations. This identifies a new computational role of cortical oscillations and connects them to various phenomena in the brain, such as sampling-based probabilistic inference, memory replay, multisensory cue combination, and place cell flickering. △ Less

Submitted 4 April, 2022; v1 submitted 19 June, 2020; originally announced June 2020.

Comments: 34 pages, 9 figures

Journal ref: PLoS Comput Biol 18(3): e1009753 (2022)

Closed-loop experiments on the BrainScaleS-2 architecture

Authors: K. Schreiber, T. C. Wunderlich, C. Pehle, M. A. Petrovici, J. Schemmel, K. Meier

Abstract: The evolution of biological brains has always been contingent on their embodiment within their respective environments, in which survival required appropriate navigation and manipulation skills. Studying such interactions thus represents an important aspect of computational neuroscience and, by extension, a topic of interest for neuromorphic engineering. Here, we present three examples of embodime… ▽ More The evolution of biological brains has always been contingent on their embodiment within their respective environments, in which survival required appropriate navigation and manipulation skills. Studying such interactions thus represents an important aspect of computational neuroscience and, by extension, a topic of interest for neuromorphic engineering. Here, we present three examples of embodiment on the BrainScaleS-2 architecture, in which dynamical timescales of both agents and environment are accelerated by several orders of magnitude with respect to their biological archetypes. △ Less

Submitted 29 April, 2020; originally announced April 2020.

Comments: Neuro-inspired Computational Elements Workshop (NICE 2020). arXiv admin note: text overlap with arXiv:1912.12980

Versatile emulation of spiking neural networks on an accelerated neuromorphic substrate

Authors: Sebastian Billaudelle, Yannik Stradmann, Korbinian Schreiber, Benjamin Cramer, Andreas Baumbach, Dominik Dold, Julian Göltz, Akos F. Kungl, Timo C. Wunderlich, Andreas Hartel, Eric Müller, Oliver Breitwieser, Christian Mauch, Mitja Kleider, Andreas Grübl, David Stöckel, Christian Pehle, Arthur Heimbrecht, Philipp Spilger, Gerd Kiene, Vitali Karasenko, Walter Senn, Mihai A. Petrovici, Johannes Schemmel, Karlheinz Meier

Abstract: We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration factor of 1000 compared to biological dynamics enables the execution of computationally expensive tasks, by allowing the fast emulation of long-duration experi… ▽ More We present first experimental results on the novel BrainScaleS-2 neuromorphic architecture based on an analog neuro-synaptic core and augmented by embedded microprocessors for complex plasticity and experiment control. The high acceleration factor of 1000 compared to biological dynamics enables the execution of computationally expensive tasks, by allowing the fast emulation of long-duration experiments or rapid iteration over many consecutive trials. The flexibility of our architecture is demonstrated in a suite of five distinct experiments, which emphasize different aspects of the BrainScaleS-2 system. △ Less

Submitted 9 May, 2022; v1 submitted 30 December, 2019; originally announced December 2019.

Structural plasticity on an accelerated analog neuromorphic hardware system

Authors: Sebastian Billaudelle, Benjamin Cramer, Mihai A. Petrovici, Korbinian Schreiber, David Kappel, Johannes Schemmel, Karlheinz Meier

Abstract: In computational neuroscience, as well as in machine learning, neuromorphic devices promise an accelerated and scalable alternative to neural network simulations. Their neural connectivity and synaptic capacity depends on their specific design choices, but is always intrinsically limited. Here, we present a strategy to achieve structural plasticity that optimizes resource allocation under these co… ▽ More In computational neuroscience, as well as in machine learning, neuromorphic devices promise an accelerated and scalable alternative to neural network simulations. Their neural connectivity and synaptic capacity depends on their specific design choices, but is always intrinsically limited. Here, we present a strategy to achieve structural plasticity that optimizes resource allocation under these constraints by constantly rewiring the pre- and gpostsynaptic partners while kee** the neuronal fan-in constant and the connectome sparse. In particular, we implemented this algorithm on the analog neuromorphic system BrainScaleS-2. It was executed on a custom embedded digital processor located on chip, accompanying the mixed-signal substrate of spiking neurons and synapse circuits. We evaluated our implementation in a simple supervised learning scenario, showing its ability to optimize the network topology with respect to the nature of its training data, as well as its overall computational efficiency. △ Less

Submitted 30 September, 2020; v1 submitted 27 December, 2019; originally announced December 2019.

Fast and energy-efficient neuromorphic deep learning with first-spike times

Authors: Julian Göltz, Laura Kriener, Andreas Baumbach, Sebastian Billaudelle, Oliver Breitwieser, Benjamin Cramer, Dominik Dold, Akos Ferenc Kungl, Walter Senn, Johannes Schemmel, Karlheinz Meier, Mihai Alexandru Petrovici

Abstract: For a biological agent operating under environmental pressure, energy consumption and reaction times are of critical importance. Similarly, engineered systems are optimized for short time-to-solution and low energy-to-solution characteristics. At the level of neuronal implementation, this implies achieving the desired results with as few and as early spikes as possible. With time-to-first-spike co… ▽ More For a biological agent operating under environmental pressure, energy consumption and reaction times are of critical importance. Similarly, engineered systems are optimized for short time-to-solution and low energy-to-solution characteristics. At the level of neuronal implementation, this implies achieving the desired results with as few and as early spikes as possible. With time-to-first-spike coding both of these goals are inherently emerging features of learning. Here, we describe a rigorous derivation of a learning rule for such first-spike times in networks of leaky integrate-and-fire neurons, relying solely on input and output spike times, and show how this mechanism can implement error backpropagation in hierarchical spiking networks. Furthermore, we emulate our framework on the BrainScaleS-2 neuromorphic system and demonstrate its capability of harnessing the system's speed and energy characteristics. Finally, we examine how our approach generalizes to other neuromorphic platforms by studying how its performance is affected by typical distortive effects induced by neuromorphic substrates. △ Less

Submitted 17 May, 2021; v1 submitted 24 December, 2019; originally announced December 2019.

Comments: 24 pages, 11 figures

Journal ref: Nature Machine Intelligence 3, 823-835 (2021)

Control of criticality and computation in spiking neuromorphic networks with plasticity

Authors: Benjamin Cramer, David Stöckel, Markus Kreft, Michael Wibral, Johannes Schemmel, Karlheinz Meier, Viola Priesemann

Abstract: The critical state is assumed to be optimal for any computation in recurrent neural networks, because criticality maximizes a number of abstract computational properties. We challenge this assumption by evaluating the performance of a spiking recurrent neural network on a set of tasks of varying complexity at - and away from critical network dynamics. To that end, we developed a spiking network wi… ▽ More The critical state is assumed to be optimal for any computation in recurrent neural networks, because criticality maximizes a number of abstract computational properties. We challenge this assumption by evaluating the performance of a spiking recurrent neural network on a set of tasks of varying complexity at - and away from critical network dynamics. To that end, we developed a spiking network with synaptic plasticity on a neuromorphic chip. We show that the distance to criticality can be easily adapted by changing the input strength, and then demonstrate a clear relation between criticality, task-performance and information-theoretic fingerprint. Whereas the information-theoretic measures all show that network capacity is maximal at criticality, this is not the case for performance on specific tasks: Only the complex, memory-intensive tasks profit from criticality, whereas the simple tasks suffer from it. Thereby, we challenge the general assumption that criticality would be beneficial for any task, and provide instead an understanding of how the collective network state should be tuned to task requirement to achieve optimal performance. △ Less

Submitted 11 February, 2020; v1 submitted 17 September, 2019; originally announced September 2019.

Neuromorphic Hardware learns to learn

Authors: Thomas Bohnstingl, Franz Scherr, Christian Pehle, Karlheinz Meier, Wolfgang Maass

Abstract: Hyperparameters and learning algorithms for neuromorphic hardware are usually chosen by hand. In contrast, the hyperparameters and learning algorithms of networks of neurons in the brain, which they aim to emulate, have been optimized through extensive evolutionary and developmental processes for specific ranges of computing and learning tasks. Occasionally this process has been emulated through g… ▽ More Hyperparameters and learning algorithms for neuromorphic hardware are usually chosen by hand. In contrast, the hyperparameters and learning algorithms of networks of neurons in the brain, which they aim to emulate, have been optimized through extensive evolutionary and developmental processes for specific ranges of computing and learning tasks. Occasionally this process has been emulated through genetic algorithms, but these require themselves hand-design of their details and tend to provide a limited range of improvements. We employ instead other powerful gradient-free optimization tools, such as cross-entropy methods and evolutionary strategies, in order to port the function of biological optimization processes to neuromorphic hardware. As an example, we show that this method produces neuromorphic agents that learn very efficiently from rewards. In particular, meta-plasticity, i.e., the optimization of the learning rule which they use, substantially enhances reward-based learning capability of the hardware. In addition, we demonstrate for the first time Learning-to-Learn benefits from such hardware, in particular, the capability to extract abstract knowledge from prior learning experiences that speeds up the learning of new but related tasks. Learning-to-Learn is especially suited for accelerated neuromorphic hardware, since it makes it feasible to carry out the required very large number of network computations. △ Less

Submitted 18 March, 2019; v1 submitted 15 March, 2019; originally announced March 2019.

Journal ref: https://www.frontiersin.org/articles/10.3389/fnins.2019.00483/full

Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster

Authors: Felix Bührer, Frank Fischer, Georg Fleig, Anton Gamel, Manuel Giffels, Thomas Hauth, Michael Janczyk, Konrad Meier, Günter Quast, Benoît Roland, Ulrike Schnoor, Markus Schumacher, Dirk von Suchodoletz, Bernd Wiebelt

Abstract: The NEMO High Performance Computing Cluster at the University of Freiburg has been made available to researchers of the ATLAS and CMS experiments. Users access the cluster from external machines connected to the World-wide LHC Computing Grid (WLCG). This paper describes how the full software environment of the WLCG is provided in a virtual machine image. The interplay between the schedulers for NE… ▽ More The NEMO High Performance Computing Cluster at the University of Freiburg has been made available to researchers of the ATLAS and CMS experiments. Users access the cluster from external machines connected to the World-wide LHC Computing Grid (WLCG). This paper describes how the full software environment of the WLCG is provided in a virtual machine image. The interplay between the schedulers for NEMO and for the external clusters is coordinated through the ROCED service. A cloud computing infrastructure is deployed at NEMO to orchestrate the simultaneous usage by bare metal and virtualized jobs. Through the setup, resources are provided to users in a transparent, automatized, and on-demand way. The performance of the virtualized environment has been evaluated for particle physics applications. △ Less

Submitted 20 December, 2018; originally announced December 2018.

Demonstrating Advantages of Neuromorphic Computation: A Pilot Study

Authors: Timo Wunderlich, Akos F. Kungl, Eric Müller, Andreas Hartel, Yannik Stradmann, Syed Ahmed Aamir, Andreas Grübl, Arthur Heimbrecht, Korbinian Schreiber, David Stöckel, Christian Pehle, Sebastian Billaudelle, Gerd Kiene, Christian Mauch, Johannes Schemmel, Karlheinz Meier, Mihai A. Petrovici

Abstract: Neuromorphic devices represent an attempt to mimic aspects of the brain's architecture and dynamics with the aim of replicating its hallmark functional capabilities in terms of computational power, robust learning and energy efficiency. We employ a single-chip prototype of the BrainScaleS 2 neuromorphic system to implement a proof-of-concept demonstration of reward-modulated spike-timing-dependent… ▽ More Neuromorphic devices represent an attempt to mimic aspects of the brain's architecture and dynamics with the aim of replicating its hallmark functional capabilities in terms of computational power, robust learning and energy efficiency. We employ a single-chip prototype of the BrainScaleS 2 neuromorphic system to implement a proof-of-concept demonstration of reward-modulated spike-timing-dependent plasticity in a spiking network that learns to play the Pong video game by smooth pursuit. This system combines an electronic mixed-signal substrate for emulating neuron and synapse dynamics with an embedded digital processor for on-chip learning, which in this work also serves to simulate the virtual environment and learning agent. The analog emulation of neuronal membrane dynamics enables a 1000-fold acceleration with respect to biological real-time, with the entire chip operating on a power budget of 57mW. Compared to an equivalent simulation using state-of-the-art software, the on-chip emulation is at least one order of magnitude faster and three orders of magnitude more energy-efficient. We demonstrate how on-chip learning can mitigate the effects of fixed-pattern noise, which is unavoidable in analog substrates, while making use of temporal variability for action exploration. Learning compensates imperfections of the physical substrate, as manifested in neuronal parameter variability, by adapting synaptic weights to match respective excitability of individual neurons. △ Less

Submitted 8 March, 2019; v1 submitted 8 November, 2018; originally announced November 2018.

Comments: Added measurements with noise in NEST simulation, add notice about journal publication. Frontiers in Neuromorphic Engineering (2019)

Emulating quantum computation with artificial neural networks

Authors: Christian Pehle, Karlheinz Meier, Markus Oberthaler, Christof Wetterich

Abstract: We demonstrate, that artificial neural networks (ANN) can be trained to emulate single or multiple basic quantum operations. In order to realize a quantum state, we implement a novel "quantumness gate" that maps an arbitrary matrix to the real representation of a positive hermitean normalized density matrix. We train the CNOT gate, the Hadamard gate and a rotation in Hilbert space as basic buildin… ▽ More We demonstrate, that artificial neural networks (ANN) can be trained to emulate single or multiple basic quantum operations. In order to realize a quantum state, we implement a novel "quantumness gate" that maps an arbitrary matrix to the real representation of a positive hermitean normalized density matrix. We train the CNOT gate, the Hadamard gate and a rotation in Hilbert space as basic building blocks for processing the quantum density matrices of two entangled qubits. During the training process the neural networks learn to represent the complex structure, the hermiticity, the normalization and the positivity of the output matrix. The requirement of successful training allows us to find a critical bottleneck dimension which reflects the relevant quantum information. Chains of individually trained neural quantum gates can be constructed to realize any unitary transformation. For scaling to larger quantum systems, we propose to use correlations of stochastic macroscopic two-level observables or classical bits. This novel concept provides a path for a classical implementation of computationally relevant quantum information processing on classical neural networks, in particular on neuromorphic computing machines featuring stochastic operations. △ Less

Submitted 24 October, 2018; originally announced October 2018.

Comments: 6 pages , 3 figures

Stochasticity from function -- why the Bayesian brain may need no noise

Authors: Dominik Dold, Ilja Bytschok, Akos F. Kungl, Andreas Baumbach, Oliver Breitwieser, Walter Senn, Johannes Schemmel, Karlheinz Meier, Mihai A. Petrovici

Abstract: An increasing body of evidence suggests that the trial-to-trial variability of spiking activity in the brain is not mere noise, but rather the reflection of a sampling-based encoding scheme for probabilistic computing. Since the precise statistical properties of neural activity are important in this context, many models assume an ad-hoc source of well-behaved, explicit noise, either on the input o… ▽ More An increasing body of evidence suggests that the trial-to-trial variability of spiking activity in the brain is not mere noise, but rather the reflection of a sampling-based encoding scheme for probabilistic computing. Since the precise statistical properties of neural activity are important in this context, many models assume an ad-hoc source of well-behaved, explicit noise, either on the input or on the output side of single neuron dynamics, most often assuming an independent Poisson process in either case. However, these assumptions are somewhat problematic: neighboring neurons tend to share receptive fields, rendering both their input and their output correlated; at the same time, neurons are known to behave largely deterministically, as a function of their membrane potential and conductance. We suggest that spiking neural networks may, in fact, have no need for noise to perform sampling-based Bayesian inference. We study analytically the effect of auto- and cross-correlations in functionally Bayesian spiking networks and demonstrate how their effect translates to synaptic interaction strengths, rendering them controllable through synaptic plasticity. This allows even small ensembles of interconnected deterministic spiking networks to simultaneously and co-dependently shape their output activity through learning, enabling them to perform complex Bayesian computation without any need for noise, which we demonstrate in silico, both in classical simulation and in neuromorphic emulation. These results close a gap between the abstract models and the biology of functionally Bayesian spiking networks, effectively reducing the architectural constraints imposed on physical neural substrates required to perform probabilistic computing, be they biological or artificial. △ Less

Submitted 24 August, 2019; v1 submitted 21 September, 2018; originally announced September 2018.

Journal ref: Neural Networks 119C (2019) pp. 200-213

Accelerated physical emulation of Bayesian inference in spiking neural networks

Authors: Akos F. Kungl, Sebastian Schmitt, Johann Klähn, Paul Müller, Andreas Baumbach, Dominik Dold, Alexander Kugele, Nico Gürtler, Luziwei Leng, Eric Müller, Christoph Koke, Mitja Kleider, Christian Mauch, Oliver Breitwieser, Maurice Güttler, Dan Husmann, Kai Husmann, Joscha Ilmberger, Andreas Hartel, Vitali Karasenko, Andreas Grübl, Johannes Schemmel, Karlheinz Meier, Mihai A. Petrovici

Abstract: The massively parallel nature of biological information processing plays an important role for its superiority to human-engineered computing devices. In particular, it may hold the key to overcoming the von Neumann bottleneck that limits contemporary computer architectures. Physical-model neuromorphic devices seek to replicate not only this inherent parallelism, but also aspects of its microscopic… ▽ More The massively parallel nature of biological information processing plays an important role for its superiority to human-engineered computing devices. In particular, it may hold the key to overcoming the von Neumann bottleneck that limits contemporary computer architectures. Physical-model neuromorphic devices seek to replicate not only this inherent parallelism, but also aspects of its microscopic dynamics in analog circuits emulating neurons and synapses. However, these machines require network models that are not only adept at solving particular tasks, but that can also cope with the inherent imperfections of analog substrates. We present a spiking network model that performs Bayesian inference through sampling on the BrainScaleS neuromorphic platform, where we use it for generative and discriminative computations on visual data. By illustrating its functionality on this platform, we implicitly demonstrate its robustness to various substrate-specific distortive effects, as well as its accelerated capability for computation. These results showcase the advantages of brain-inspired physical computation and provide important building blocks for large-scale neuromorphic applications. △ Less

Submitted 1 April, 2020; v1 submitted 6 July, 2018; originally announced July 2018.

Comments: This preprint has been published 2019 November 14. Please cite as: Kungl A. F. et al. (2019) Accelerated Physical Emulation of Bayesian Inference in Spiking Neural Networks. Front. Neurosci. 13:1201. doi: 10.3389/fnins.2019.01201

Journal ref: Frontiers in Neuroscience - Neuromorphic Engineering, 14 November 2019

An Accelerated LIF Neuronal Network Array for a Large Scale Mixed-Signal Neuromorphic Architecture

Authors: Syed Ahmed Aamir, Yannik Stradmann, Paul Müller, Christian Pehle, Andreas Hartel, Andreas Grübl, Johannes Schemmel, Karlheinz Meier

Abstract: We present an array of leaky integrate-and-fire (LIF) neuron circuits designed for the second-generation BrainScaleS mixed-signal 65-nm CMOS neuromorphic hardware. The neuronal array is embedded in the analog network core of a scaled-down prototype HICANN-DLS chip. Designed as continuous-time circuits, the neurons are highly tunable and reconfigurable elements with accelerated dynamics. Each neuro… ▽ More We present an array of leaky integrate-and-fire (LIF) neuron circuits designed for the second-generation BrainScaleS mixed-signal 65-nm CMOS neuromorphic hardware. The neuronal array is embedded in the analog network core of a scaled-down prototype HICANN-DLS chip. Designed as continuous-time circuits, the neurons are highly tunable and reconfigurable elements with accelerated dynamics. Each neuron integrates input current from a multitude of incoming synapses and evokes a digital spike event output. The circuit offers a wide tuning range for synaptic and membrane time constants, as well as for refractory periods to cover a number of computational models. We elucidate our design methodology, underlying circuit design, calibration and measurement results from individual sub-circuits across multiple dies. The circuit dynamics match with the behavior of the LIF mathematical model. We further demonstrate a winner-take-all network on the prototype chip as a typical element of cortical processing. △ Less

Submitted 23 May, 2018; v1 submitted 5 April, 2018; originally announced April 2018.

Comments: 14 pages, 9 Figures, accepted for publication in IEEE Transactions on Circuits and Systems I

A Mixed-Signal Structured AdEx Neuron for Accelerated Neuromorphic Cores

Authors: Syed Ahmed Aamir, Paul Müller, Gerd Kiene, Laura Kriener, Yannik Stradmann, Andreas Grübl, Johannes Schemmel, Karlheinz Meier

Abstract: Here we describe a multi-compartment neuron circuit based on the Adaptive-Exponential I&F (AdEx) model, developed for the second-generation BrainScaleS hardware. Based on an existing modular Leaky Integrate-and-Fire (LIF) architecture designed in 65 nm CMOS, the circuit features exponential spike generation, neuronal adaptation, inter-compartmental connections as well as a conductance-based reset.… ▽ More Here we describe a multi-compartment neuron circuit based on the Adaptive-Exponential I&F (AdEx) model, developed for the second-generation BrainScaleS hardware. Based on an existing modular Leaky Integrate-and-Fire (LIF) architecture designed in 65 nm CMOS, the circuit features exponential spike generation, neuronal adaptation, inter-compartmental connections as well as a conductance-based reset. The design reproduces a diverse set of firing patterns observed in cortical pyramidal neurons. Further, it enables the emulation of sodium and calcium spikes, as well as N-Methyl-D-Aspartate (NMDA) plateau potentials known from apical and thin dendrites. We characterize the AdEx circuit extensions and exemplify how the interplay between passive and non-linear active signal processing enhances the computational capabilities of single (but structured) on-chip neurons. △ Less

Submitted 29 May, 2018; v1 submitted 5 April, 2018; originally announced April 2018.

Comments: 11 pages, 17 figures (including author photographs)

Full Wafer Redistribution and Wafer Embedding as Key Technologies for a Multi-Scale Neuromorphic Hardware Cluster

Authors: Kai Zoschke, Maurice Güttler, Lars Böttcher, Andreas Grübl, Dan Husmann, Johannes Schemmel, Karlheinz Meier, Oswin Ehrmann

Abstract: Together with the Kirchhoff-Institute for Physics(KIP) the Fraunhofer IZM has developed a full wafer redistribution and embedding technology as base for a large-scale neuromorphic hardware system. The paper will give an overview of the neuromorphic computing platform at the KIP and the associated hardware requirements which drove the described technological developments. In the first phase of the… ▽ More Together with the Kirchhoff-Institute for Physics(KIP) the Fraunhofer IZM has developed a full wafer redistribution and embedding technology as base for a large-scale neuromorphic hardware system. The paper will give an overview of the neuromorphic computing platform at the KIP and the associated hardware requirements which drove the described technological developments. In the first phase of the project standard redistribution technologies from wafer level packaging were adapted to enable a high density reticle-to-reticle routing on 200mm CMOS wafers. Neighboring reticles were interconnected across the scribe lines with an 8μm pitch routing based on semi-additive copper metallization. Passivation by photo sensitive benzocyclobutene was used to enable a second intra-reticle routing layer. Final IO pads with flash gold were generated on top of each reticle. With that concept neuromorphic systems based on full wafers could be assembled and tested. The fabricated high density inter-reticle routing revealed a very high yield of larger than 99.9%. In order to allow an upscaling of the system size to a large number of wafers with feasible effort a full wafer embedding concept for printed circuit boards was developed and proven in the second phase of the project. The wafers were thinned to 250μm and laminated with additional prepreg layers and copper foils into a core material. After lamination of the PCB panel the reticle IOs of the embedded wafer were accessed by micro via drilling, copper electroplating, lithography and subtractive etching of the PCB wiring structure. The created wiring with 50um line width enabled an access of the reticle IOs on the embedded wafer as well as a board level routing. The panels with the embedded wafers were subsequently stressed with up to 1000 thermal cycles between 0C and 100C and have shown no severe failure formation over the cycle time. △ Less

Submitted 15 January, 2018; originally announced January 2018.

Comments: Accepted at EPTC 2017

Deterministic networks for probabilistic computing

Authors: Jakob Jordan, Mihai A. Petrovici, Oliver Breitwieser, Johannes Schemmel, Karlheinz Meier, Markus Diesmann, Tom Tetzlaff

Abstract: Neural-network models of high-level brain functions such as memory recall and reasoning often rely on the presence of stochasticity. The majority of these models assumes that each neuron in the functional network is equipped with its own private source of randomness, often in the form of uncorrelated external noise. However, both in vivo and in silico, the number of noise sources is limited due to… ▽ More Neural-network models of high-level brain functions such as memory recall and reasoning often rely on the presence of stochasticity. The majority of these models assumes that each neuron in the functional network is equipped with its own private source of randomness, often in the form of uncorrelated external noise. However, both in vivo and in silico, the number of noise sources is limited due to space and bandwidth constraints. Hence, neurons in large networks usually need to share noise sources. Here, we show that the resulting shared-noise correlations can significantly impair the performance of stochastic network models. We demonstrate that this problem can be overcome by using deterministic recurrent neural networks as sources of uncorrelated noise, exploiting the decorrelating effect of inhibitory feedback. Consequently, even a single recurrent network of a few hundred neurons can serve as a natural noise source for large ensembles of functional networks, each comprising thousands of units. We successfully apply the proposed framework to a diverse set of binary-unit networks with different dimensionalities and entropies, as well as to a network reproducing handwritten digits with distinct predefined frequencies. Finally, we show that the same design transfers to functional networks of spiking neurons. △ Less

Submitted 7 November, 2017; v1 submitted 13 October, 2017; originally announced October 2017.

Comments: 22 pages, 11 figures

Spiking neurons with short-term synaptic plasticity form superior generative networks

Authors: Luziwei Leng, Roman Martel, Oliver Breitwieser, Ilja Bytschok, Walter Senn, Johannes Schemmel, Karlheinz Meier, Mihai A. Petrovici

Abstract: Spiking networks that perform probabilistic inference have been proposed both as models of cortical computation and as candidates for solving problems in machine learning. However, the evidence for spike-based computation being in any way superior to non-spiking alternatives remains scarce. We propose that short-term plasticity can provide spiking networks with distinct computational advantages co… ▽ More Spiking networks that perform probabilistic inference have been proposed both as models of cortical computation and as candidates for solving problems in machine learning. However, the evidence for spike-based computation being in any way superior to non-spiking alternatives remains scarce. We propose that short-term plasticity can provide spiking networks with distinct computational advantages compared to their classical counterparts. In this work, we use networks of leaky integrate-and-fire neurons that are trained to perform both discriminative and generative tasks in their forward and backward information processing paths, respectively. During training, the energy landscape associated with their dynamics becomes highly diverse, with deep attractor basins separated by high barriers. Classical algorithms solve this problem by employing various tempering techniques, which are both computationally demanding and require global state updates. We demonstrate how similar results can be achieved in spiking networks endowed with local short-term synaptic plasticity. Additionally, we discuss how these networks can even outperform tempering-based approaches when the training data is imbalanced. We thereby show how biologically inspired, local, spike-triggered synaptic dynamics based simply on a limited pool of synaptic resources can allow spiking networks to outperform their non-spiking relatives. △ Less

Submitted 10 October, 2017; v1 submitted 24 September, 2017; originally announced September 2017.

Comments: corrected typo in abstract

Consistency of extended Nelson-Siegel curve families with the Ho-Lee and Hull and White short rate models

Authors: Patricia Kisbye, Karem Meier

Abstract: Nelson and Siegel curves are widely used to fit the observed term structure of interest rates in a particular date. By the other hand, several interest rate models have been developed such their initial forward rate curve can be adjusted to any observed data, as the Ho-Lee and the Hull and White one factor models. In this work we study the evolution of the forward curve process for each of this mo… ▽ More Nelson and Siegel curves are widely used to fit the observed term structure of interest rates in a particular date. By the other hand, several interest rate models have been developed such their initial forward rate curve can be adjusted to any observed data, as the Ho-Lee and the Hull and White one factor models. In this work we study the evolution of the forward curve process for each of this models assuming that the initial curve is of Nelson-Siegel type. We conclude that the forward curve process produces curves belonging to a parametric family of curves that can be seen as extended Nelson and Siegel curves. △ Less

Submitted 8 July, 2017; originally announced July 2017.

Comments: 13 pages

MSC Class: 91G30

Spike-based probabilistic inference with correlated noise

Authors: Ilja Bytschok, Dominik Dold, Johannes Schemmel, Karlheinz Meier, Mihai A. Petrovici

Abstract: A steadily increasing body of evidence suggests that the brain performs probabilistic inference to interpret and respond to sensory input and that trial-to-trial variability in neural activity plays an important role. The neural sampling hypothesis interprets stochastic neural activity as sampling from an underlying probability distribution and has been shown to be compatible with biologically obs… ▽ More A steadily increasing body of evidence suggests that the brain performs probabilistic inference to interpret and respond to sensory input and that trial-to-trial variability in neural activity plays an important role. The neural sampling hypothesis interprets stochastic neural activity as sampling from an underlying probability distribution and has been shown to be compatible with biologically observed firing patterns. In many studies, uncorrelated noise is used as a source of stochasticity, discounting the fact that cortical neurons may share a significant portion of their presynaptic partners, which impacts their computation. This is relevant in biology and for implementations of neural networks where bandwidth constraints limit the amount of independent noise. When receiving correlated noise, the resulting correlations cannot be directly countered by changes in synaptic weights $W$. We show that this is contingent on the chosen coding: when changing the state space from $z\in\{0,1\}$ to $z'\in\{-1,1\}$, correlated noise has the exact same effect as changes in $W'$. The translation of the problem to the $\{-1,1\}$ space allows to find a weight configuration that compensates for the induced correlations. For an artificial embedding of sampling networks, this allows a straightforward transfer between platforms with different bandwidth constraints. The existence of the map** is important for learning. Since in the $\{-1,1\}$-coding the correlated noise can be compensated by parameter changes and the probability distribution can be kept invariant when changing the coding, the distribution will be found in the $\{0,1\}$-coding as well during learning, as demonstrated in simulations. Conclusively, sampling spiking networks are impervious to noise correlations when trained. If such computation happens in cortex, network plasticity does not need to take account of shared noise inputs. △ Less

Submitted 6 July, 2017; originally announced July 2017.

Comments: 3 pages, 1 figure

An Accelerated Analog Neuromorphic Hardware System Emulating NMDA- and Calcium-Based Non-Linear Dendrites

Authors: Johannes Schemmel, Laura Kriener, Paul Müller, Karlheinz Meier

Abstract: This paper presents an extension of the BrainScaleS accelerated analog neuromorphic hardware model. The scalable neuromorphic architecture is extended by the support for multi-compartment models and non-linear dendrites. These features are part of a \SI{65}{\nano\meter} prototype ASIC. It allows to emulate different spike types observed in cortical pyramidal neurons: NMDA plateau potentials, calci… ▽ More This paper presents an extension of the BrainScaleS accelerated analog neuromorphic hardware model. The scalable neuromorphic architecture is extended by the support for multi-compartment models and non-linear dendrites. These features are part of a \SI{65}{\nano\meter} prototype ASIC. It allows to emulate different spike types observed in cortical pyramidal neurons: NMDA plateau potentials, calcium and sodium spikes. By replicating some of the structures of these cells, they can be configured to perform coincidence detection within a single neuron. Built-in plasticity mechanisms can modify not only the synaptic weights, but also the dendritic synaptic composition to efficiently train large multi-compartment neurons. Transistor-level simulations demonstrate the functionality of the analog implementation and illustrate analogies to biological measurements. △ Less

Submitted 21 March, 2017; originally announced March 2017.

Comments: Accepted at IJCNN 2017

Pattern representation and recognition with accelerated analog neuromorphic systems

Authors: Mihai A. Petrovici, Sebastian Schmitt, Johann Klähn, David Stöckel, Anna Schroeder, Guillaume Bellec, Johannes Bill, Oliver Breitwieser, Ilja Bytschok, Andreas Grübl, Maurice Güttler, Andreas Hartel, Stephan Hartmann, Dan Husmann, Kai Husmann, Sebastian Jeltsch, Vitali Karasenko, Mitja Kleider, Christoph Koke, Alexander Kononov, Christian Mauch, Eric Müller, Paul Müller, Johannes Partzsch, Thomas Pfeil , et al. (11 additional authors not shown)

Abstract: Despite being originally inspired by the central nervous system, artificial neural networks have diverged from their biological archetypes as they have been remodeled to fit particular tasks. In this paper, we review several possibilites to reverse map these architectures to biologically more realistic spiking networks with the aim of emulating them on fast, low-power neuromorphic hardware. Since… ▽ More Despite being originally inspired by the central nervous system, artificial neural networks have diverged from their biological archetypes as they have been remodeled to fit particular tasks. In this paper, we review several possibilites to reverse map these architectures to biologically more realistic spiking networks with the aim of emulating them on fast, low-power neuromorphic hardware. Since many of these devices employ analog components, which cannot be perfectly controlled, finding ways to compensate for the resulting effects represents a key challenge. Here, we discuss three different strategies to address this problem: the addition of auxiliary network components for stabilizing activity, the utilization of inherently robust architectures and a training method for hardware-emulated networks that functions without perfect knowledge of the system's dynamics and parameters. For all three scenarios, we corroborate our theoretical considerations with experimental results on accelerated analog neuromorphic platforms. △ Less

Submitted 3 July, 2017; v1 submitted 17 March, 2017; originally announced March 2017.

Comments: accepted at ISCAS 2017

Journal ref: Circuits and Systems (ISCAS), 2017 IEEE International Symposium on

Robustness from structure: Inference with hierarchical spiking networks on analog neuromorphic hardware

Authors: Mihai A. Petrovici, Anna Schroeder, Oliver Breitwieser, Andreas Grübl, Johannes Schemmel, Karlheinz Meier

Abstract: How spiking networks are able to perform probabilistic inference is an intriguing question, not only for understanding information processing in the brain, but also for transferring these computational principles to neuromorphic silicon circuits. A number of computationally powerful spiking network models have been proposed, but most of them have only been tested, under ideal conditions, in softwa… ▽ More How spiking networks are able to perform probabilistic inference is an intriguing question, not only for understanding information processing in the brain, but also for transferring these computational principles to neuromorphic silicon circuits. A number of computationally powerful spiking network models have been proposed, but most of them have only been tested, under ideal conditions, in software simulations. Any implementation in an analog, physical system, be it in vivo or in silico, will generally lead to distorted dynamics due to the physical properties of the underlying substrate. In this paper, we discuss several such distortive effects that are difficult or impossible to remove by classical calibration routines or parameter training. We then argue that hierarchical networks of leaky integrate-and-fire neurons can offer the required robustness for physical implementation and demonstrate this with both software simulations and emulation on an accelerated analog neuromorphic device. △ Less

Submitted 12 March, 2017; originally announced March 2017.

Comments: accepted at IJCNN 2017

Journal ref: International Joint Conference on Neural Networks (IJCNN), 2017

A neuronal dynamics study on a neuromorphic chip

Authors: Wenyuan Li, Igor V. Ovchinnikov, Honglin Chen, Zhe Wang, Albert Lee, Hochul Lee, Carlos Cepeda, Robert N. Schwartz, Karlheinz Meier, Kang L. Wang

Abstract: Neuronal firing activities have attracted a lot of attention since a large population of spatiotemporal patterns in the brain is the basis for adaptive behavior and can also reveal the signs for various neurological disorders including Alzheimer's, schizophrenia, epilepsy and others. Here, we study the dynamics of a simple neuronal network using different sets of settings on a neuromorphic chip. W… ▽ More Neuronal firing activities have attracted a lot of attention since a large population of spatiotemporal patterns in the brain is the basis for adaptive behavior and can also reveal the signs for various neurological disorders including Alzheimer's, schizophrenia, epilepsy and others. Here, we study the dynamics of a simple neuronal network using different sets of settings on a neuromorphic chip. We observed three different types of collective neuronal firing activities, which agree with the clinical data taken from the brain. We constructed a brain phase diagram and showed that within the weak noise region, the brain is operating in an expected noise-induced phase (N-phase) rather than at a so-called self-organized critical boundary. The significance of this study is twofold: first, the deviation of neuronal activities from the normal brain could be symptomatic of diseases of the central nervous system, thus paving the way for new diagnostics and treatments; second, the normal brain states in the N-phase are optimal for computation and information processing. The latter may provide a way to establish powerful new computing paradigm using collective behavior of networks of spiking neurons. △ Less

Submitted 10 March, 2017; originally announced March 2017.

Neuromorphic Hardware In The Loop: Training a Deep Spiking Network on the BrainScaleS Wafer-Scale System

Authors: Sebastian Schmitt, Johann Klaehn, Guillaume Bellec, Andreas Gruebl, Maurice Guettler, Andreas Hartel, Stephan Hartmann, Dan Husmann, Kai Husmann, Vitali Karasenko, Mitja Kleider, Christoph Koke, Christian Mauch, Eric Mueller, Paul Mueller, Johannes Partzsch, Mihai A. Petrovici, Stefan Schiefer, Stefan Scholze, Bernhard Vogginger, Robert Legenstein, Wolfgang Maass, Christian Mayr, Johannes Schemmel, Karlheinz Meier

Abstract: Emulating spiking neural networks on analog neuromorphic hardware offers several advantages over simulating them on conventional computers, particularly in terms of speed and energy consumption. However, this usually comes at the cost of reduced control over the dynamics of the emulated networks. In this paper, we demonstrate how iterative training of a hardware-emulated network can compensate for… ▽ More Emulating spiking neural networks on analog neuromorphic hardware offers several advantages over simulating them on conventional computers, particularly in terms of speed and energy consumption. However, this usually comes at the cost of reduced control over the dynamics of the emulated networks. In this paper, we demonstrate how iterative training of a hardware-emulated network can compensate for anomalies induced by the analog substrate. We first convert a deep neural network trained in software to a spiking network on the BrainScaleS wafer-scale neuromorphic system, thereby enabling an acceleration factor of 10 000 compared to the biological time domain. This map** is followed by the in-the-loop training, where in each training step, the network activity is first recorded in hardware and then used to compute the parameter updates in software via backpropagation. An essential finding is that the parameter updates do not have to be precise, but only need to approximately follow the correct gradient, which simplifies the computation of updates. Using this approach, after only several tens of iterations, the spiking network shows an accuracy close to the ideal software-emulated prototype. The presented techniques show that deep spiking networks emulated on analog neuromorphic devices can attain good computational performance despite the inherent variations of the analog substrate. △ Less

Submitted 6 March, 2017; originally announced March 2017.

Comments: 8 pages, 10 figures, submitted to IJCNN 2017

Imaging structural transitions in organometallic molecules on Ag(100) for solar thermal energy storage

Authors: Jongweon Cho, Ivan V. Pechenezhskiy, Luis Berbil-Bautista, Steven K. Meier, K. Peter C. Vollhardt, Michael F. Crommie

Abstract: The use of opto-thermal molecular energy storage at the nanoscale creates new opportunities for powering future microdevices with flexible synthetic tailorability. Practical application of these molecular materials, however, requires a deeper microscopic understanding of how their behavior is altered by the presence of different types of substrates. Here we present single-molecule resolved scannin… ▽ More The use of opto-thermal molecular energy storage at the nanoscale creates new opportunities for powering future microdevices with flexible synthetic tailorability. Practical application of these molecular materials, however, requires a deeper microscopic understanding of how their behavior is altered by the presence of different types of substrates. Here we present single-molecule resolved scanning tunneling microscopy imaging of thermally- and optically-induced structural transitions in (fulvalene)tetracarbonyldiruthenium molecules adsorbed onto a Ag(100) surface as a prototype system. Both the parent complex and the photoisomer display distinct thermally-driven phase transformations when they are in contact with a Ag(100) surface. This behavior is consistent with the loss of carbonyl ligands due to strong molecule-surface coupling. Ultraviolet radiation induces marked structural changes only in the intact parent complex, thus indicating a photoisomerization reaction. These results demonstrate how stimuli-induced structural transitions in this class of molecule depend on the nature of the underlying substrate. △ Less

Submitted 28 February, 2017; originally announced March 2017.

Comments: 4 figures

Stochastic inference with spiking neurons in the high-conductance state

Authors: Mihai A. Petrovici, Johannes Bill, Ilja Bytschok, Johannes Schemmel, Karlheinz Meier

Abstract: The highly variable dynamics of neocortical circuits observed in vivo have been hypothesized to represent a signature of ongoing stochastic inference but stand in apparent contrast to the deterministic response of neurons measured in vitro. Based on a propagation of the membrane autocorrelation across spike bursts, we provide an analytical derivation of the neural activation function that holds fo… ▽ More The highly variable dynamics of neocortical circuits observed in vivo have been hypothesized to represent a signature of ongoing stochastic inference but stand in apparent contrast to the deterministic response of neurons measured in vitro. Based on a propagation of the membrane autocorrelation across spike bursts, we provide an analytical derivation of the neural activation function that holds for a large parameter space, including the high-conductance state. On this basis, we show how an ensemble of leaky integrate-and-fire neurons with conductance-based synapses embedded in a spiking environment can attain the correct firing statistics for sampling from a well-defined target distribution. For recurrent networks, we examine convergence toward stationarity in computer simulations and demonstrate sample-based Bayesian inference in a mixed graphical model. This points to a new computational role of high-conductance states and establishes a rigorous link between deterministic neuron models and functional stochastic dynamics on the network level. △ Less

Submitted 23 October, 2016; originally announced October 2016.

Journal ref: Phys. Rev. E 94, 042312 (2016)

Criticality or Supersymmetry Breaking ?

Authors: Igor V. Ovchinnikov, Wenyuan Li, Yuquan Sun, Robert N. Schwartz, Andrew E. Hudson, Karlheinz Meier, Kang L. Wang

Abstract: In many stochastic dynamical systems, ordinary chaotic behavior is preceded by a full-dimensional phase that exhibits 1/f-type power-spectra and/or scale-free statistics of (anti)instantons such as neuroavalanches, earthquakes, etc. In contrast with the phenomenological concept of self-organized criticality, the recently developed approximation-free supersymmetric theory of stochastic differential… ▽ More In many stochastic dynamical systems, ordinary chaotic behavior is preceded by a full-dimensional phase that exhibits 1/f-type power-spectra and/or scale-free statistics of (anti)instantons such as neuroavalanches, earthquakes, etc. In contrast with the phenomenological concept of self-organized criticality, the recently developed approximation-free supersymmetric theory of stochastic differential equations, or stochastics, (STS) identifies this phase as the noise-induced chaos (N-phase), i.e., the phase where the topological supersymmetry pertaining to all stochastic dynamical systems is broken spontaneously by the condensation of the noise-induced (anti-)instantons. Here, we support this picture in the context of neurodynamics. We study a 1D chain of neuron-like elements and find that the dynamics in the N-phase is indeed featured by positive stochastic Lyapunov exponents and dominated by (anti)instantonic processes of (creation)annihilation of kinks and antikinks, which can be viewed as predecessors of boundaries of neuroavalanches. We also construct the phase diagram of emulated stochastic neurodynamics on Spikey neuromorphic hardware and demonstrate that the width of the N-phase vanishes in the deterministic limit in accordance with STS. As a first result of the application of STS to neurodynamics comes the conclusion that a conscious brain can reside only in the N-phase. △ Less

Submitted 6 February, 2020; v1 submitted 30 August, 2016; originally announced September 2016.

Comments: elsevier format, updated refs

Journal ref: Symmetry 12, 805 (2020)

Demonstrating Hybrid Learning in a Flexible Neuromorphic Hardware System

Authors: Simon Friedmann, Johannes Schemmel, Andreas Gruebl, Andreas Hartel, Matthias Hock, Karlheinz Meier

Abstract: We present results from a new approach to learning and plasticity in neuromorphic hardware systems: to enable flexibility in implementable learning mechanisms while kee** high efficiency associated with neuromorphic implementations, we combine a general-purpose processor with full-custom analog elements. This processor is operating in parallel with a fully parallel neuromorphic system consisti… ▽ More We present results from a new approach to learning and plasticity in neuromorphic hardware systems: to enable flexibility in implementable learning mechanisms while kee** high efficiency associated with neuromorphic implementations, we combine a general-purpose processor with full-custom analog elements. This processor is operating in parallel with a fully parallel neuromorphic system consisting of an array of synapses connected to analog, continuous time neuron circuits. Novel analog correlation sensor circuits process spike events for each synapse in parallel and in real-time. The processor uses this pre-processing to compute new weights possibly using additional information following its program. Therefore, learning rules can be defined in software giving a large degree of flexibility. Synapses realize correlation detection geared towards Spike-Timing Dependent Plasticity (STDP) as central computational primitive in the analog domain. Operating at a speed-up factor of 1000 compared to biological time-scale, we measure time-constants from tens to hundreds of micro-seconds. We analyze variability across multiple chips and demonstrate learning using a multiplicative STDP rule. We conclude, that the presented approach will enable flexible and efficient learning as a platform for neuroscientific research and technological applications. △ Less

Submitted 13 October, 2016; v1 submitted 18 April, 2016; originally announced April 2016.

The high-conductance state enables neural sampling in networks of LIF neurons

Authors: Mihai A. Petrovici, Ilja Bytschok, Johannes Bill, Johannes Schemmel, Karlheinz Meier

Abstract: The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which explains how sample-based inference can be performed by networks of spiking neurons. One particular requirement of this approach is that the neural response functio… ▽ More The apparent stochasticity of in-vivo neural circuits has long been hypothesized to represent a signature of ongoing stochastic inference in the brain. More recently, a theoretical framework for neural sampling has been proposed, which explains how sample-based inference can be performed by networks of spiking neurons. One particular requirement of this approach is that the neural response function closely follows a logistic curve. Analytical approaches to calculating neural response functions have been the subject of many theoretical studies. In order to make the problem tractable, particular assumptions regarding the neural or synaptic parameters are usually made. However, biologically significant activity regimes exist which are not covered by these approaches: Under strong synaptic bombardment, as is often the case in cortex, the neuron is shifted into a high-conductance state (HCS) characterized by a small membrane time constant. In this regime, synaptic time constants and refractory periods dominate membrane dynamics. The core idea of our approach is to separately consider two different "modes" of spiking dynamics: burst spiking and transient quiescence, in which the neuron does not spike for longer periods. We treat the former by propagating the PDF of the effective membrane potential from spike to spike within a burst, while using a diffusion approximation for the latter. We find that our prediction of the neural response function closely matches simulation data. Moreover, in the HCS scenario, we show that the neural response function becomes symmetric and can be well approximated by a logistic function, thereby providing the correct dynamics in order to perform neural sampling. We hereby provide not only a normative framework for Bayesian inference in cortex, but also powerful applications of low-power, accelerated neuromorphic systems to relevant machine learning tasks. △ Less

Submitted 5 January, 2016; originally announced January 2016.

Comments: 3 pages, 1 figure

Data compression for the First G-APD Cherenkov Telescope

Authors: M. L. Ahnen, M. Balbo, M. Bergmann, A. Biland, T. Bretz, J. Buß, D. Dorner, S. Einecke, J. Freiwald, C. Hempfling, D. Hildebrand, G. Hughes, W. Lustermann, E. Lyard, K. Mannheim, K. Meier, S. Mueller, D. Neise, A. Neronov, A. -K. Overkem**, A. Paravac, F. Pauss, W. Rhode, T. Steinbring, F. Temme , et al. (5 additional authors not shown)

Abstract: The First Geiger-mode Avalanche photodiode (G-APD) Cherenkov Telescope (FACT) has been operating on the Canary island of La Palma since October 2011. Operations were automated so that the system can be operated remotely. Manual interaction is required only when the observation schedule is modified due to weather conditions or in case of unexpected events such as a mechanical failure. Automatic ope… ▽ More The First Geiger-mode Avalanche photodiode (G-APD) Cherenkov Telescope (FACT) has been operating on the Canary island of La Palma since October 2011. Operations were automated so that the system can be operated remotely. Manual interaction is required only when the observation schedule is modified due to weather conditions or in case of unexpected events such as a mechanical failure. Automatic operations enabled high data taking efficiency, which resulted in up to two terabytes of FITS files being recorded nightly and transferred from La Palma to the FACT archive at ISDC in Switzerland. Since long term storage of hundreds of terabytes of observations data is costly, data compression is mandatory. This paper discusses the design choices that were made to increase the compression ratio and speed of writing of the data with respect to existing compression algorithms. Following a more detailed motivation, the FACT compression algorithm along with the associated I/O layer is discussed. Eventually, the performances of the algorithm is compared to other approaches. △ Less

Submitted 19 June, 2015; originally announced June 2015.

Comments: 17 pages, accepted to Astronomy and Computing special issue on astronomical file formats

FACT - Monitoring Blazars at Very High Energies

Authors: D. Dorner, M. L. Ahnen, M. Bergmann, A. Biland, M. Balbo, T. Bretz, J. Buss, S. Einecke, J. Freiwald, C. Hempfling, D. Hildebrand, G. Hughes, W. Lustermann, K. Mannheim, K. Meier, S. Mueller, D. Neise, A. Neronov, A. -K. Overkem**, A. Paravac, F. Pauss, W. Rhode, T. Steinbring, F. Temme, J. Thaele , et al. (4 additional authors not shown)

Abstract: The First G-APD Cherenkov Telescope (FACT) was built on the Canary Island of La Palma in October 2011 as a proof of principle for silicon based photosensors in Cherenkov Astronomy. The scientific goal of the project is to study the variability of active galatic nuclei (AGN) at TeV energies. Observing a small sample of TeV blazars whenever possible, an unbiased data sample is collected. This allows… ▽ More The First G-APD Cherenkov Telescope (FACT) was built on the Canary Island of La Palma in October 2011 as a proof of principle for silicon based photosensors in Cherenkov Astronomy. The scientific goal of the project is to study the variability of active galatic nuclei (AGN) at TeV energies. Observing a small sample of TeV blazars whenever possible, an unbiased data sample is collected. This allows to study the variability of the selected objects on timescales from hours to years. Results from the first three years of monitoring will be presented. To provide quick flare alerts to the community and trigger multi-wavelength observations, a quick look analysis has been installed on-site providing results publicly online within the same night. In summer 2014, several flare alerts were issued. Results of the quick look analysis are summarized. △ Less

Submitted 9 February, 2015; originally announced February 2015.

Comments: 2014 Fermi Symposium proceedings - eConf C14102.1

The effect of heterogeneity on decorrelation mechanisms in spiking neural networks: a neuromorphic-hardware study

Authors: Thomas Pfeil, Jakob Jordan, Tom Tetzlaff, Andreas Grübl, Johannes Schemmel, Markus Diesmann, Karlheinz Meier

Abstract: High-level brain function such as memory, classification or reasoning can be realized by means of recurrent networks of simplified model neurons. Analog neuromorphic hardware constitutes a fast and energy efficient substrate for the implementation of such neural computing architectures in technical applications and neuroscientific research. The functional performance of neural networks is often cr… ▽ More High-level brain function such as memory, classification or reasoning can be realized by means of recurrent networks of simplified model neurons. Analog neuromorphic hardware constitutes a fast and energy efficient substrate for the implementation of such neural computing architectures in technical applications and neuroscientific research. The functional performance of neural networks is often critically dependent on the level of correlations in the neural activity. In finite networks, correlations are typically inevitable due to shared presynaptic input. Recent theoretical studies have shown that inhibitory feedback, abundant in biological neural networks, can actively suppress these shared-input correlations and thereby enable neurons to fire nearly independently. For networks of spiking neurons, the decorrelating effect of inhibitory feedback has so far been explicitly demonstrated only for homogeneous networks of neurons with linear sub-threshold dynamics. Theory, however, suggests that the effect is a general phenomenon, present in any system with sufficient inhibitory feedback, irrespective of the details of the network structure or the neuronal and synaptic properties. Here, we investigate the effect of network heterogeneity on correlations in sparse, random networks of inhibitory neurons with non-linear, conductance-based synapses. Emulations of these networks on the analog neuromorphic hardware system Spikey allow us to test the efficiency of decorrelation by inhibitory feedback in the presence of hardware-specific heterogeneities. The configurability of the hardware substrate enables us to modulate the extent of heterogeneity in a systematic manner. We selectively study the effects of shared input and recurrent connections on correlations in membrane potentials and spike trains. Our results confirm ... △ Less

Submitted 9 June, 2016; v1 submitted 28 November, 2014; originally announced November 2014.

Comments: 20 pages, 10 figures, supplements

Journal ref: Phys. Rev. X 6, 021023 (2016)

Probabilistic inference in discrete spaces can be implemented into networks of LIF neurons

Authors: Dimitri Probst, Mihai A. Petrovici, Ilja Bytschok, Johannes Bill, Dejan Pecevski, Johannes Schemmel, Karlheinz Meier

Abstract: The means by which cortical neural networks are able to efficiently solve inference problems remains an open question in computational neuroscience. Recently, abstract models of Bayesian computation in neural circuits have been proposed, but they lack a mechanistic interpretation at the single-cell level. In this article, we describe a complete theoretical framework for building networks of leaky… ▽ More The means by which cortical neural networks are able to efficiently solve inference problems remains an open question in computational neuroscience. Recently, abstract models of Bayesian computation in neural circuits have been proposed, but they lack a mechanistic interpretation at the single-cell level. In this article, we describe a complete theoretical framework for building networks of leaky integrate-and-fire neurons that can sample from arbitrary probability distributions over binary random variables. We test our framework for a model inference task based on a psychophysical phenomenon (the Knill-Kersten optical illusion) and further assess its performance when applied to randomly generated distributions. As the local computations performed by the network strongly depend on the interaction between neurons, we compare several types of couplings mediated by either single synapses or interneuron chains. Due to its robustness to substrate imperfections such as parameter noise and background noise correlations, our model is particularly interesting for implementation on novel, neuro-inspired computing architectures, which can thereby serve as a fast, low-power substrate for solving real-world inference problems. △ Less

Submitted 22 February, 2015; v1 submitted 20 October, 2014; originally announced October 2014.

Journal ref: Front. Comput. Neurosci. 9:13 (2015)

FACT -- Operation of the First G-APD Cherenkov Telescope

Authors: T. Bretz, A. Biland, J. Buß, V. Commichau, L. Djambazov, D. Dorner, S. Einecke, D. Eisenacher, J. Freiwald, O. Grimm, H. von Gunten, C. Haller, C. Hempfling, D. Hildebrand, G. Hughes, U. Horisberger, M. L. Knoetig, T. Krähenbühl, W. Lustermann, E. Lyard, K. Mannheim, K. Meier, S. Mueller, D. Neise, A. -K. Overkem** , et al. (11 additional authors not shown)

Abstract: Since more than two years, the First G-APD Cherenkov Telescope (FACT) is operating successfully at the Canary Island of La Palma. Apart from its purpose to serve as a monitoring facility for the brightest TeV blazars, it was built as a major step to establish solid state photon counters as detectors in Cherenkov astronomy. The camera of the First G-APD Cherenkov Telesope comprises 1440 Geiger-mo… ▽ More Since more than two years, the First G-APD Cherenkov Telescope (FACT) is operating successfully at the Canary Island of La Palma. Apart from its purpose to serve as a monitoring facility for the brightest TeV blazars, it was built as a major step to establish solid state photon counters as detectors in Cherenkov astronomy. The camera of the First G-APD Cherenkov Telesope comprises 1440 Geiger-mode avalanche photo diodes (G-APD aka. MPPC or SiPM) for photon detection. Since properties as the gain of G-APDs depend on temperature and the applied voltage, a real-time feedback system has been developed and implemented. To correct for the change introduced by temperature, several sensors have been placed close to the photon detectors. Their read out is used to calculate a corresponding voltage offset. In addition to temperature changes, changing current introduces a voltage drop in the supporting resistor network. To correct changes in the voltage drop introduced by varying photon flux from the night-sky background, the current is measured and the voltage drop calculated. To check the stability of the G-APD properties, dark count spectra with high statistics have been taken under different environmental conditions and been evaluated. The maximum data rate delivered by the camera is about 240 MB/s. The recorded data, which can exceed 1 TB in a moonless night, is compressed in real-time with a proprietary loss-less algorithm. The performance is better than gzip by almost a factor of two in compression ratio and speed. In total, two to three CPU cores are needed for data taking. In parallel, a quick-look analysis of the recently recorded data is executed on a second machine. Its result is publicly available within a few minutes after the data were taken. [...] △ Less

Submitted 8 July, 2014; originally announced July 2014.

Comments: 19th IEEE Real-Time Conference, Nara, Japan (2014)

Characterization and Compensation of Network-Level Anomalies in Mixed-Signal Neuromorphic Modeling Platforms

Authors: Mihai A. Petrovici, Bernhard Vogginger, Paul Müller, Oliver Breitwieser, Mikael Lundqvist, Lyle Muller, Matthias Ehrlich, Alain Destexhe, Anders Lansner, René Schüffny, Johannes Schemmel, Karlheinz Meier

Abstract: Advancing the size and complexity of neural network models leads to an ever increasing demand for computational resources for their simulation. Neuromorphic devices offer a number of advantages over conventional computing architectures, such as high emulation speed or low power consumption, but this usually comes at the price of reduced configurability and precision. In this article, we investigat… ▽ More Advancing the size and complexity of neural network models leads to an ever increasing demand for computational resources for their simulation. Neuromorphic devices offer a number of advantages over conventional computing architectures, such as high emulation speed or low power consumption, but this usually comes at the price of reduced configurability and precision. In this article, we investigate the consequences of several such factors that are common to neuromorphic devices, more specifically limited hardware resources, limited parameter configurability and parameter variations. Our final aim is to provide an array of methods for co** with such inevitable distortion mechanisms. As a platform for testing our proposed strategies, we use an executable system specification (ESS) of the BrainScaleS neuromorphic system, which has been designed as a universal emulation back-end for neuroscientific modeling. We address the most essential limitations of this device in detail and study their effects on three prototypical benchmark network models within a well-defined, systematic workflow. For each network model, we start by defining quantifiable functionality measures by which we then assess the effects of typical hardware-specific distortion mechanisms, both in idealized software simulations and on the ESS. For those effects that cause unacceptable deviations from the original network dynamics, we suggest generic compensation mechanisms and demonstrate their effectiveness. Both the suggested workflow and the investigated compensation mechanisms are largely back-end independent and do not require additional hardware configurability beyond the one required to emulate the benchmark networks in the first place. We hereby provide a generic methodological environment for configurable neuromorphic devices that are targeted at emulating large-scale, functional neural networks. △ Less

Submitted 10 February, 2015; v1 submitted 29 April, 2014; originally announced April 2014.

Journal ref: PLOS ONE, October 10th 2014

Calibration and performance of the photon sensor response of FACT -- The First G-APD Cherenkov telescope

Authors: A. Biland, T. Bretz, J. Buß, V. Commichau, L. Djambazov, D. Dorner, S. Einecke, D. Eisenacher, J. Freiwald, O. Grimm, H. von Gunten, C. Haller, C. Hempfling, D. Hildebrand, G. Hughes, U. Horisberger, M. L. Knoetig, T. Krähenbühl, W. Lustermann, E. Lyard, K. Mannheim, K. Meier, S. Mueller, D. Neise, A. -K. Overkem** , et al. (11 additional authors not shown)

Abstract: The First G-APD Cherenkov Telescope (FACT) is the first in-operation test of the performance of silicon photo detectors in Cherenkov Astronomy. For more than two years it is operated on La Palma, Canary Islands (Spain), for the purpose of long-term monitoring of astrophysical sources. For this, the performance of the photo detectors is crucial and therefore has been studied in great detail. Specia… ▽ More The First G-APD Cherenkov Telescope (FACT) is the first in-operation test of the performance of silicon photo detectors in Cherenkov Astronomy. For more than two years it is operated on La Palma, Canary Islands (Spain), for the purpose of long-term monitoring of astrophysical sources. For this, the performance of the photo detectors is crucial and therefore has been studied in great detail. Special care has been taken for their temperature and voltage dependence implementing a correction method to keep their properties stable. Several measurements have been carried out to monitor the performance. The measurements and their results are shown, demonstrating the stability of the gain below the percent level. The resulting stability of the whole system is discussed, nicely demonstrating that silicon photo detectors are perfectly suited for the usage in Cherenkov telescopes, especially for long-term monitoring purpose. △ Less

Submitted 30 July, 2014; v1 submitted 23 March, 2014; originally announced March 2014.

Journal ref: 2014 JINST 9 P10012

FACT -- The G-APD revolution in Cherenkov astronomy

Authors: T. Bretz, H. Anderhub, M. Backes, A. Biland, V. Boccone, I. Braun, J. Buß, F. Cadoux, V. Commichau, L. Djambazov, D. Dorner, S. Einecke, D. Eisenacher, A. Gendotti, O. Grimm, H. von Gunten, C. Haller, C. Hempfling, D. Hildebrand, U. Horisberger, B. Huber, K. S. Kim, M. L. Knoetig, J. H. Köhne, T. Krähenbühl , et al. (31 additional authors not shown)

Abstract: Since two years, the FACT telescope is operating on the Canary Island of La Palma. Apart from its purpose to serve as a monitoring facility for the brightest TeV blazars, it was built as a major step to establish solid state photon counters as detectors in Cherenkov astronomy. The camera of the First G-APD Cherenkov Telesope comprises 1440 Geiger-mode avalanche photo diodes (G-APD), equipped with… ▽ More Since two years, the FACT telescope is operating on the Canary Island of La Palma. Apart from its purpose to serve as a monitoring facility for the brightest TeV blazars, it was built as a major step to establish solid state photon counters as detectors in Cherenkov astronomy. The camera of the First G-APD Cherenkov Telesope comprises 1440 Geiger-mode avalanche photo diodes (G-APD), equipped with solid light guides to increase the effective light collection area of each sensor. Since no sense-line is available, a special challenge is to keep the applied voltage stable although the current drawn by the G-APD depends on the flux of night-sky background photons significantly varying with ambient light conditions. Methods have been developed to keep the temperature and voltage dependent response of the G-APDs stable during operation. As a cross-check, dark count spectra with high statistics have been taken under different environmental conditions. In this presentation, the project, the developed methods and the experience from two years of operation of the first G-APD based camera in Cherenkov astronomy under changing environmental conditions will be presented. △ Less

Submitted 14 March, 2014; originally announced March 2014.

Comments: Proceedings of the Nuclear Science Symposium and Medical Imaging Conference (IEEE-NSS/MIC), 2013

Stochastic inference with deterministic spiking neurons

Authors: Mihai A. Petrovici, Johannes Bill, Ilja Bytschok, Johannes Schemmel, Karlheinz Meier

Abstract: The seemingly stochastic transient dynamics of neocortical circuits observed in vivo have been hypothesized to represent a signature of ongoing stochastic inference. In vitro neurons, on the other hand, exhibit a highly deterministic response to various types of stimulation. We show that an ensemble of deterministic leaky integrate-and-fire neurons embedded in a spiking noisy environment can attai… ▽ More The seemingly stochastic transient dynamics of neocortical circuits observed in vivo have been hypothesized to represent a signature of ongoing stochastic inference. In vitro neurons, on the other hand, exhibit a highly deterministic response to various types of stimulation. We show that an ensemble of deterministic leaky integrate-and-fire neurons embedded in a spiking noisy environment can attain the correct firing statistics in order to sample from a well-defined target distribution. We provide an analytical derivation of the activation function on the single cell level; for recurrent networks, we examine convergence towards stationarity in computer simulations and demonstrate sample-based Bayesian inference in a mixed graphical model. This establishes a rigorous link between deterministic neuron models and functional stochastic dynamics on the network level. △ Less

Submitted 13 November, 2013; originally announced November 2013.

Comments: 6 pages, 4 figures

MSC Class: 92-08 ACM Class: C.1.3; I.5.1

FACT - Long-term Monitoring of Bright TeV-Blazars

Authors: D. Dorner, A. Biland, T. Bretz, J. Buss, S. Einecke, D. Eisenacher, D. Hildebrand, M. L. Knötig, T. Krähenbühl, W. Lustermann, K. Mannheim, K. Meier, D. Neise, A. -K. Overkem**, A. Paravac, F. Pauss, W. Rhode, M. Ribordy, T. Steinbring, F. Temme, J. Thaele, R. Walter, Q. Weitzel, M. Zänglein

Abstract: Since October 2011, the First G-APD Cherenkov Telescope (FACT) is operated successfully on the Canary Island of La Palma. Apart from the proof of principle for the use of G-APDs in Cherenkov telescopes, the major goal of the project is the dedicated long-term monitoring of a small sample of bright TeV blazars. The unique properties of G-APDs permit stable observations also during strong moon light… ▽ More Since October 2011, the First G-APD Cherenkov Telescope (FACT) is operated successfully on the Canary Island of La Palma. Apart from the proof of principle for the use of G-APDs in Cherenkov telescopes, the major goal of the project is the dedicated long-term monitoring of a small sample of bright TeV blazars. The unique properties of G-APDs permit stable observations also during strong moon light. Thus a superior sampling density is provided on time scales at which the blazar variability amplitudes are expected to be largest, as exemplified by the spectacular variations of Mrk 501 observed in June 2012. While still in commissioning, FACT monitored bright blazars like Mrk 421 and Mrk 501 during the past 1.5 years so far. Preliminary results including the Mrk 501 flare from June 2012 will be presented. △ Less

Submitted 3 November, 2013; originally announced November 2013.

Comments: 4 pages, 4 figures, presented at the 33rd ICRC (2013)

Report number: FACT/ICRC2013/686

Neuromorphic Learning towards Nano Second Precision

Authors: Thomas Pfeil, Anne-Christine Scherzer, Johannes Schemmel, Karlheinz Meier

Abstract: Temporal coding is one approach to representing information in spiking neural networks. An example of its application is the location of sounds by barn owls that requires especially precise temporal coding. Dependent upon the azimuthal angle, the arrival times of sound signals are shifted between both ears. In order to deter- mine these interaural time differences, the phase difference of the sign… ▽ More Temporal coding is one approach to representing information in spiking neural networks. An example of its application is the location of sounds by barn owls that requires especially precise temporal coding. Dependent upon the azimuthal angle, the arrival times of sound signals are shifted between both ears. In order to deter- mine these interaural time differences, the phase difference of the signals is measured. We implemented this biologically inspired network on a neuromorphic hardware system and demonstrate spike-timing dependent plasticity on an analog, highly accelerated hardware substrate. Our neuromorphic implementation enables the resolution of time differences of less than 50 ns. On-chip Hebbian learning mechanisms select inputs from a pool of neurons which code for the same sound frequency. Hence, noise caused by different synaptic delays across these inputs is reduced. Furthermore, learning compensates for variations on neuronal and synaptic parameters caused by device mismatch intrinsic to the neuromorphic substrate. △ Less

Submitted 18 September, 2013; v1 submitted 17 September, 2013; originally announced September 2013.

Comments: 7 pages, 7 figures, presented at IJCNN 2013 in Dallas, TX, USA. IJCNN 2013. Corrected version with updated STDP curves IJCNN 2013

Journal ref: Neural Networks (IJCNN), The 2013 International Joint Conference on , pp. 1-5, 4-9 Aug. 2013

FACT - Threshold prediction for higher duty cycle and improved scheduling

Authors: T. Bretz, A. Biland, J. Buß, D. Dorner, S. Einecke, D. Eisenacher, D. Hildebrand, M. L. Knoetig, T. Krähenbühl, W. Lustermann, K. Mannheim, K. Meier, D. Neise, A. -K. Overkem**, A. Paravac, F. Pauss, W. Rhode, M. Ribordy, T. Steinbring, F. Temme, J. Thaele, P. Vogler, R. Walter, Q. Weitzel, M. Zänglein

Abstract: The First G-APD Cherenkov telescope (FACT) is the first telescope using silicon photon detectors (G-APD aka. SiPM). The use of Silicon devices promise a higher photon detection efficiency, more robustness and higher precision than photo-multiplier tubes. Being operated during different light-conditions, the threshold settings of a Cherenkov telescope have to be adapted to feature the lowest possib… ▽ More The First G-APD Cherenkov telescope (FACT) is the first telescope using silicon photon detectors (G-APD aka. SiPM). The use of Silicon devices promise a higher photon detection efficiency, more robustness and higher precision than photo-multiplier tubes. Being operated during different light-conditions, the threshold settings of a Cherenkov telescope have to be adapted to feature the lowest possible threshold but also an efficient suppression of triggers from night-sky background photons. Usually this threshold is set either by experience or a mini-ratescan. Since the measured current through the sensors is directly correlated with the noise level, the current can be used to set the best threshold at any time. Due to the correlation between the physical threshold and the final energy threshold, the current can also be used as a measure for the energy threshold of any observation. This presentation introduces a method which uses the properties of the moon and the source position to predict the currents and the corresponding energy threshold for every upcoming observation allowing to adapt the observation schedule accordingly. △ Less

Submitted 7 August, 2013; originally announced August 2013.

Report number: FACT/ICRC2013/720

FACT - How stable are the silicon photon detectors?

Authors: T. Bretz, A. Biland, J. Buß, D. Dorner, S. Einecke, D. Eisenacher, D. Hildebrand, M. L. Knoetig, T. Krähenbühl, W. Lustermann, K. Mannheim, K. Meier, D. Neise, A. -K. Overkem**, A. Paravac, F. Pauss, W. Rhode, M. Ribordy, T. Steinbring, F. Temme, J. Thaele, P. Vogler, R. Walter, Q. Weitzel, M. Zänglein

Abstract: The First G-APD Cherenkov telescope (FACT) is the first telescope using silicon photon detectors (G-APD aka. SiPM). The use of Silicon devices promise a higher photon detection efficiency, more robustness and higher precision than photo-multiplier tubes. Since the properties of G-APDs depend on auxiliary parameters like temperature, a feedback system adapting the applied voltage accordingly is man… ▽ More The First G-APD Cherenkov telescope (FACT) is the first telescope using silicon photon detectors (G-APD aka. SiPM). The use of Silicon devices promise a higher photon detection efficiency, more robustness and higher precision than photo-multiplier tubes. Since the properties of G-APDs depend on auxiliary parameters like temperature, a feedback system adapting the applied voltage accordingly is mandatory. In this presentation, the feedback system, developed and in operation for FACT, is presented. Using the extraction of a single photon-equivalent (pe) spectrum as a reference, it can be proven that the sensors can be operated with very high precision. The extraction of the single-pe, its spectrum up to 10\,pe, its properties and their precision, as well as their long-term behavior during operation are discussed. As a by product a single pulse template is obtained. It is shown that with the presented method, an additional external calibration device can be omitted. The presented method is essential for the application of G-APDs in future projects in Cherenkov astronomy and is supposed to result in a more stable and precise operation than possible with photo-multiplier tubes. △ Less

Submitted 7 August, 2013; originally announced August 2013.

Report number: FACT/ICRC2013/683

FACT - The First G-APD Cherenkov Telescope: Status and Results

Authors: T. Bretz, H. Anderhub, M. Backes, A. Biland, V. Boccone, I. Braun, T. Bretz, J. Buss, F. Cadoux, V. Commichau, L. Djambazov, D. Dorner, S. Einecke, D. Eisenacher, A. Gendotti, O. Grimm, H. von Gunten, C. Haller, D. Hildebrand, U. Horisberger, B. Huber, K. -S. Kim, M. L. Knoetig, J. -H. Koehne, T. Kraehenbuehl , et al. (30 additional authors not shown)

Abstract: The First G-APD Cherenkov telescope (FACT) is the first telescope using silicon photon detectors (G-APD aka. SiPM). It is built on the mount of the HEGRA CT3 telescope, still located at the Observatorio del Roque de los Muchachos, and it is successfully in operation since Oct. 2011. The use of Silicon devices promises a higher photon detection efficiency, more robustness and higher precision than… ▽ More The First G-APD Cherenkov telescope (FACT) is the first telescope using silicon photon detectors (G-APD aka. SiPM). It is built on the mount of the HEGRA CT3 telescope, still located at the Observatorio del Roque de los Muchachos, and it is successfully in operation since Oct. 2011. The use of Silicon devices promises a higher photon detection efficiency, more robustness and higher precision than photo-multiplier tubes. The FACT collaboration is investigating with which precision these devices can be operated on the long-term. Currently, the telescope is successfully operated from remote and robotic operation is under development. During the past months of operation, the foreseen monitoring program of the brightest known TeV blazars has been carried out, and first physics results have been obtained including a strong flare of Mrk501. An instantaneous flare alert system is already in a testing phase. This presentation will give an overview of the project and summarize its goals, status and first results. △ Less

Submitted 7 August, 2013; originally announced August 2013.

Report number: FACT/ICRC2013/682

FACT: Towards Robotic Operation of an Imaging Air Cherenkov Telescope

Authors: A. Biland, H. Anderhub, M. Backes, V. Boccone, I. Braun, T. Bretz, J. Buss, F. Cadoux, V. Commichau, L. Djambazov, D. Dorner, S. Einecke, D. Eisenacher, A. Gendotti, O. Grimm, H. von Gunten, C. Haller, D. Hildebrand, U. Horisberger, B. Huber, K. -S. Kim, M. L. Knoetig, J. -H. Koehne, T. Kraehenbuehl, B. Krumm , et al. (29 additional authors not shown)

Abstract: The First G-APD Cherenkov Telescope (FACT) became operational at La Palma in October 2011. Since summer 2012, due to very smooth and stable operation, it is the first telescope of its kind that is routinely operated from remote, without the need for a data-taking crew on site. In addition, many standard tasks of operation are executed automatically without the need for manual interaction. Based on… ▽ More The First G-APD Cherenkov Telescope (FACT) became operational at La Palma in October 2011. Since summer 2012, due to very smooth and stable operation, it is the first telescope of its kind that is routinely operated from remote, without the need for a data-taking crew on site. In addition, many standard tasks of operation are executed automatically without the need for manual interaction. Based on the experience gained so far, some alterations to improve the safety of the system are under development to allow robotic operation in the future. We present the setup and precautions used to implement remote operations and the experience gained so far, as well as the work towards robotic operation. △ Less

Submitted 30 July, 2013; originally announced July 2013.

Comments: Poster presented at the 33rd ICRC (2013), 4 pages, 3 figures

Report number: FACT/ICRC2013/708

FACT - Long-term stability and observations during strong Moon light

Authors: M. L. Knoetig, A. Biland, T. Bretz, J. Buß, D. Dorner, S. Einecke, D. Eisenacher, D. Hildebrand, T. Krähenbühl, W. Lustermann, K. Mannheim, K. Meier, D. Neise, A. -K. Overkem**, A. Paravac, F. Pauss, W. Rhode, M. Ribordy, T. Steinbring, F. Temme, J. Thaele, P. Vogler, R. Walter, Q. Weitzel, M. Zänglein

Abstract: The First G-APD Cherenkov Telescope (FACT) is the first Cherenkov telescope equipped with a camera made of silicon photon detectors (G-APD aka. SiPM). Since October 2011, it is regularly taking data on the Canary Island of La Palma. G-APDs are ideal detectors for Cherenkov telescopes as they are robust and stable. Furthermore, the insensitivity of G-APDs towards strong ambient light allows to cond… ▽ More The First G-APD Cherenkov Telescope (FACT) is the first Cherenkov telescope equipped with a camera made of silicon photon detectors (G-APD aka. SiPM). Since October 2011, it is regularly taking data on the Canary Island of La Palma. G-APDs are ideal detectors for Cherenkov telescopes as they are robust and stable. Furthermore, the insensitivity of G-APDs towards strong ambient light allows to conduct observations during bright Moon and twilight. This gain in observation time is essential for the long-term monitoring of bright TeV blazars. During the commissioning phase, hundreds of hours of data (including data from the the Crab Nebula) were taken in order to understand the performance and sensitivity of the instrument. The data cover a wide range of observation conditions including different weather conditions, different zenith angles and different light conditions (ranging from dark night to direct full Moon). We use a new parmetrisation of the Moon light background to enhance our scheduling and to monitor the atmosphere. With the data from 1.5 years, the long-term stability and the performance of the camera during Moon light is studied and compared to that achieved with photomultiplier tubes so far. △ Less

Submitted 24 July, 2013; v1 submitted 23 July, 2013; originally announced July 2013.

Comments: 3 pages, 3 figures, FACT Contribution to the 33rd International Cosmic Ray Conference (ICRC), Rio de Janeiro

Report number: FACT/ICRC2013/695