-
Vertical shear instability with dust evolution and consistent cooling times. On the importance of the initial dust distribution
Authors:
Thomas Pfeil,
Til Birnstiel,
Hubert Klahr
Abstract:
Context. Gas in protoplanetary disks mostly cools via thermal accommodation with dust particles. Thermal relaxation is thus highly sensitive to the local dust size distributions and the spatial distribution of the grains. So far, the interplay between thermal relaxation and gas turbulence has not been dynamically modeled in hydrodynamic simulations of protoplanetary disks with dust.
Aims. We aim…
▽ More
Context. Gas in protoplanetary disks mostly cools via thermal accommodation with dust particles. Thermal relaxation is thus highly sensitive to the local dust size distributions and the spatial distribution of the grains. So far, the interplay between thermal relaxation and gas turbulence has not been dynamically modeled in hydrodynamic simulations of protoplanetary disks with dust.
Aims. We aim to study the effects of the vertical shear instability (VSI) on the thermal relaxation times, and vice versa. We are particularly interested in the influence of the initial dust grain size on the VSI and whether the emerging turbulence is sustained over long timescales.
Results. We find that the emergence of the VSI is strongly dependent on the initial dust grain size. Coagulation also counteracts the emergence of hydrodynamic turbulence in our simulations, as shown by others before. Starting a simulation with larger grains (100 $μ$m) generally leads to a less turbulent outcome. While the inner disk regions (within $\sim$ 70 au) develop turbulence in all three simulations, we find that the simulations with larger particles do not develop VSI in the outer disk.
Conclusions. Our simulations with dynamically calculated thermal accommodation times based on the drifting and settling dust distribution show that the VSI, once developed in a disk, can be sustained over long timescales, even if grain growth is occurring. The VSI corrugates the dust layer and even diffuses the smaller grains into the upper atmosphere, where they can cool the gas. Whether the instability can emerge for a specific stratification depends on the initial dust grain sizes and the initial dust scale height. If the grains are initially $\gtrsim$ 100 $μ$m and if the level of turbulence is initially assumed to be low, we find no VSI turbulence in the outer disk regions.
△ Less
Submitted 14 June, 2024;
originally announced June 2024.
-
Dust Coagulation Reconciles Protoplanetary Disk Observations with the Vertical Shear Instability. I. Dust Coagulation and the VSI Dead Zone
Authors:
Thomas Pfeil,
Til Birnstiel,
Hubert Klahr
Abstract:
Protoplanetary disks exhibit a vertical gradient in angular momentum, rendering them susceptible to the Vertical Shear Instability (VSI). The most important condition for the onset of this mechanism is a short timescale of thermal relaxation ($\lesssim 0.1$ orbital timescales). Simulations of fully VSI active disks are characterized by turbulent, vertically extended dust layers. This is in contrad…
▽ More
Protoplanetary disks exhibit a vertical gradient in angular momentum, rendering them susceptible to the Vertical Shear Instability (VSI). The most important condition for the onset of this mechanism is a short timescale of thermal relaxation ($\lesssim 0.1$ orbital timescales). Simulations of fully VSI active disks are characterized by turbulent, vertically extended dust layers. This is in contradiction with recent observations of the outer regions of some protoplanetary disks, which appear highly settled. In this work, we demonstrate that the process of dust coagulation can diminish the cooling rate of the gas in the outer disk and extinct the VSI activity. Our findings indicate that the turbulence strength is especially susceptible to variations in the fragmentation velocity of the grains. A small fragmentation velocity of $\approx 100 \mathrm{\, cm \,s^{-1}}$ results in a fully turbulent simulation, whereas a value of $\approx 400 \mathrm{\, cm \,s^{-1}}$ results in a laminar outer disk, being consistent with observations. We show that VSI turbulence remains relatively unaffected by variations in the maximum particle size in the inner disk regions. However, we find that dust coagulation can significantly suppress the occurrence of VSI turbulence at larger distances from the central star.
△ Less
Submitted 15 December, 2023; v1 submitted 11 October, 2023;
originally announced October 2023.
-
A Neural Network Subgrid Model of the Early Stages of Planet Formation
Authors:
Thomas Pfeil,
Miles Cranmer,
Shirley Ho,
Philip J. Armitage,
Tilman Birnstiel,
Hubert Klahr
Abstract:
Planet formation is a multi-scale process in which the coagulation of $\mathrm{μm}$-sized dust grains in protoplanetary disks is strongly influenced by the hydrodynamic processes on scales of astronomical units ($\approx 1.5\times 10^8 \,\mathrm{km}$). Studies are therefore dependent on subgrid models to emulate the micro physics of dust coagulation on top of a large scale hydrodynamic simulation.…
▽ More
Planet formation is a multi-scale process in which the coagulation of $\mathrm{μm}$-sized dust grains in protoplanetary disks is strongly influenced by the hydrodynamic processes on scales of astronomical units ($\approx 1.5\times 10^8 \,\mathrm{km}$). Studies are therefore dependent on subgrid models to emulate the micro physics of dust coagulation on top of a large scale hydrodynamic simulation. Numerical simulations which include the relevant physical effects are complex and computationally expensive. Here, we present a fast and accurate learned effective model for dust coagulation, trained on data from high resolution numerical coagulation simulations. Our model captures details of the dust coagulation process that were so far not tractable with other dust coagulation prescriptions with similar computational efficiency.
△ Less
Submitted 8 November, 2022;
originally announced November 2022.
-
Hybrid SNN-ANN: Energy-Efficient Classification and Object Detection for Event-Based Vision
Authors:
Alexander Kugele,
Thomas Pfeil,
Michael Pfeiffer,
Elisabetta Chicca
Abstract:
Event-based vision sensors encode local pixel-wise brightness changes in streams of events rather than image frames and yield sparse, energy-efficient encodings of scenes, in addition to low latency, high dynamic range, and lack of motion blur. Recent progress in object recognition from event-based sensors has come from conversions of deep neural networks, trained with backpropagation. However, us…
▽ More
Event-based vision sensors encode local pixel-wise brightness changes in streams of events rather than image frames and yield sparse, energy-efficient encodings of scenes, in addition to low latency, high dynamic range, and lack of motion blur. Recent progress in object recognition from event-based sensors has come from conversions of deep neural networks, trained with backpropagation. However, using these approaches for event streams requires a transformation to a synchronous paradigm, which not only loses computational efficiency, but also misses opportunities to extract spatio-temporal features. In this article we propose a hybrid architecture for end-to-end training of deep neural networks for event-based pattern recognition and object detection, combining a spiking neural network (SNN) backbone for efficient event-based feature extraction, and a subsequent analog neural network (ANN) head to solve synchronous classification and detection tasks. This is achieved by combining standard backpropagation with surrogate gradient training to propagate gradients through the SNN. Hybrid SNN-ANNs can be trained without conversion, and result in highly accurate networks that are substantially more computationally efficient than their ANN counterparts. We demonstrate results on event-based classification and object detection datasets, in which only the architecture of the ANN heads need to be adapted to the tasks, and no conversion of the event-based input is necessary. Since ANNs and SNNs require different hardware paradigms to maximize their efficiency, we envision that SNN backbone and ANN head can be executed on different processing units, and thus analyze the necessary bandwidth to communicate between the two parts. Hybrid networks are promising architectures to further advance machine learning approaches for event-based vision, without having to compromise on efficiency.
△ Less
Submitted 6 December, 2021;
originally announced December 2021.
-
SOSP: Efficiently Capturing Global Correlations by Second-Order Structured Pruning
Authors:
Manuel Nonnenmacher,
Thomas Pfeil,
Ingo Steinwart,
David Reeb
Abstract:
Pruning neural networks reduces inference time and memory costs. On standard hardware, these benefits will be especially prominent if coarse-grained structures, like feature maps, are pruned. We devise two novel saliency-based methods for second-order structured pruning (SOSP) which include correlations among all structures and layers. Our main method SOSP-H employs an innovative second-order appr…
▽ More
Pruning neural networks reduces inference time and memory costs. On standard hardware, these benefits will be especially prominent if coarse-grained structures, like feature maps, are pruned. We devise two novel saliency-based methods for second-order structured pruning (SOSP) which include correlations among all structures and layers. Our main method SOSP-H employs an innovative second-order approximation, which enables saliency evaluations by fast Hessian-vector products. SOSP-H thereby scales like a first-order method despite taking into account the full Hessian. We validate SOSP-H by comparing it to our second method SOSP-I that uses a well-established Hessian approximation, and to numerous state-of-the-art methods. While SOSP-H performs on par or better in terms of accuracy, it has clear advantages in terms of scalability and efficiency. This allowed us to scale SOSP-H to large-scale vision tasks, even though it captures correlations across all layers of the network. To underscore the global nature of our pruning methods, we evaluate their performance not only by removing structures from a pretrained network, but also by detecting architectural bottlenecks. We show that our algorithms allow to systematically reveal architectural bottlenecks, which we then remove to further increase the accuracy of the networks.
△ Less
Submitted 30 June, 2022; v1 submitted 19 October, 2021;
originally announced October 2021.
-
High Resolution Parameter Study of the Vertical Shear Instability II: Dependence on temperature gradient and cooling time
Authors:
Natascha Manger,
Thomas Pfeil,
Hubert Klahr
Abstract:
A certain appeal to the alpha model for turbulence and related viscosity in accretion disks was that one scales the Reynolds stresses simply on the thermal pressure, assuming that turbulence driven by a certain mechanism will attain a characteristic Mach number in its velocity fluctuations. Besides the notion that there are different mechanism driving turbulence and angular momentum transport in a…
▽ More
A certain appeal to the alpha model for turbulence and related viscosity in accretion disks was that one scales the Reynolds stresses simply on the thermal pressure, assuming that turbulence driven by a certain mechanism will attain a characteristic Mach number in its velocity fluctuations. Besides the notion that there are different mechanism driving turbulence and angular momentum transport in a disk, we also find that within a single instability mechanism, here the Vertical Shear Instability, stresses do not linearly scale with thermal pressure. Here we demonstrate in numerical simulations the effect of the gas temperature gradient and the thermal relaxation time on the average stresses generated in the non-linear stage of the instability. We find that the stresses scale with the square of the exponent of the radial temperature profile at least for a range of $d \log T /d \log R = [-0.5, -1]$, beyond which the pressure scale height varies too much over the simulation domain, to provide clear results. Stresses are also dependent on thermal relaxation times, provided they are longer than $10^{-3}$ orbital periods. The strong dependence of viscous transport of angular momentum on the local conditions in the disk (especially temperature, temperature gradient, and surface density/optical depth) challenges the ideas of viscosity leading to smooth density distributions, opening a route for structure (ring) formation and time variable mass accretion.
△ Less
Submitted 3 September, 2021;
originally announced September 2021.
-
ItNet: iterative neural networks with small graphs for accurate, efficient and anytime semantic segmentation
Authors:
Thomas Pfeil
Abstract:
Deep neural networks have usually to be compressed and accelerated for their usage in low-power, e.g. mobile, devices. Recently, massively-parallel hardware accelerators were developed that offer high throughput and low latency at low power by utilizing in-memory computation. However, to exploit these benefits the computational graph of a neural network has to fit into the in-computation memory of…
▽ More
Deep neural networks have usually to be compressed and accelerated for their usage in low-power, e.g. mobile, devices. Recently, massively-parallel hardware accelerators were developed that offer high throughput and low latency at low power by utilizing in-memory computation. However, to exploit these benefits the computational graph of a neural network has to fit into the in-computation memory of these hardware systems that is usually rather limited in size. In this study, we introduce a class of network models that have a small memory footprint in terms of their computational graphs. To this end, the graph is designed to contain loops by iteratively executing a single network building block. Furthermore, the trade-off between accuracy and latency of these so-called iterative neural networks is improved by adding multiple intermediate outputs during both training and inference. We show state-of-the-art results for semantic segmentation on the CamVid and Cityscapes datasets that are especially demanding in terms of computational resources. In ablation studies, the improvement of network training by intermediate network outputs as well as the trade-off between weight sharing over iterations and the network size are investigated.
△ Less
Submitted 3 August, 2021; v1 submitted 21 January, 2021;
originally announced January 2021.
-
The Sandwich Mode for Vertical Shear Instability in Protoplanetary Disks
Authors:
Thomas Pfeil,
Hubert Klahr
Abstract:
Turbulence has a profound impact on the evolution of gas and dust in protoplanetary disks (PPDs), from driving the collisions and the diffusion of dust grains, to the concentration of pebbles in giant vortices, thus, facilitating planetesimal formation. The Vertical Shear Instability (VSI) is a hydrodynamic mechanism, operating in PPDs if the local rate of thermal relaxation is high enough. Previo…
▽ More
Turbulence has a profound impact on the evolution of gas and dust in protoplanetary disks (PPDs), from driving the collisions and the diffusion of dust grains, to the concentration of pebbles in giant vortices, thus, facilitating planetesimal formation. The Vertical Shear Instability (VSI) is a hydrodynamic mechanism, operating in PPDs if the local rate of thermal relaxation is high enough. Previous studies of the VSI have, however, relied on the assumption of constant cooling rates, or neglected the finite coupling time between the gas particles and the dust grains. Here, we present the results of hydrodynamic simulations of PPDs with the PLUTO code that include a more realistic thermal relaxation prescription, which enables us to study the VSI in the optically thick and optically thin parts of the disk under consideration of the thermal dust-gas coupling. We show the VSI to cause turbulence even in the optically thick inner regions of PPDs in our two- and three-dimensional simulations. The collisional decoupling of dust and gas particles in the upper atmosphere and the correspondingly inefficient thermal relaxation rates lead to the dam** of the VSI turbulence. Long-lived anticyclonic vortices form in our three-dimensional simulation. These structures emerge from the turbulence in the VSI-active layer, persist over hundreds of orbits and extend vertically over the whole extent of the turbulent region. We conclude that the VSI leads to turbulence and the formation of long-lived dust traps within $\pm$3 pressure scale heights distance from the disk midplane
△ Less
Submitted 16 July, 2021; v1 submitted 25 August, 2020;
originally announced August 2020.
-
Map** the Conditions for Hydrodynamic Instability on Steady State Accretion Models of Protoplanetary Disks
Authors:
Thomas Pfeil,
Hubert Klahr
Abstract:
Hydrodynamical instabilities in disks around young stars depend on the thermodynamic stratification of the disk and on the local rate of thermal relaxation. Here, we map the spatial extent of unstable regions for the Vertical Shear Instability (VSI), the Convective OverStability (COS), and the amplification of vortices via the Subcritical Baroclinic Instability (SBI). We use steady state accretion…
▽ More
Hydrodynamical instabilities in disks around young stars depend on the thermodynamic stratification of the disk and on the local rate of thermal relaxation. Here, we map the spatial extent of unstable regions for the Vertical Shear Instability (VSI), the Convective OverStability (COS), and the amplification of vortices via the Subcritical Baroclinic Instability (SBI). We use steady state accretion disk models, including stellar irradiation, accretion heating and radiative transfer. We determine the local radial and vertical stratification and thermal relaxation rate in the disk, in dependence of the stellar mass, disk mass and mass accretion rate. We find that passive regions of disks - i.e. the midplane temperature dominated by irradiation - are COS unstable about one pressure scale height above the midplane and VSI unstable at radii $> 10 \, \text{au}$. Vortex amplification via SBI should operate in most parts of active and passive disks. For active parts of disks (midplane temperature determined by accretion power) COS can become active down to the midplane. Same is true for the VSI because of the vertically adiabatic stratification of an internally heated disk. If hydro instabilities or other non-ideal MHD processes are able to create $α$-stresses ($> 10^{-5}$) and released accretion energy leads to internal heating of the disk, hydrodynamical instabilities are likely to operate in significant parts of the planet forming zones in disks around young stars, driving gas accretion and flow structure formation. Thus hydro-instabilities are viable candidates to explain the rings and vortices observed with ALMA and VLT.
△ Less
Submitted 3 February, 2019; v1 submitted 30 August, 2018;
originally announced August 2018.
-
The streaming rollout of deep networks - towards fully model-parallel execution
Authors:
Volker Fischer,
Jan Köhler,
Thomas Pfeil
Abstract:
Deep neural networks, and in particular recurrent networks, are promising candidates to control autonomous agents that interact in real-time with the physical world. However, this requires a seamless integration of temporal features into the network's architecture. For the training of and inference with recurrent neural networks, they are usually rolled out over time, and different rollouts exist.…
▽ More
Deep neural networks, and in particular recurrent networks, are promising candidates to control autonomous agents that interact in real-time with the physical world. However, this requires a seamless integration of temporal features into the network's architecture. For the training of and inference with recurrent neural networks, they are usually rolled out over time, and different rollouts exist. Conventionally during inference, the layers of a network are computed in a sequential manner resulting in sparse temporal integration of information and long response times. In this study, we present a theoretical framework to describe rollouts, the level of model-parallelization they induce, and demonstrate differences in solving specific tasks. We prove that certain rollouts, also for networks with only skip and no recurrent connections, enable earlier and more frequent responses, and show empirically that these early responses have better performance. The streaming rollout maximizes these properties and enables a fully parallel execution of the network reducing runtime on massively parallel devices. Finally, we provide an open-source toolbox to design, train, evaluate, and interact with streaming rollouts.
△ Less
Submitted 2 November, 2018; v1 submitted 13 June, 2018;
originally announced June 2018.
-
Instabilities and Flow Structures in Protoplanetary Disks: Setting the Stage for Planetesimal Formation
Authors:
Hubert Klahr,
Thomas Pfeil,
Andreas Schreiber
Abstract:
This chapter highlights the properties of turbulence and meso-scale flow structures in protoplanetary disks and their role in the planet formation process. Here we focus on the formation of planetesimals from a gravitational collapse of a pebble cloud. Large scale and long lived flow structures - vortices and zonal flows - are a consequence of weak magneto and hydrodynamic instabilities in the pre…
▽ More
This chapter highlights the properties of turbulence and meso-scale flow structures in protoplanetary disks and their role in the planet formation process. Here we focus on the formation of planetesimals from a gravitational collapse of a pebble cloud. Large scale and long lived flow structures - vortices and zonal flows - are a consequence of weak magneto and hydrodynamic instabilities in the pressure and entropy stratified quasi-Keplerian shear flow interacting with the fast rotation of the disk. The vortices and zonal flows on the other hand are particle traps tap** into the radial pebble flux of the disk, leading to locally sufficient accumulations to trigger gravitational collapse, directly converting pebbles to many kilometer sized planetesimals. This collapse is moderated by the streaming instability, which is a back-reaction from the particle accumulations onto the gas flow. Without trap** pebbles and increasing thus the local solid to gas ratio, this back-reaction would ultimately prevent the formation of planetsimals via turbulent diffusion. The formation of long lived flow structures is therefore a necessary condition for an efficient and fast formation of planetesimals.
△ Less
Submitted 4 December, 2018; v1 submitted 11 June, 2018;
originally announced June 2018.
-
Pattern representation and recognition with accelerated analog neuromorphic systems
Authors:
Mihai A. Petrovici,
Sebastian Schmitt,
Johann Klähn,
David Stöckel,
Anna Schroeder,
Guillaume Bellec,
Johannes Bill,
Oliver Breitwieser,
Ilja Bytschok,
Andreas Grübl,
Maurice Güttler,
Andreas Hartel,
Stephan Hartmann,
Dan Husmann,
Kai Husmann,
Sebastian Jeltsch,
Vitali Karasenko,
Mitja Kleider,
Christoph Koke,
Alexander Kononov,
Christian Mauch,
Eric Müller,
Paul Müller,
Johannes Partzsch,
Thomas Pfeil
, et al. (11 additional authors not shown)
Abstract:
Despite being originally inspired by the central nervous system, artificial neural networks have diverged from their biological archetypes as they have been remodeled to fit particular tasks. In this paper, we review several possibilites to reverse map these architectures to biologically more realistic spiking networks with the aim of emulating them on fast, low-power neuromorphic hardware. Since…
▽ More
Despite being originally inspired by the central nervous system, artificial neural networks have diverged from their biological archetypes as they have been remodeled to fit particular tasks. In this paper, we review several possibilites to reverse map these architectures to biologically more realistic spiking networks with the aim of emulating them on fast, low-power neuromorphic hardware. Since many of these devices employ analog components, which cannot be perfectly controlled, finding ways to compensate for the resulting effects represents a key challenge. Here, we discuss three different strategies to address this problem: the addition of auxiliary network components for stabilizing activity, the utilization of inherently robust architectures and a training method for hardware-emulated networks that functions without perfect knowledge of the system's dynamics and parameters. For all three scenarios, we corroborate our theoretical considerations with experimental results on accelerated analog neuromorphic platforms.
△ Less
Submitted 3 July, 2017; v1 submitted 17 March, 2017;
originally announced March 2017.
-
The effect of heterogeneity on decorrelation mechanisms in spiking neural networks: a neuromorphic-hardware study
Authors:
Thomas Pfeil,
Jakob Jordan,
Tom Tetzlaff,
Andreas Grübl,
Johannes Schemmel,
Markus Diesmann,
Karlheinz Meier
Abstract:
High-level brain function such as memory, classification or reasoning can be realized by means of recurrent networks of simplified model neurons. Analog neuromorphic hardware constitutes a fast and energy efficient substrate for the implementation of such neural computing architectures in technical applications and neuroscientific research. The functional performance of neural networks is often cr…
▽ More
High-level brain function such as memory, classification or reasoning can be realized by means of recurrent networks of simplified model neurons. Analog neuromorphic hardware constitutes a fast and energy efficient substrate for the implementation of such neural computing architectures in technical applications and neuroscientific research. The functional performance of neural networks is often critically dependent on the level of correlations in the neural activity. In finite networks, correlations are typically inevitable due to shared presynaptic input. Recent theoretical studies have shown that inhibitory feedback, abundant in biological neural networks, can actively suppress these shared-input correlations and thereby enable neurons to fire nearly independently. For networks of spiking neurons, the decorrelating effect of inhibitory feedback has so far been explicitly demonstrated only for homogeneous networks of neurons with linear sub-threshold dynamics. Theory, however, suggests that the effect is a general phenomenon, present in any system with sufficient inhibitory feedback, irrespective of the details of the network structure or the neuronal and synaptic properties. Here, we investigate the effect of network heterogeneity on correlations in sparse, random networks of inhibitory neurons with non-linear, conductance-based synapses. Emulations of these networks on the analog neuromorphic hardware system Spikey allow us to test the efficiency of decorrelation by inhibitory feedback in the presence of hardware-specific heterogeneities. The configurability of the hardware substrate enables us to modulate the extent of heterogeneity in a systematic manner. We selectively study the effects of shared input and recurrent connections on correlations in membrane potentials and spike trains. Our results confirm ...
△ Less
Submitted 9 June, 2016; v1 submitted 28 November, 2014;
originally announced November 2014.
-
Neuromorphic Learning towards Nano Second Precision
Authors:
Thomas Pfeil,
Anne-Christine Scherzer,
Johannes Schemmel,
Karlheinz Meier
Abstract:
Temporal coding is one approach to representing information in spiking neural networks. An example of its application is the location of sounds by barn owls that requires especially precise temporal coding. Dependent upon the azimuthal angle, the arrival times of sound signals are shifted between both ears. In order to deter- mine these interaural time differences, the phase difference of the sign…
▽ More
Temporal coding is one approach to representing information in spiking neural networks. An example of its application is the location of sounds by barn owls that requires especially precise temporal coding. Dependent upon the azimuthal angle, the arrival times of sound signals are shifted between both ears. In order to deter- mine these interaural time differences, the phase difference of the signals is measured. We implemented this biologically inspired network on a neuromorphic hardware system and demonstrate spike-timing dependent plasticity on an analog, highly accelerated hardware substrate. Our neuromorphic implementation enables the resolution of time differences of less than 50 ns. On-chip Hebbian learning mechanisms select inputs from a pool of neurons which code for the same sound frequency. Hence, noise caused by different synaptic delays across these inputs is reduced. Furthermore, learning compensates for variations on neuronal and synaptic parameters caused by device mismatch intrinsic to the neuromorphic substrate.
△ Less
Submitted 18 September, 2013; v1 submitted 17 September, 2013;
originally announced September 2013.
-
Six networks on a universal neuromorphic computing substrate
Authors:
Thomas Pfeil,
Andreas Grübl,
Sebastian Jeltsch,
Eric Müller,
Paul Müller,
Mihai A. Petrovici,
Michael Schmuker,
Daniel Brüderle,
Johannes Schemmel,
Karlheinz Meier
Abstract:
In this study, we present a highly configurable neuromorphic computing substrate and use it for emulating several types of neural networks. At the heart of this system lies a mixed-signal chip, with analog implementations of neurons and synapses and digital transmission of action potentials. Major advantages of this emulation device, which has been explicitly designed as a universal neural network…
▽ More
In this study, we present a highly configurable neuromorphic computing substrate and use it for emulating several types of neural networks. At the heart of this system lies a mixed-signal chip, with analog implementations of neurons and synapses and digital transmission of action potentials. Major advantages of this emulation device, which has been explicitly designed as a universal neural network emulator, are its inherent parallelism and high acceleration factor compared to conventional computers. Its configurability allows the realization of almost arbitrary network topologies and the use of widely varied neuronal and synaptic parameters. Fixed-pattern noise inherent to analog circuitry is reduced by calibration routines. An integrated development environment allows neuroscientists to operate the device without any prior knowledge of neuromorphic circuit design. As a showcase for the capabilities of the system, we describe the successful emulation of six different neural networks which cover a broad spectrum of both structure and functionality.
△ Less
Submitted 21 February, 2013; v1 submitted 26 October, 2012;
originally announced October 2012.
-
Is a 4-bit synaptic weight resolution enough? - Constraints on enabling spike-timing dependent plasticity in neuromorphic hardware
Authors:
Thomas Pfeil,
Tobias C. Potjans,
Sven Schrader,
Wiebke Potjans,
Johannes Schemmel,
Markus Diesmann,
Karlheinz Meier
Abstract:
Large-scale neuromorphic hardware systems typically bear the trade-off between detail level and required chip resources. Especially when implementing spike-timing-dependent plasticity, reduction in resources leads to limitations as compared to floating point precision. By design, a natural modification that saves resources would be reducing synaptic weight resolution. In this study, we give an est…
▽ More
Large-scale neuromorphic hardware systems typically bear the trade-off between detail level and required chip resources. Especially when implementing spike-timing-dependent plasticity, reduction in resources leads to limitations as compared to floating point precision. By design, a natural modification that saves resources would be reducing synaptic weight resolution. In this study, we give an estimate for the impact of synaptic weight discretization on different levels, ranging from random walks of individual weights to computer simulations of spiking neural networks. The FACETS wafer-scale hardware system offers a 4-bit resolution of synaptic weights, which is shown to be sufficient within the scope of our network benchmark. Our findings indicate that increasing the resolution may not even be useful in light of further restrictions of customized mixed-signal synapses. In addition, variations due to production imperfections are investigated and shown to be uncritical in the context of the presented study. Our results represent a general framework for setting up and configuring hardware-constrained synapses. We suggest how weight discretization could be considered for other backends dedicated to large-scale simulations. Thus, our proposition of a good hardware verification practice may rise synergy effects between hardware developers and neuroscientists.
△ Less
Submitted 28 November, 2014; v1 submitted 30 January, 2012;
originally announced January 2012.
-
A Comprehensive Workflow for General-Purpose Neural Modeling with Highly Configurable Neuromorphic Hardware Systems
Authors:
Daniel Brüderle,
Mihai A. Petrovici,
Bernhard Vogginger,
Matthias Ehrlich,
Thomas Pfeil,
Sebastian Millner,
Andreas Grübl,
Karsten Wendt,
Eric Müller,
Marc-Olivier Schwartz,
Dan Husmann de Oliveira,
Sebastian Jeltsch,
Johannes Fieres,
Moritz Schilling,
Paul Müller,
Oliver Breitwieser,
Venelin Petkov,
Lyle Muller,
Andrew P. Davison,
Pradeep Krishnamurthy,
Jens Kremkow,
Mikael Lundqvist,
Eilif Muller,
Johannes Partzsch,
Stefan Scholze
, et al. (9 additional authors not shown)
Abstract:
In this paper we present a methodological framework that meets novel requirements emerging from upcoming types of accelerated and highly configurable neuromorphic hardware systems. We describe in detail a device with 45 million programmable and dynamic synapses that is currently under development, and we sketch the conceptual challenges that arise from taking this platform into operation. More spe…
▽ More
In this paper we present a methodological framework that meets novel requirements emerging from upcoming types of accelerated and highly configurable neuromorphic hardware systems. We describe in detail a device with 45 million programmable and dynamic synapses that is currently under development, and we sketch the conceptual challenges that arise from taking this platform into operation. More specifically, we aim at the establishment of this neuromorphic system as a flexible and neuroscientifically valuable modeling tool that can be used by non-hardware-experts. We consider various functional aspects to be crucial for this purpose, and we introduce a consistent workflow with detailed descriptions of all involved modules that implement the suggested steps: The integration of the hardware interface into the simulator-independent model description language PyNN; a fully automated translation between the PyNN domain and appropriate hardware configurations; an executable specification of the future neuromorphic system that can be seamlessly integrated into this biology-to-hardware map** process as a test bench for all software layers and possible hardware design modifications; an evaluation scheme that deploys models from a dedicated benchmark library, compares the results generated by virtual or prototype hardware devices with reference software simulations and analyzes the differences. The integration of these components into one hardware-software workflow provides an ecosystem for ongoing preparative studies that support the hardware design process and represents the basis for the maturity of the model-to-hardware map** software. The functionality and flexibility of the latter is proven with a variety of experimental results.
△ Less
Submitted 21 July, 2011; v1 submitted 12 November, 2010;
originally announced November 2010.
