Showing 1–7 of 7 results for author: Stapmanns, J

Runtime Construction of Large-Scale Spiking Neuronal Network Models on GPU Devices

Authors: Bruno Golosio, Jose Villamar, Gianmarco Tiddia, Elena Pastorelli, Jonas Stapmanns, Viviana Fanti, Pier Stanislao Paolucci, Abigail Morrison, Johanna Senk

Abstract: Simulation speed matters for neuroscientific research: this includes not only how quickly the simulated model time of a large-scale spiking neuronal network progresses, but also how long it takes to instantiate the network model in computer memory. On the hardware side, acceleration via highly parallel GPUs is being increasingly utilized. On the software side, code generation approaches ensure hig… ▽ More Simulation speed matters for neuroscientific research: this includes not only how quickly the simulated model time of a large-scale spiking neuronal network progresses, but also how long it takes to instantiate the network model in computer memory. On the hardware side, acceleration via highly parallel GPUs is being increasingly utilized. On the software side, code generation approaches ensure highly optimized code, at the expense of repeated code regeneration and recompilation after modifications to the network model. Aiming for a greater flexibility with respect to iterative model changes, here we propose a new method for creating network connections interactively, dynamically, and directly in GPU memory through a set of commonly used high-level connection rules. We validate the simulation performance with both consumer and data center GPUs on two neuroscientifically relevant models: a cortical microcircuit of about 77,000 leaky-integrate-and-fire neuron models and 300 million static synapses, and a two-population network recurrently connected using a variety of connection rules. With our proposed ad hoc network instantiation, both network construction and simulation times are comparable or shorter than those obtained with other state-of-the-art simulation technologies, while still meeting the flexibility demands of explorative network modeling. △ Less

Submitted 16 June, 2023; originally announced June 2023.

Comments: 29 pages, 9 figures

Journal ref: Appl. Sci. 2023, 13(17), 9598

Phenomenological modeling of diverse and heterogeneous synaptic dynamics at natural density

Authors: Agnes Korcsak-Gorzo, Charl Linssen, Jasper Albers, Stefan Dasbach, Renato Duarte, Susanne Kunkel, Abigail Morrison, Johanna Senk, Jonas Stapmanns, Tom Tetzlaff, Markus Diesmann, Sacha J. van Albada

Abstract: This chapter sheds light on the synaptic organization of the brain from the perspective of computational neuroscience. It provides an introductory overview on how to account for empirical data in mathematical models, implement such models in software, and perform simulations reflecting experiments. This path is demonstrated with respect to four key aspects of synaptic signaling: the connectivity o… ▽ More This chapter sheds light on the synaptic organization of the brain from the perspective of computational neuroscience. It provides an introductory overview on how to account for empirical data in mathematical models, implement such models in software, and perform simulations reflecting experiments. This path is demonstrated with respect to four key aspects of synaptic signaling: the connectivity of brain networks, synaptic transmission, synaptic plasticity, and the heterogeneity across synapses. Each step and aspect of the modeling and simulation workflow comes with its own challenges and pitfalls, which are highlighted and addressed. △ Less

Submitted 19 February, 2023; v1 submitted 10 December, 2022; originally announced December 2022.

Comments: 38 pages, 5 figures, LaTeX; added two figures, clarified and extended formulations, updated format, added references

Gell-Mann-Low criticality in neural networks

Authors: Lorenzo Tiberi, Jonas Stapmanns, Tobias Kühn, Thomas Luu, David Dahmen, Moritz Helias

Abstract: Criticality is deeply related to optimal computational capacity. The lack of a renormalized theory of critical brain dynamics, however, so far limits insights into this form of biological information processing to mean-field results. These methods neglect a key feature of critical systems: the interaction between degrees of freedom across all length scales, which allows for complex nonlinear compu… ▽ More Criticality is deeply related to optimal computational capacity. The lack of a renormalized theory of critical brain dynamics, however, so far limits insights into this form of biological information processing to mean-field results. These methods neglect a key feature of critical systems: the interaction between degrees of freedom across all length scales, which allows for complex nonlinear computation. We present a renormalized theory of a prototypical neural field theory, the stochastic Wilson-Cowan equation. We compute the flow of couplings, which parameterize interactions on increasing length scales. Despite similarities with the Kardar-Parisi-Zhang model, the theory is of a Gell-Mann-Low type, the archetypal form of a renormalizable quantum field theory. Here, nonlinear couplings vanish, flowing towards the Gaussian fixed point, but logarithmically slowly, thus remaining effective on most scales. We show this critical structure of interactions to implement a desirable trade-off between linearity, optimal for information storage, and nonlinearity, required for computation. △ Less

Submitted 5 October, 2021; originally announced October 2021.

Event-based update of synapses in voltage-based learning rules

Authors: Jonas Stapmanns, Jan Hahne, Moritz Helias, Matthias Bolten, Markus Diesmann, David Dahmen

Abstract: Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. Synapses therefore require continuous information to update their strength which a priori nece… ▽ More Due to the point-like nature of neuronal spiking, efficient neural network simulators often employ event-based simulation schemes for synapses. Yet many types of synaptic plasticity rely on the membrane potential of the postsynaptic cell as a third factor in addition to pre- and postsynaptic spike times. Synapses therefore require continuous information to update their strength which a priori necessitates a continuous update in a time-driven manner. The latter hinders scaling of simulations to realistic cortical network sizes and relevant time scales for learning. Here, we derive two efficient algorithms for archiving postsynaptic membrane potentials, both compatible with modern simulation engines based on event-based synapse updates. We theoretically contrast the two algorithms with a time-driven synapse update scheme to analyze advantages in terms of memory and computations. We further present a reference implementation in the spiking neural network simulator NEST for two prototypical voltage-based plasticity rules: the Clopath rule and the Urbanczik-Senn rule. For both rules, the two event-based algorithms significantly outperform the time-driven scheme. Depending on the amount of data to be stored for plasticity, which heavily differs between the rules, a strong performance increase can be achieved by compressing or sampling of information on membrane potentials. Our results on computational efficiency related to archiving of information provide guidelines for the design of learning rules in order to make them practically usable in large-scale networks. △ Less

Submitted 10 March, 2021; v1 submitted 18 September, 2020; originally announced September 2020.

Comments: 45 pages, 13 figures, 7 tables

Self-consistent formulations for stochastic nonlinear neuronal dynamics

Authors: Jonas Stapmanns, Tobias Kühn, David Dahmen, Thomas Luu, Carsten Honerkamp, Moritz Helias

Abstract: Neural dynamics is often investigated with tools from bifurcation theory. However, many neuron models are stochastic, mimicking fluctuations in the input from unknown parts of the brain or the spiking nature of signals. Noise changes the dynamics with respect to the deterministic model; in particular bifurcation theory cannot be applied. We formulate stochastic neuronal dynamics in the Martin-Sigg… ▽ More Neural dynamics is often investigated with tools from bifurcation theory. However, many neuron models are stochastic, mimicking fluctuations in the input from unknown parts of the brain or the spiking nature of signals. Noise changes the dynamics with respect to the deterministic model; in particular bifurcation theory cannot be applied. We formulate stochastic neuronal dynamics in the Martin-Siggia-Rose de Dominicis-Janssen (MSRDJ) formalism and present the fluctuation expansion of the effective action and the functional renormalization group (fRG) as two systematic ways to incorporate corrections to the mean dynamics and time-dependent statistics due to fluctuations in the presence of nonlinear neuronal gain. To formulate self-consistency equations, we derive a fundamental link between the effective action in the Onsager-Machlup(OM) formalism, which allows the study of phase transitions, and the MSRDJ effective action, which is computationally advantageous. These results in particular allow the derivation of an OM effective action for systems with non-Gaussian noise. This approach naturally leads to effective deterministic equations for the first moment of the stochastic system; they explain how nonlinearities and noise cooperate to produce memory effects. Moreover, the MSRDJ formulation yields an effective linear system that has identical power spectra and linear response. Starting from the better known loopwise approximation, we then discuss the use of the fRG as a method to obtain self-consistency beyond the mean. We present a new efficient truncation scheme for the hierarchy of flow equations for the vertex functions by adapting the Blaizot, Méndez and Wschebor approximation from the derivative expansion to the vertex expansion. The methods are presented by means of the simplest possible example of a stochastic differential equation that has generic features of neuronal dynamics. △ Less

Submitted 8 April, 2022; v1 submitted 21 December, 2018; originally announced December 2018.

Comments: Equivalent to published version, including two minor typo fixes in Eq (6) and Fig 6. All conclusions unchanged. 7 figures

Journal ref: Phys. Rev. E 101, 042124 (2020)

Thermodynamic properties of the Shastry-Sutherland model from quantum Monte Carlo simulations

Authors: Stefan Wessel, Ido Niesen, Jonas Stapmanns, B. Normand, Frédéric Mila, Philippe Corboz, Andreas Honecker

Abstract: We investigate the minus-sign problem that afflicts quantum Monte Carlo (QMC) simulations of frustrated quantum spin systems, focusing on spin S=1/2, two spatial dimensions, and the extended Shastry-Sutherland model. We show that formulating the Hamiltonian in the diagonal dimer basis leads to a sign problem that becomes negligible at low temperatures for small and intermediate values of the ratio… ▽ More We investigate the minus-sign problem that afflicts quantum Monte Carlo (QMC) simulations of frustrated quantum spin systems, focusing on spin S=1/2, two spatial dimensions, and the extended Shastry-Sutherland model. We show that formulating the Hamiltonian in the diagonal dimer basis leads to a sign problem that becomes negligible at low temperatures for small and intermediate values of the ratio of the inter- and intradimer couplings. This is a consequence of the fact that the product state of dimer singlets is the exact ground state both of the extended Shastry-Sutherland model and of a corresponding "sign-problem-free" model, obtained by changing the signs of all positive off-diagonal matrix elements in the dimer basis. By exploiting this insight, we map the sign problem throughout the extended parameter space from the Shastry-Sutherland to the fully frustrated bilayer model and compare it with the phase diagram computed by tensor-network methods. We use QMC to compute with high accuracy the temperature dependence of the magnetic specific heat and susceptibility of the Shastry-Sutherland model for large systems up to a coupling ratio of 0.526(1) and down to zero temperature. For larger coupling ratios, our QMC results assist us in benchmarking the evolution of the thermodynamic properties by systematic comparison with exact diagonalization calculations and interpolated high-temperature series expansions. △ Less

Submitted 30 November, 2018; v1 submitted 6 August, 2018; originally announced August 2018.

Comments: 13 pages including 10 figures; published version with minor changes and corrections

Journal ref: Phys. Rev. B 98, 174432 (2018)

Thermal Critical Points and Quantum Critical End Point in the Frustrated Bilayer Heisenberg Antiferromagnet

Authors: Jonas Stapmanns, Philippe Corboz, Frederic Mila, Andreas Honecker, Bruce Normand, Stefan Wessel

Abstract: We consider the finite-temperature phase diagram of the $S = 1/2$ frustrated Heisenberg bilayer. Although this two-dimensional system may show magnetic order only at zero temperature, we demonstrate the presence of a line of finite-temperature critical points related to the line of first-order transitions between the dimer-singlet and -triplet regimes. We show by high-precision quantum Monte Carlo… ▽ More We consider the finite-temperature phase diagram of the $S = 1/2$ frustrated Heisenberg bilayer. Although this two-dimensional system may show magnetic order only at zero temperature, we demonstrate the presence of a line of finite-temperature critical points related to the line of first-order transitions between the dimer-singlet and -triplet regimes. We show by high-precision quantum Monte Carlo simulations, which are sign-free in the fully frustrated limit, that this critical point is in the Ising universality class. At zero temperature, the continuous transition between the ordered bilayer and the dimer-singlet state terminates on the first-order line, giving a quantum critical end point, and we use tensor-network calculations to follow the first-order discontinuities in its vicinity. △ Less

Submitted 19 September, 2018; v1 submitted 28 May, 2018; originally announced May 2018.

Comments: 6 pages, 4 figures; supplemental material: 3 pages, 3 figures; v2: as published

Journal ref: Phys. Rev. Lett. 121, 127201 (2018)