Skip to main content

Showing 1–35 of 35 results for author: Panzeri, S

.
  1. arXiv:2212.04317  [pdf

    cs.NE cs.ET q-bio.NC

    Constraints on the design of neuromorphic circuits set by the properties of neural population codes

    Authors: Stefano Panzeri, Ella Janotte, Alejandro Pequeño-Zurro, Jacopo Bonato, Chiara Bartolozzi

    Abstract: In the brain, information is encoded, transmitted and used to inform behaviour at the level of timing of action potentials distributed over population of neurons. To implement neural-like systems in silico, to emulate neural function, and to interface successfully with the brain, neuromorphic circuits need to encode information in a way compatible to that used by populations of neuron in the brain… ▽ More

    Submitted 8 December, 2022; originally announced December 2022.

    Comments: Review paper

  2. arXiv:2210.07069  [pdf, ps, other

    q-bio.NC physics.bio-ph

    Biologically plausible solutions for spiking networks with efficient coding

    Authors: Veronika Koren, Stefano Panzeri

    Abstract: Understanding how the dynamics of neural networks is shaped by the computations they perform is a fundamental question in neuroscience. Recently, the framework of efficient coding proposed a theory of how spiking neural networks can compute low-dimensional stimulus signals with high efficiency. Efficient spiking networks are based on time-dependent minimization of a loss function related to inform… ▽ More

    Submitted 24 October, 2022; v1 submitted 13 October, 2022; originally announced October 2022.

    Comments: in press at NeurIPS 2022- Thirty-sixth Conference on Neural Information Processing Systems

  3. arXiv:2010.05375  [pdf, other

    stat.ML cs.LG

    Causal learning with sufficient statistics: an information bottleneck approach

    Authors: Daniel Chicharro, Michel Besserve, Stefano Panzeri

    Abstract: The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal information from conditional independencies between variables of a system are common tools for this purpose, but are limited in the lack of independencies. To surmount this limitation, we ca… ▽ More

    Submitted 11 October, 2020; originally announced October 2020.

    MSC Class: 94A16; 62D20; 62H22; 62Bxx

  4. arXiv:1905.08360  [pdf, other

    stat.ML cs.LG stat.ME

    Conditionally-additive-noise Models for Structure Learning

    Authors: Daniel Chicharro, Stefano Panzeri, Ilya Shpitser

    Abstract: Constraint-based structure learning algorithms infer the causal structure of multivariate systems from observational data by determining an equivalent class of causal structures compatible with the conditional independencies in the data. Methods based on additive-noise (AN) models have been proposed to further discriminate between causal structures that are equivalent in terms of conditional indep… ▽ More

    Submitted 20 May, 2019; originally announced May 2019.

    MSC Class: 62-07 62-09

  5. arXiv:1904.12798  [pdf, other

    q-bio.NC math.DS

    Mathematical studies of the dynamics of finite-size binary neural networks: A review of recent progress

    Authors: Diego Fasoli, Stefano Panzeri

    Abstract: Traditional mathematical approaches to studying analytically the dynamics of neural networks rely on the mean-field approximation, which is rigorously applicable only to networks of infinite size. However, all existing real biological networks have finite size, and many of them, such as microscopic circuits in invertebrates, are composed only of a few tens of neurons. Thus, it is important to be a… ▽ More

    Submitted 29 April, 2019; originally announced April 2019.

    Comments: 27 pages, 7 figures

  6. Stationary-State Statistics of a Binary Neural Network Model with Quenched Disorder

    Authors: Diego Fasoli, Stefano Panzeri

    Abstract: We study the statistical properties of the stationary firing-rate states of a neural network model with quenched disorder. The model has arbitrary size, discrete-time evolution equations and binary firing rates, while the topology and the strength of the synaptic connections are randomly generated from known, generally arbitrary, probability distributions. We derived semi-analytical expressions of… ▽ More

    Submitted 29 November, 2018; originally announced November 2018.

    Comments: 30 pages, 6 figures, 2 supplemental Python scripts

  7. arXiv:1807.08018  [pdf, ps, other

    stat.ME cs.IT q-bio.NC q-bio.QM

    Information estimation using nonparametric copulas

    Authors: Houman Safaai, Arno Onken, Christopher D. Harvey, Stefano Panzeri

    Abstract: Estimation of mutual information between random variables has become crucial in a range of fields, from physics to neuroscience to finance. Estimating information accurately over a wide range of conditions relies on the development of flexible methods to describe statistical dependencies among variables, without imposing potentially invalid assumptions on the data. Such methods are needed in cases… ▽ More

    Submitted 25 October, 2018; v1 submitted 20 July, 2018; originally announced July 2018.

    Comments: 17 pages, 13 figures

    Journal ref: Phys. Rev. E 98, 053302 (2018)

  8. arXiv:1803.00338  [pdf, other

    q-bio.NC cs.NE

    Synthesizing realistic neural population activity patterns using Generative Adversarial Networks

    Authors: Manuel Molano-Mazon, Arno Onken, Eugenio Piasini, Stefano Panzeri

    Abstract: The ability to synthesize realistic patterns of neural activity is crucial for studying neural information processing. Here we used the Generative Adversarial Networks (GANs) framework to simulate the concerted activity of a population of neurons. We adapted the Wasserstein-GAN variant to facilitate the generation of unconstrained neural population activity patterns while still benefiting from par… ▽ More

    Submitted 17 April, 2018; v1 submitted 1 March, 2018; originally announced March 2018.

    Comments: Published as a conference paper at ICLR 2018 V2: minor changes in supp. material

  9. arXiv:1712.02449  [pdf, other

    q-bio.NC cs.IT physics.data-an

    Quantifying how much sensory information in a neural code is relevant for behavior

    Authors: Giuseppe Pica, Eugenio Piasini, Houman Safaai, Caroline A. Runyan, Mathew E. Diamond, Tommaso Fellin, Christoph Kayser, Christopher D. Harvey, Stefano Panzeri

    Abstract: Determining how much of the sensory information carried by a neural code contributes to behavioral performance is key to understand sensory function and neural information flow. However, there are as yet no analytical tools to compute this information that lies at the intersection between sensory coding and behavioral readout. Here we develop a novel measure, termed the information-theoretic inter… ▽ More

    Submitted 6 December, 2017; originally announced December 2017.

    Journal ref: Advances in Neural Information Processing Systems 30, 3689--3699, 2017

  10. arXiv:1711.11408  [pdf, other

    q-bio.NC stat.ML

    The identity of information: how deterministic dependencies constrain information synergy and redundancy

    Authors: Daniel Chicharro, Giuseppe Pica, Stefano Panzeri

    Abstract: Understanding how different information sources together transmit information is crucial in many domains. For example, understanding the neural code requires characterizing how different neurons contribute unique, redundant, or synergistic pieces of information about sensory or behavioral variables. Williams and Beer (2010) proposed a partial information decomposition (PID) which separates the mut… ▽ More

    Submitted 13 November, 2017; originally announced November 2017.

    MSC Class: 94A15; 94A17

  11. arXiv:1706.08921  [pdf, other

    cs.IT cs.NE math.ST physics.bio-ph physics.data-an

    Invariant components of synergy, redundancy, and unique information among three variables

    Authors: Giuseppe Pica, Eugenio Piasini, Daniel Chicharro, Stefano Panzeri

    Abstract: In a system of three stochastic variables, the Partial Information Decomposition (PID) of Williams and Beer dissects the information that two variables (sources) carry about a third variable (target) into nonnegative information atoms that describe redundant, unique, and synergistic modes of dependencies among the variables. However, the classification of the three variables into two sources and o… ▽ More

    Submitted 27 June, 2017; originally announced June 2017.

    Journal ref: Entropy 2017, 19(9), 451

  12. Optimized brute-force algorithms for the bifurcation analysis of a spin-glass-like neural network model

    Authors: Diego Fasoli, Stefano Panzeri

    Abstract: Bifurcation theory is a powerful tool for studying how the dynamics of a neural network model depends on its underlying neurophysiological parameters. However, bifurcation theory has been developed mostly for smooth dynamical systems and for continuous-time non-smooth models, which prevents us from understanding the changes of dynamics in some widely used classes of artificial neural network model… ▽ More

    Submitted 16 May, 2017; originally announced May 2017.

    Comments: 22 pages, 5 figures, 4 Python scripts

    Journal ref: Phys. Rev. E 99, 012316 (2019)

  13. arXiv:1702.03183  [pdf, other

    q-bio.NC

    Pattern Storage, Bifurcations and Higher-Order Correlation Structure of an Exactly Solvable Asymmetric Neural Network Model

    Authors: Diego Fasoli, Anna Cattani, Stefano Panzeri

    Abstract: Exactly solvable neural network models with asymmetric weights are rare, and exact solutions are available only in some mean-field approaches. In this article we find exact analytical solutions of an asymmetric spin-glass-like model of arbitrary size and we perform a complete study of its dynamical and statistical properties. The network has discrete-time evolution equations, binary firing rates a… ▽ More

    Submitted 15 February, 2017; v1 submitted 10 February, 2017; originally announced February 2017.

    Comments: Main Text: 25 pages, 10 figures. Supplementary Materials: 25 pages, 3 figures. In version 1, we plotted Fig. 7 with an inhibitory current that was different from that stated in the figure caption. We fixed this in version 2, by replotting Fig. 7 with the correct value of the current. Results unchanged

  14. arXiv:1612.09522  [pdf, other

    physics.data-an q-bio.NC

    Redundancy and synergy in dual decompositions of mutual information gain and information loss

    Authors: Daniel Chicharro, Stefano Panzeri

    Abstract: Williams and Beer (2010) proposed a nonnegative mutual information decomposition, based on the construction of information gain lattices, which allows separating the information that a set of variables contains about another into components interpretable as the unique information of one variable, or redundant and synergy components. In this work we extend the framework of Williams and Beer (2010)… ▽ More

    Submitted 30 December, 2016; originally announced December 2016.

    MSC Class: 94A15; 94A17

  15. arXiv:1605.07383  [pdf, other

    q-bio.NC math.DS

    From Local Chaos to Critical Slowing Down: A Theory of the Functional Connectivity of Small Neural Circuits

    Authors: Diego Fasoli, Anna Cattani, Stefano Panzeri

    Abstract: Functional connectivity is a fundamental property of neural networks that quantifies the segregation and integration of information between cortical areas. Due to mathematical complexity, a theory that could explain how the parameters of mesoscopic networks composed of a few tens of neurons affect the functional connectivity is still to be formulated. Yet, many interesting problems in neuroscience… ▽ More

    Submitted 26 May, 2016; v1 submitted 24 May, 2016; originally announced May 2016.

    Comments: 24 pages, 5 figures; compiled version of the Supplementary Materials added (12 pages)

  16. The complexity of dynamics in small neural circuits

    Authors: Diego Fasoli, Anna Cattani, Stefano Panzeri

    Abstract: Mean-field theory is a powerful tool for studying large neural networks. However, when the system is composed of a few neurons, macroscopic differences between the mean-field approximation and the real behavior of the network can arise. Here we introduce a study of the dynamics of a small firing-rate network with excitatory and inhibitory populations, in terms of local and global bifurcations of t… ▽ More

    Submitted 22 July, 2015; v1 submitted 30 June, 2015; originally announced June 2015.

    Comments: 34 pages, 11 figures. Supplementary materials added, colors of figures 8 and 9 fixed, results unchanged

  17. arXiv:1504.03954  [pdf

    q-bio.NC

    Phase-of-firing code

    Authors: Anna Cattani, Gaute T. Einevoll, Stefano Panzeri

    Abstract: Definition. The phase-of-firing code is a neural coding scheme whereby neurons encode information using the time at which they fire spikes within a cycle of the ongoing oscillatory pattern of network activity. This coding scheme may allow neurons to use their temporal pattern of spikes to encode information that is not encoded in their firing rate.

    Submitted 15 April, 2015; originally announced April 2015.

    Comments: In press, Encyclopedia of Computational Neuroscience, 2015

  18. Estimating Information-Theoretic Quantities

    Authors: Robin A. A. Ince, Simon R. Schultz, Stefano Panzeri

    Abstract: Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying information flow in the nervous system. It has a number of useful properties: it is a general measure sensitive to any relationship, not only linear effects; it… ▽ More

    Submitted 8 January, 2015; originally announced January 2015.

    Comments: 16 pages, 3 figures

    Journal ref: Encyclopaedia of Computational Neuroscience 2014, pp 1-13

  19. Applications of Information Theory to Analysis of Neural Data

    Authors: Simon R. Schultz, Robin A. A. Ince, Stefano Panzeri

    Abstract: Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying information flow in the nervous system. It has a number of useful properties: it is a general measure sensitive to any relationship, not only linear effects; it… ▽ More

    Submitted 8 January, 2015; originally announced January 2015.

    Comments: 8 pages, 2 figures

    Journal ref: Encyclopedia of Computational Neuroscience 2014, pp 1-6

  20. Summary of Information Theoretic Quantities

    Authors: Robin A. A. Ince, Stefano Panzeri, Simon R. Schultz

    Abstract: Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying information flow in the nervous system. As a framework it has a number of useful properties: it provides a general measure sensitive to any relationship, not onl… ▽ More

    Submitted 8 January, 2015; originally announced January 2015.

    Comments: 7 pages

    Journal ref: Encyclopaedia of Computational Neuroscience 2014, pp 1-6

  21. arXiv:1206.0560  [pdf

    q-bio.NC

    The information content of Local Field Potentials: experiments and models

    Authors: Alberto Mazzoni, Nikos K. Logothetis, Stefano Panzeri

    Abstract: The LFPs is a broadband signal that captures variations of neural population activity over a wide range of time scales. The range of time scales available in LFPs is particularly interesting from the neural coding point of view because it opens up the possibility to investigate whether there are privileged time scales for information processing, a question that has been hotly debated over the last… ▽ More

    Submitted 4 June, 2012; originally announced June 2012.

    Comments: To appear in Quian Quiroga and Panzeri (Eds) Principles of Neural Coding, CRC Press, 2012

  22. arXiv:physics/0006081  [pdf, ps, other

    physics.bio-ph q-bio.NC

    Synchronisation, binding and the role of correlated firing in fast information transmission

    Authors: Simon R. Schultz, Huw D. R. Golledge, Stefano Panzeri

    Abstract: Does synchronization between action potentials from different neurons in the visual system play a substantial role in solving the binding problem? The binding problem can be studied quantitatively in the broader framework of the information contained in neural spike trains about some external correlate, which in this case is object configurations in the visual field. We approach this problem by… ▽ More

    Submitted 30 June, 2000; originally announced June 2000.

    Comments: 15 pages, to appear in Emergent Neural Computational Architectures Based on Neuroscience, Lecture Notes in Computer Science, Springer-Verlag, Heidelberg

  23. arXiv:physics/0001006  [pdf, ps, other

    physics.bio-ph cond-mat.dis-nn q-bio.NC

    Temporal correlations and neural spike train entropy

    Authors: Simon R. Schultz, Stefano Panzeri

    Abstract: Sampling considerations limit the experimental conditions under which information theoretic analyses of neurophysiological data yield reliable results. We develop a procedure for computing the full temporal entropy and information of ensembles of neural spike trains, which performs reliably for limited samples of data. This approach also yields insight upon the role of correlations between spike… ▽ More

    Submitted 11 April, 2001; v1 submitted 4 January, 2000; originally announced January 2000.

    Comments: 4 pages, 3 figures; final published version. In press, Physical Review Letters

  24. arXiv:physics/9908027  [pdf, ps, other

    physics.bio-ph q-bio.NC

    A unified approach to the study of temporal, correlational and rate coding

    Authors: S. Panzeri, S. R. Schultz

    Abstract: We demonstrate that the information contained in the spike occurrence times of a population of neurons can be broken up into a series of terms, each of which reflect something about potential coding mechanisms. This is possible in the coding r{é}gime in which few spikes are emitted in the relevant time window. This approach allows us to study the additional information contributed by spike tim… ▽ More

    Submitted 23 August, 2000; v1 submitted 13 August, 1999; originally announced August 1999.

    Comments: 33 pages, 7 figures

  25. arXiv:cond-mat/9704227  [pdf, ps, other

    cond-mat.dis-nn q-bio

    Quantitative analysis of a Schaffer collateral model

    Authors: S Schultz, S Panzeri, ET Rolls, A Treves

    Abstract: Advances in techniques for the formal analysis of neural networks have introduced the possibility of detailed quantitative analyses of brain circuitry. This paper applies a method for calculating mutual information to the analysis of the Schaffer collateral connections between regions CA3 and CA1 of the hippocampus. Attention is given to the introduction of further details of anatomy and physiol… ▽ More

    Submitted 19 September, 1997; v1 submitted 28 April, 1997; originally announced April 1997.

    Comments: Revised version. 16 pages LaTeX, 5 figs. To be published in Baddeley et al (Eds) Information Theory and the Brain, Cambridge Univ. Press 1998

  26. arXiv:hep-th/9610144  [pdf, ps, other

    hep-th hep-lat hep-ph

    Finite Temperature Lattice QCD in the Large N Limit

    Authors: M. Billo', M. Caselle, A. D'Adda, S. Panzeri

    Abstract: Our aim is to give a self-contained review of recent advances in the analytic description of the deconfinement transition and determination of the deconfinement temperature in lattice QCD at large N. We also include some new results, as for instance in the comparison of the analytic results with Montecarlo simulations. We first review the general set-up of finite temperature lattice gauge theori… ▽ More

    Submitted 18 October, 1996; originally announced October 1996.

    Comments: 66 pages, plain Latex, figures included by epsf

    Report number: DFTT 43/96, NORDITA 96/66P

    Journal ref: Int.J.Mod.Phys. A12 (1997) 1783-1846

  27. Effective actions for finite temperature Lattice Gauge Theories

    Authors: M. Billo', M. Caselle, A. D'Adda, S. Panzeri

    Abstract: We consider a lattice gauge theory at finite temperature in ($d$+1) dimensions with the Wilson action and different couplings $β_t$ and $β_s$ for timelike and spacelike plaquettes. By using the character expansion and Schwinger-Dyson type equations we construct, order by order in $β_s$, an effective action for the Polyakov loops which is exact to all orders in $β_t$. As an example we construct t… ▽ More

    Submitted 12 September, 1996; originally announced September 1996.

    Comments: Talk presented at LATTICE96(finite temperature)

    Journal ref: Nucl.Phys.Proc.Suppl. 53 (1997) 459-461

  28. Toward an analytic determination of the deconfinement temperature in SU(2) L.G.T.

    Authors: M. Billo', M. Caselle, A. D'Adda, S. Panzeri

    Abstract: We consider the SU(2) lattice gauge theory at finite temperature in (d+1) dimensions, with different couplings $β_t$ and $β_s$ for timelike and spacelike plaquettes. By using the character expansion of the Wilson action and performing the integrals over space-like link variables, we find an effective action for the Polyakov loops which is exact to all orders in $β_t$ and to the first non-trivial… ▽ More

    Submitted 29 January, 1996; originally announced January 1996.

    Comments: uuencoded latex file of 32 pages plus 3 ps figures

    Report number: DFTT 69/95, NORDITA 96/1P

    Journal ref: Nucl.Phys. B472 (1996) 163-193

  29. Deconfinement Transition in Large N Lattice Gauge Theory

    Authors: M. Billo', M. Caselle, A. D'Adda, L. Magnea, S. Panzeri

    Abstract: We study analytically the phase diagram of the pure $SU(N)$ lattice gauge theory at finite temperature, and we attempt to estimate the critical deconfinement temperature. We apply large $N$ techniques to the Wilson and to the Heat Kernel action, and we study the resulting models both in the strong coupling and in the weak coupling limits. Using the Heat Kernel action, we establish an interesting… ▽ More

    Submitted 26 July, 1994; originally announced July 1994.

    Comments: 39 pages (Latex) + 4 ps-figures (using EPSF), DFTT 30/94

    Journal ref: Nucl.Phys. B435 (1995) 172-206

  30. arXiv:hep-th/9309107  [pdf, ps, other

    hep-th

    Two-dimensional QCD on the sphere and on the cylinder

    Authors: M. Caselle, A. D'Adda, L. Magnea, S. Panzeri

    Abstract: The partition functions of QCD2 on simple surfaces admit representations in terms of exponentials of the inverse coupling, that are modular transforms of the usual character expansions. We review the construction of such a representation in the case of the cylinder, and show how it leads to a formulation of QCD2 as a $c=1$ matrix model of the Kazakov-Migdal type. The eigenvalues describe the pos… ▽ More

    Submitted 20 September, 1993; originally announced September 1993.

    Comments: 12 pages, plain latex, DFTT 50/93

  31. The C = 1 Matrix Model Formulation of Two Dimensional Yang-Mills Theories

    Authors: Stefano Panzeri

    Abstract: We find the exact matrix model description of two dimensional Yang-Mills theories on a cylinder or on a torus and with an arbitrary compact gauge group. This matrix model is the singlet sector of a $c =1$ matrix model where the matrix field is in the fundamental representation of the gauge group. We also prove that the basic constituents of the theory are Sutherland fermions in the zero coupling… ▽ More

    Submitted 28 July, 1993; originally announced July 1993.

    Comments: 15 pages, plain latex, DFTT 36/93

    Journal ref: Mod. Phys. Lett. A8 (1993) 3201-3214

  32. Two dimensional QCD is a one dimensional Kazakov-Migdal model

    Authors: M. Caselle, A. D'Adda, L. Magnea, S. Panzeri

    Abstract: We calculate the partition functions of QCD in two dimensions on a cylinder and on a torus in the gauge $\partial_{0} A_{0} = 0$ by integrating explicitly over the non zero modes of the Fourier expansion in the periodic time variable. The result is a one dimensional Kazakov-Migdal matrix model with eigenvalues on a circle rather than on a line. We prove that our result coincides with the standar… ▽ More

    Submitted 9 April, 1993; v1 submitted 5 April, 1993; originally announced April 1993.

    Comments: DFTT 15/93, 17 pages, Latex (Besides minor changes and comments added we note that for U(N) odd and even N have to be treated separately)

    Journal ref: Nucl.Phys. B416 (1994) 751-770

  33. The Kazakov-Migdal Model as a High Temperature Lattice Gauge Theory

    Authors: M. Caselle, A. D'Adda, S. Panzeri

    Abstract: We show that the Kazakov-Migdal (K-M) induced gauge model in $d$ dimensions describes the high temperature limit of ordinary lattice gauge theories in $d+1$ dimensions. The matter fields are related to the Polyakov loops, while the spatial gauge variables become the gauge fields of the K-M model. This interpretation of the K-M model is in agreement with some recent results in high temperature la… ▽ More

    Submitted 11 December, 1992; originally announced December 1992.

    Comments: 12 pages, plain latex, DFTT 71/92

    Journal ref: Phys.Lett. B302 (1993) 80-86

  34. Kazakov-Migdal Induced Gauge Theory and the Coupling of 2D Quantum Gravity to D=1 Matter

    Authors: M. Caselle, A. D'Adda, S. Panzeri

    Abstract: Recently Kazakov and Migdal proposed a new approach to the large $N$ limit of SU(N) gauge theories which could hopefully describe the asymptotically free fixed point of QCD in 4 dimensions. In this contribution we review the exact solution of their model in the case of a $d=1$ compactified lattice and its connection with the partition function of the vortex-free sector of the d=1 compactified bo… ▽ More

    Submitted 2 December, 1992; originally announced December 1992.

    Comments: Talk given By M.Caselle at LATTICE 92, 7 pages, plain latex, DFTT 65/92

    Journal ref: Nucl. Phys. Proc. Suppl. 30 (1993) 808

  35. Exact solution of d=1 Kazakov-Migdal induced gauge theory

    Authors: M. Caselle, A. D'Adda, S. Panzeri

    Abstract: We give the exact solution of the Kazakov-Migdal induced gauge model in the case of a D=1 compactified lattice with a generic number $S$ of sites and for any value of N. Due to the peculiar features of the model, the partition function that we obtain also describes the vortex-free sector of the D=1 compactified bosonic string, and it coincides in the continuum limit with the one obtained by Boul… ▽ More

    Submitted 3 August, 1992; v1 submitted 27 July, 1992; originally announced July 1992.

    Comments: 9 pages, Latex file DFTT 38/92 (revised version,with just a couple of references added)

    Journal ref: Phys.Lett. B293 (1992) 161-167