-
Direct and retrograde signal propagation in unidirectionally coupled Wilson-Cowan oscillators
Authors:
Guy Elisha,
Richard Gast,
Sourav Halder,
Sara A. Solla,
Peter J. Kahrilas,
John E. Pandolfino,
Neelesh A. Patankar
Abstract:
Certain biological systems exhibit both direct and retrograde propagating wave signals, despite unidirectional neural coupling. However, there is no model to explain this. Therefore, the underlying physics of reversing the signal's direction for one-way coupling remains unclear. Here, we resolve this issue using a Wilson-Cowan oscillators network. By analyzing the limit cycle period of various cou…
▽ More
Certain biological systems exhibit both direct and retrograde propagating wave signals, despite unidirectional neural coupling. However, there is no model to explain this. Therefore, the underlying physics of reversing the signal's direction for one-way coupling remains unclear. Here, we resolve this issue using a Wilson-Cowan oscillators network. By analyzing the limit cycle period of various coupling configurations, we determine that intrinsic frequency differences among oscillators control wave directionality.
△ Less
Submitted 1 March, 2024; v1 submitted 28 February, 2024;
originally announced February 2024.
-
Statistical physics, Bayesian inference and neural information processing
Authors:
Erin Grant,
Sandra Nestler,
Berfin Şimşek,
Sara Solla
Abstract:
Lecture notes from the course given by Professor Sara A. Solla at the Les Houches summer school on "Statistical physics of Machine Learning". The notes discuss neural information processing through the lens of Statistical Physics. Contents include Bayesian inference and its connection to a Gibbs description of learning and generalization, Generalized Linear Models as a controlled alternative to ba…
▽ More
Lecture notes from the course given by Professor Sara A. Solla at the Les Houches summer school on "Statistical physics of Machine Learning". The notes discuss neural information processing through the lens of Statistical Physics. Contents include Bayesian inference and its connection to a Gibbs description of learning and generalization, Generalized Linear Models as a controlled alternative to backpropagation through time, and linear and non-linear techniques for dimensionality reduction.
△ Less
Submitted 29 September, 2023;
originally announced September 2023.
-
Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolution
Authors:
Anthony Zador,
Sean Escola,
Blake Richards,
Bence Ölveczky,
Yoshua Bengio,
Kwabena Boahen,
Matthew Botvinick,
Dmitri Chklovskii,
Anne Churchland,
Claudia Clopath,
James DiCarlo,
Surya Ganguli,
Jeff Hawkins,
Konrad Koerding,
Alexei Koulakov,
Yann LeCun,
Timothy Lillicrap,
Adam Marblestone,
Bruno Olshausen,
Alexandre Pouget,
Cristina Savin,
Terrence Sejnowski,
Eero Simoncelli,
Sara Solla,
David Sussillo
, et al. (2 additional authors not shown)
Abstract:
Neuroscience has long been an essential driver of progress in artificial intelligence (AI). We propose that to accelerate progress in AI, we must invest in fundamental research in NeuroAI. A core component of this is the embodied Turing test, which challenges AI animal models to interact with the sensorimotor world at skill levels akin to their living counterparts. The embodied Turing test shifts…
▽ More
Neuroscience has long been an essential driver of progress in artificial intelligence (AI). We propose that to accelerate progress in AI, we must invest in fundamental research in NeuroAI. A core component of this is the embodied Turing test, which challenges AI animal models to interact with the sensorimotor world at skill levels akin to their living counterparts. The embodied Turing test shifts the focus from those capabilities like game playing and language that are especially well-developed or uniquely human to those capabilities, inherited from over 500 million years of evolution, that are shared with all animals. Building models that can pass the embodied Turing test will provide a roadmap for the next generation of AI.
△ Less
Submitted 22 February, 2023; v1 submitted 15 October, 2022;
originally announced October 2022.
-
Macroscopic Dynamics of Neural Networks with Heterogeneous Spiking Thresholds
Authors:
Richard Gast,
Sara A. Solla,
Ann Kennedy
Abstract:
Mean-field theory links the physiological properties of individual neurons to the emergent dynamics of neural population activity. These models provide an essential tool for studying brain function at different scales; however, for their application to neural populations on large scale, they need to account for differences between distinct neuron types. The Izhikevich single neuron model can accou…
▽ More
Mean-field theory links the physiological properties of individual neurons to the emergent dynamics of neural population activity. These models provide an essential tool for studying brain function at different scales; however, for their application to neural populations on large scale, they need to account for differences between distinct neuron types. The Izhikevich single neuron model can account for a broad range of different neuron types and spiking patterns, thus rendering it an optimal candidate for a mean-field theoretic treatment of brain dynamics in heterogeneous networks. Here, we derive the mean-field equations for networks of all-to-all coupled Izhikevich neurons with heterogeneous spiking thresholds. Using methods from bifurcation theory, we examine the conditions under which the mean-field theory accurately predicts the dynamics of the Izhikevich neuron network. To this end, we focus on three important features of the Izhikevich model that are subject here to simplifying assumptions: (i) spike-frequency adaptation, (ii) the spike reset conditions, and (iii) the distribution of single-cell spike thresholds across neurons.
Our results indicate that, while the mean-field model is not an exact model of the Izhikevich network dynamics, it faithfully captures its different dynamic regimes and phase transitions. We thus present a mean-field model that can represent different neuron types and spiking dynamics. The model is comprised of biophysical state variables and parameters, incorporates realistic spike resetting conditions, and accounts for heterogeneity in neural spiking thresholds. These features allow for a broad applicability of the model as well as for a direct comparison to experimental data.
△ Less
Submitted 7 September, 2022;
originally announced September 2022.
-
Effects of Neural Heterogeneity on Spiking Neural Network Dynamics
Authors:
Richard Gast,
Sara A. Solla,
Ann Kennedy
Abstract:
The brain is composed of complex networks of interacting neurons that express considerable heterogeneity in their physiology and spiking characteristics. How does neural heterogeneity affect macroscopic neural dynamics and how does it contribute to neurodynamic functions? In this letter, we address these questions by studying the macroscopic dynamics of networks of heterogeneous Izhikevich neurons…
▽ More
The brain is composed of complex networks of interacting neurons that express considerable heterogeneity in their physiology and spiking characteristics. How does neural heterogeneity affect macroscopic neural dynamics and how does it contribute to neurodynamic functions? In this letter, we address these questions by studying the macroscopic dynamics of networks of heterogeneous Izhikevich neurons. We derive mean-field equations for these networks and examine how heterogeneity in the spiking thresholds of Izhikevich neurons affects the emergent macroscopic dynamics. Our results suggest that the level of heterogeneity of inhibitory populations controls resonance and hysteresis properties of systems of coupled excitatory and inhibitory neurons. Neural heterogeneity may thus serve as a means to control the dynamic repertoire of mesoscopic brain circuits.
△ Less
Submitted 17 June, 2022;
originally announced June 2022.
-
Adversarial Domain Adaptation for Stable Brain-Machine Interfaces
Authors:
Ali Farshchian,
Juan A. Gallego,
Joseph P. Cohen,
Yoshua Bengio,
Lee E. Miller,
Sara A. Solla
Abstract:
Brain-Machine Interfaces (BMIs) have recently emerged as a clinically viable option to restore voluntary movements after paralysis. These devices are based on the ability to extract information about movement intent from neural signals recorded using multi-electrode arrays chronically implanted in the motor cortices of the brain. However, the inherent loss and turnover of recorded neurons requires…
▽ More
Brain-Machine Interfaces (BMIs) have recently emerged as a clinically viable option to restore voluntary movements after paralysis. These devices are based on the ability to extract information about movement intent from neural signals recorded using multi-electrode arrays chronically implanted in the motor cortices of the brain. However, the inherent loss and turnover of recorded neurons requires repeated recalibrations of the interface, which can potentially alter the day-to-day user experience. The resulting need for continued user adaptation interferes with the natural, subconscious use of the BMI. Here, we introduce a new computational approach that decodes movement intent from a low-dimensional latent representation of the neural data. We implement various domain adaptation methods to stabilize the interface over significantly long times. This includes Canonical Correlation Analysis used to align the latent variables across days; this method requires prior point-to-point correspondence of the time series across domains. Alternatively, we match the empirical probability distributions of the latent variables across days through the minimization of their Kullback-Leibler divergence. These two methods provide a significant and comparable improvement in the performance of the interface. However, implementation of an Adversarial Domain Adaptation Network trained to match the empirical probability distribution of the residuals of the reconstructed neural signals outperforms the two methods based on latent variables, while requiring remarkably few data points to solve the domain adaptation problem.
△ Less
Submitted 15 January, 2019; v1 submitted 28 September, 2018;
originally announced October 2018.
-
Many Attractors, Long Chaotic Transients, and Failure in Small-World Networks of Excitable Neurons
Authors:
Hermann Riecke,
Alex Roxin,
Santiago Madruga,
Sara A. Solla
Abstract:
We study the dynamical states that emerge in a small-world network of recurrently coupled excitable neurons through both numerical and analytical methods. These dynamics depend in large part on the fraction of long-range connections or `short-cuts' and the delay in the neuronal interactions. Persistent activity arises for a small fraction of `short-cuts', while a transition to failure occurs at…
▽ More
We study the dynamical states that emerge in a small-world network of recurrently coupled excitable neurons through both numerical and analytical methods. These dynamics depend in large part on the fraction of long-range connections or `short-cuts' and the delay in the neuronal interactions. Persistent activity arises for a small fraction of `short-cuts', while a transition to failure occurs at a critical value of the `short-cut' density. The persistent activity consists of multi-stable periodic attractors, the number of which is at least on the order of the number of neurons in the network. For long enough delays, network activity at high `short-cut' densities is shown to exhibit exceedingly long chaotic transients whose failure-times averaged over many network configurations follow a stretched exponential. We show how this functional form arises in the ensemble-averaged activity if each network realization has a characteristic failure-time which is exponentially distributed.
△ Less
Submitted 28 January, 2007;
originally announced January 2007.
-
Amplification in the auditory periphery: the effect of coupling tuning mechanisms
Authors:
K. A. Montgomery,
M. Silber,
S. A. Solla
Abstract:
A mathematical model describing the coupling between two independent amplification mechanisms in auditory hair cells is proposed and analyzed. Hair cells are cells in the inner ear responsible for translating sound-induced mechanical stimuli into an electrical signal that can then be recorded by the auditory nerve. In nonmammals, two separate mechanisms have been postulated to contribute to the…
▽ More
A mathematical model describing the coupling between two independent amplification mechanisms in auditory hair cells is proposed and analyzed. Hair cells are cells in the inner ear responsible for translating sound-induced mechanical stimuli into an electrical signal that can then be recorded by the auditory nerve. In nonmammals, two separate mechanisms have been postulated to contribute to the amplification and tuning properties of the hair cells. Models of each of these mechanisms have been shown to be poised near a Hopf bifurcation. Through a weakly nonlinear analysis that assumes weak periodic forcing, weak dam**, and weak coupling, the physiologically-based models of the two mechanisms are reduced to a system of two coupled amplitude equations describing the resonant response. The predictions that follow from an analysis of the reduced equations, as well as performance benefits due to the coupling of the two mechanisms, are discussed and compared with published experimental auditory nerve data.
△ Less
Submitted 12 January, 2007;
originally announced January 2007.
-
Self-sustained activity in a small-world network of excitable neurons
Authors:
Alex Roxin,
Hermann Riecke,
Sara A. Solla
Abstract:
We study the dynamics of excitable integrate-and-fire neurons in a small-world network. At low densities $p$ of directed random connections, a localized transient stimulus results in either self-sustained persistent activity or in a brief transient followed by failure. Averages over the quenched ensemble reveal that the probability of failure changes from 0 to 1 over a narrow range in $p$; this…
▽ More
We study the dynamics of excitable integrate-and-fire neurons in a small-world network. At low densities $p$ of directed random connections, a localized transient stimulus results in either self-sustained persistent activity or in a brief transient followed by failure. Averages over the quenched ensemble reveal that the probability of failure changes from 0 to 1 over a narrow range in $p$; this failure transition can be described analytically through an extension of an existing mean-field result. Exceedingly long transients emerge at higher densities $p$; their activity patterns are disordered, in contrast to the mostly periodic persistent patterns observed at low $p$. The times at which such patterns die out are consistent with a stretched-exponential distribution, which depends sensitively on the propagation velocity of the excitation.
△ Less
Submitted 25 September, 2003;
originally announced September 2003.