Showing 1–38 of 38 results for author: Magnasco, M

Input-driven circuit reconfiguration in critical recurrent neural networks

Authors: Marcelo O. Magnasco

Abstract: Changing a circuit dynamically, without actually changing the hardware itself, is called reconfiguration, and is of great importance due to its manifold technological applications. Circuit reconfiguration appears to be a feature of the cerebral cortex, and hence understanding the neuroarchitectural and dynamical features underlying self-reconfiguration may prove key to elucidate brain function. We… ▽ More Changing a circuit dynamically, without actually changing the hardware itself, is called reconfiguration, and is of great importance due to its manifold technological applications. Circuit reconfiguration appears to be a feature of the cerebral cortex, and hence understanding the neuroarchitectural and dynamical features underlying self-reconfiguration may prove key to elucidate brain function. We present a very simple single-layer recurrent network, whose signal pathways can be reconfigured "on the fly" using only its inputs, with no changes to its synaptic weights. We use the low spatio-temporal frequencies of the input to landscape the ongoing activity, which in turn permits or denies the propagation of traveling waves. This mechanism uses the inherent properties of dynamically-critical systems, which we guarantee through unitary convolution kernels. We show this network solves the classical connectedness problem, by allowing signal propagation only along the regions to be evaluated for connectedness and forbidding it elsewhere. △ Less

Submitted 23 May, 2024; originally announced May 2024.

Comments: Supplementary Movies Available Upon Request

On the dynamics of convolutional recurrent neural networks near their critical point

Authors: Aditi Chandra, Marcelo O. Magnasco

Abstract: We examine the dynamical properties of a single-layer convolutional recurrent network with a smooth sigmoidal activation function, for small values of the inputs and when the convolution kernel is unitary, so all eigenvalues lie exactly at the unit circle. Such networks have a variety of hallmark properties: the outputs depend on the inputs via compressive nonlinearities such as cubic roots, and b… ▽ More We examine the dynamical properties of a single-layer convolutional recurrent network with a smooth sigmoidal activation function, for small values of the inputs and when the convolution kernel is unitary, so all eigenvalues lie exactly at the unit circle. Such networks have a variety of hallmark properties: the outputs depend on the inputs via compressive nonlinearities such as cubic roots, and both the timescales of relaxation and the length-scales of signal propagation depend sensitively on the inputs as power laws, both diverging as the input to 0. The basic dynamical mechanism is that inputs to the network generate ongoing activity, which in turn controls how additional inputs or signals propagate spatially or attenuate in time. We present analytical solutions for the steady states when the network is forced with a single oscillation and when a background value creates a steady state of ongoing activity, and derive the relationships sha** the value of the temporal decay and spatial propagation length as a function of this background value. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Convolutional unitary or orthogonal recurrent neural networks

Authors: Marcelo O. Magnasco

Abstract: Recurrent neural networks are extremely powerful yet hard to train. One of their issues is the vanishing gradient problem, whereby propagation of training signals may be exponentially attenuated, freezing training. Use of orthogonal or unitary matrices, whose powers neither explode nor decay, has been proposed to mitigate this issue, but their computational expense has hindered their use. Here we… ▽ More Recurrent neural networks are extremely powerful yet hard to train. One of their issues is the vanishing gradient problem, whereby propagation of training signals may be exponentially attenuated, freezing training. Use of orthogonal or unitary matrices, whose powers neither explode nor decay, has been proposed to mitigate this issue, but their computational expense has hindered their use. Here we show that in the specific case of convolutional RNNs, we can define a convolutional exponential and that this operation transforms antisymmetric or anti-Hermitian convolution kernels into orthogonal or unitary convolution kernels. We explicitly derive FFT-based algorithms to compute the kernels and their derivatives. The computational complexity of parametrizing this subspace of orthogonal transformations is thus the same as the networks' iteration. △ Less

Submitted 14 February, 2023; originally announced February 2023.

Masks and COVID-19: a causal framework for imputing value to public-health interventions

Authors: Andres Babino, Marcelo O. Magnasco

Abstract: During the COVID-19 pandemic, the scientific community developed predictive models to evaluate potential governmental interventions. However, the analysis of the effects these interventions had is less advanced. Here, we propose a data-driven framework to assess these effects retrospectively. We use a regularized regression to find a parsimonious model that fits the data with the least changes in… ▽ More During the COVID-19 pandemic, the scientific community developed predictive models to evaluate potential governmental interventions. However, the analysis of the effects these interventions had is less advanced. Here, we propose a data-driven framework to assess these effects retrospectively. We use a regularized regression to find a parsimonious model that fits the data with the least changes in the Rt parameter. Then, we postulate each jump in Rt as the effect of an intervention. Following the do-operator prescriptions, we simulate the counterfactual case by forcing Rt to stay at the pre-jump value. We then attribute a value to the intervention from the difference between true evolution and simulated counterfactual. We show that the recommendation to use facemasks for all activities would reduce the number of cases by 170000 (95% CI 160000 to 180000) in Connecticut, Massachusetts, and New York State. The framework presented here might be used in any case where cause and effects are sparse in time. △ Less

Submitted 7 July, 2020; v1 submitted 9 June, 2020; originally announced June 2020.

Comments: 27 pages, 9 figures

A Center Manifold Reduction Technique for a System of Randomly Coupled Oscillators

Authors: Dimitrios Moirogiannis, Keith Hayton, Marcelo Magnasco

Abstract: In dynamical systems theory, a fixed point of the dynamics is called nonhyperbolic if the linearization of the system around the fixed point has at least one eigenvalue with zero real part. The center manifold existence theorem guarantees the local existence of an invariant subspace of the dynamics, known as a center manifold, around such nonhyperbolic fixed points. A growing number of theoretical… ▽ More In dynamical systems theory, a fixed point of the dynamics is called nonhyperbolic if the linearization of the system around the fixed point has at least one eigenvalue with zero real part. The center manifold existence theorem guarantees the local existence of an invariant subspace of the dynamics, known as a center manifold, around such nonhyperbolic fixed points. A growing number of theoretical and experimental studies suggest that some neural systems utilize nonhyperbolic fixed points and corresponding center manifolds to display complex, nonlinear dynamics and to flexibly adapt to wide-ranging sensory input parameters. In this paper, we present a technique to study the statistical properties of high-dimensional, nonhyperbolic dynamical systems with random connectivity and examine which statistical properties determine both the shape of the center manifold and the corresponding reduced dynamics on it. This technique also gives us constraints on the family of center manifold models that could arise from a large-scale random network. We demonstrate this approach on an example network of randomly coupled damped oscillators. △ Less

Submitted 1 April, 2019; originally announced April 2019.

A Time Domain Acoustic Model for the Production of Rodent Ultrasonic Vocalizations

Authors: Matthew Dornfeld, Marcelo Magnasco, Oreste Piro

Abstract: Mammalian ultrasonic vocalization (USV) has been a subject of interest for decades. This interest has mainly been driven by the intelligence of dolphins and other odontocetes. However the semantic content of odontocete USV and its mechanism of production remain poorly understood. Serendipitously however many rodent species have convergently evolved the ability to produce USVs in a similar manner.… ▽ More Mammalian ultrasonic vocalization (USV) has been a subject of interest for decades. This interest has mainly been driven by the intelligence of dolphins and other odontocetes. However the semantic content of odontocete USV and its mechanism of production remain poorly understood. Serendipitously however many rodent species have convergently evolved the ability to produce USVs in a similar manner. In this paper we use rodent USV as a model process to help us gain insight into the production mechanism for mammalian USV as a whole. We derive a model that describes the production of rodent USVs by considering the interaction of an unstable jet, emerging from the vocal folds, with the passive resonance modes of the upper vocal tract. Thus our model is also a solution to a special case of the jet susceptibility problem. The derived model takes the form of a set of coupled nonlinear time domain ODEs, whose solutions are controlled by biologically relevant parameters such as subglottal pressure and vocal fold radius. In our analysis of the model we find the existence of a subglottal blowing pressure threshold ($p \approx 710$ Pa), above which steady acoustic oscillations occur. Furthermore we also reproduce the $22$ kHz rat alarm call at realistic blowing pressures ($p \approx 1500$ Pa) △ Less

Submitted 20 September, 2018; originally announced September 2018.

A Nonhyperbolic Toy Model of Cochlear Dynamics

Authors: Keith Hayton, Dimitrios Moirogiannis, Marcelo Magnasco

Abstract: Cochlea displays complex and highly nonlinear behavior in response to wide-ranging auditory stimuli. While there have been many recent advancements in the modeling of cochlear dynamics, it remains unclear what mathematical structures underlie the essential features of the extended cochlea. We construct a dynamical system consisting of a series of strongly coupled critical oscillators to show that… ▽ More Cochlea displays complex and highly nonlinear behavior in response to wide-ranging auditory stimuli. While there have been many recent advancements in the modeling of cochlear dynamics, it remains unclear what mathematical structures underlie the essential features of the extended cochlea. We construct a dynamical system consisting of a series of strongly coupled critical oscillators to show that high-dimensional nonhyperbolic dynamics can account for high-order compressive nonlinearities, amplification of weak input, frequency selectivity, and traveling waves of activity. As a single Hopf bifurcation generically gives rise to features of cochlea at a local level, the nonhyperbolicity mechanism proposed in this paper can be seen as a higher-dimensional analogue for the entire extended cochlea. △ Less

Submitted 6 August, 2018; v1 submitted 2 July, 2018; originally announced July 2018.

Adaptive Scales of Spatial Integration and Response Latencies in a Critically-Balanced Model of the Primary Visual Cortex

Authors: Keith Hayton, Dimitrios Moirogiannis, Marcelo Magnasco

Abstract: The brain processes visual inputs having structure over a large range of spatial scales. The precise mechanisms or algorithms used by the brain to achieve this feat are largely unknown and an open problem in visual neuroscience. In particular, the spatial extent in visual space over which primary visual cortex (V1) performs evidence integration has been shown to change as a function of contrast an… ▽ More The brain processes visual inputs having structure over a large range of spatial scales. The precise mechanisms or algorithms used by the brain to achieve this feat are largely unknown and an open problem in visual neuroscience. In particular, the spatial extent in visual space over which primary visual cortex (V1) performs evidence integration has been shown to change as a function of contrast and other visual parameters, thus adapting scale in visual space in an input-dependent manner. We demonstrate that a simple dynamical mechanism---dynamical criticality---can simultaneously account for the well-documented input-dependence characteristics of three properties of V1: scales of integration in visuotopic space, extents of lateral integration on the cortical surface, and response latencies. △ Less

Submitted 21 March, 2018; v1 submitted 27 March, 2017; originally announced March 2017.

Extracting Hidden Hierarchies in 3D Distribution Networks

Authors: Carl D. Modes, Marcelo O. Magnasco, Eleni Katifori

Abstract: Natural and man-made transport webs are frequently dominated by dense sets of nested cycles. The architecture of these networks, as defined by the topology and edge weights, determines how efficiently the networks perform their function. Yet, the set of tools that can characterize such a weighted cycle-rich architecture in a physically relevant, mathematically compact way is sparse. In order to fi… ▽ More Natural and man-made transport webs are frequently dominated by dense sets of nested cycles. The architecture of these networks, as defined by the topology and edge weights, determines how efficiently the networks perform their function. Yet, the set of tools that can characterize such a weighted cycle-rich architecture in a physically relevant, mathematically compact way is sparse. In order to fill this void, we have developed a new algorithm that rests on an abstraction of the physical `tiling' in the case of a two dimensional network to an effective tiling of an abstract surface in space that the network may be thought to sit in. Generically these abstract surfaces are richer than the flat plane and as a result there are now two families of fundamental units that may aggregate upon cutting weakest links -- the plaquettes of the tiling and the longer `topological' cycles associated with the abstract surface itself. Upon sequential removal of the weakest links, as determined by the edge weight, neighboring plaquettes merge and a tree characterizing this merging process results. The properties of this characteristic tree can provide the physical and topological data required to describe the architecture of the network and to build physical models. The new algorithm can be used for automated phenotypic characterization of any weighted network whose structure is dominated by cycles, such as mammalian vasculature in the organs, the root networks of clonal colonies like quaking aspen, or the force networks in jammed granular matter. △ Less

Submitted 15 October, 2014; originally announced October 2014.

Journal ref: Phys. Rev. X 6, 031009 (2016)

Structural Self-Assembly and Glassy Dynamics in Locally Adaptive Networks

Authors: Johannes Gräwer, Carl D. Modes, Marcelo O. Magnasco, Eleni Katifori

Abstract: Transport networks play a key role across four realms of eukaryotic life: slime molds, fungi, plants, and animals. In addition to the developmental algorithms that build them, many also employ adaptive strategies to respond to stimuli, damage, and other environmental changes. We model these adapting network architectures using a generic dynamical system on weighted graphs and find in simulation th… ▽ More Transport networks play a key role across four realms of eukaryotic life: slime molds, fungi, plants, and animals. In addition to the developmental algorithms that build them, many also employ adaptive strategies to respond to stimuli, damage, and other environmental changes. We model these adapting network architectures using a generic dynamical system on weighted graphs and find in simulation that these networks ultimately develop a hierarchical organization of the final weighted architecture accompanied by the formation of a system-spanning backbone. In addition, we find that the long term equilibration dynamics exhibit glassy behavior characterized by long periods of slow changes punctuated by bursts of reorganization events. △ Less

Submitted 30 May, 2014; originally announced May 2014.

A Geometric Knotspace Template

Authors: Carl D. Modes, Marcelo O. Magnasco

Abstract: Early last century witnessed both the complete classification of 2-dimensional manifolds and a proof that classification of 4-dimensional manifolds is undecidable, setting up 3-dimensional manifolds as a central battleground of topology to this day. A rather important subset of the 3-manifolds has turned out to be the knotspaces, the manifolds left when a thin tube around a knot in 3D space is exc… ▽ More Early last century witnessed both the complete classification of 2-dimensional manifolds and a proof that classification of 4-dimensional manifolds is undecidable, setting up 3-dimensional manifolds as a central battleground of topology to this day. A rather important subset of the 3-manifolds has turned out to be the knotspaces, the manifolds left when a thin tube around a knot in 3D space is excised. Given a knot diagram it would be desirable to provide as compact a description of its knotspace as feasible; hitherto this has been done by computationally tessellating the knotspace of a given knot into polyhedral complexes using ad hoc methods of uncontrolled computational complexity. Here we present an extremely compact representation of the knotspace obtainable directly from a knot diagram; more technically, an explicit, geometrically-inspired polygonal tessellation of a deformation retract of the knotspace of arbitrary knots and links. Our template can be constructed directly from a planar presentation of the knot with C crossings using at most 12C polygons bounded by 64C edges, in time O(C). We show the utility of our template by deriving a novel presentation of the fundamental group, from which we motivate a measure of complexity of the knot diagram. △ Less

Submitted 26 February, 2013; v1 submitted 5 February, 2013; originally announced February 2013.

Comments: 15 pages, 11 figures

MSC Class: 57M25

Minimal Bounds on Nonlinearity in Auditory Processing

Authors: Jacob N. Oppenheim, Pavel Isakov, Marcelo O. Magnasco

Abstract: Time-reversal symmetry breaking is a key feature of nearly all natural sounds, caused by the physics of sound production. While attention has been paid to the response of the auditory system to "natural stimuli," very few psychophysical tests have been performed. We conduct psychophysical measurements of time-frequency acuity for both "natural" notes (sharp attack, long decay) and time-reversed on… ▽ More Time-reversal symmetry breaking is a key feature of nearly all natural sounds, caused by the physics of sound production. While attention has been paid to the response of the auditory system to "natural stimuli," very few psychophysical tests have been performed. We conduct psychophysical measurements of time-frequency acuity for both "natural" notes (sharp attack, long decay) and time-reversed ones. Our results demonstrate significantly greater precision, arising from enhanced temporal acuity, for such "natural" sounds over both their time-reversed versions and theoretically optimal gaussian pulses, without a corresponding decrease in frequency acuity. These data rule out models of auditory processing that obey a modified "uncertainty principle" between temporal and frequency acuity and suggest the existence of statistical priors for naturalistic stimuli, in the form of sharp-attack, long-decay notes. We are additionally able to calculate a minimal theoretical bound on the order of the nonlinearity present in auditory processing. We find that only matching pursuit, spectral derivatives, and reassigned spectrograms are able to satisfy this criterion. △ Less

Submitted 3 January, 2013; originally announced January 2013.

Comments: 9 pages, 3 figures

Human Time-Frequency Acuity Beats the Fourier Uncertainty Principle

Authors: Jacob N. Oppenheim, Marcelo O. Magnasco

Abstract: The time-frequency uncertainty principle states that the product of the temporal and frequency extents of a signal cannot be smaller than $1/(4π)$. We study human ability to simultaneously judge the frequency and the timing of a sound. Our subjects often exceeded the uncertainty limit, sometimes by more than tenfold, mostly through remarkable timing acuity. Our results establish a lower bound for… ▽ More The time-frequency uncertainty principle states that the product of the temporal and frequency extents of a signal cannot be smaller than $1/(4π)$. We study human ability to simultaneously judge the frequency and the timing of a sound. Our subjects often exceeded the uncertainty limit, sometimes by more than tenfold, mostly through remarkable timing acuity. Our results establish a lower bound for the nonlinearity and complexity of the algorithms employed by our brains in parsing transient sounds, rule out simple "linear filter" models of early auditory processing, and highlight timing acuity as a central feature in auditory object processing. △ Less

Submitted 3 January, 2013; v1 submitted 22 August, 2012; originally announced August 2012.

Comments: 4 pages, 2 figures; Accepted at PRL

A phase transition in the first passage of a Brownian process through a fluctuating boundary: implications for neural coding

Authors: Thibaud Taillefumier, Marcelo O. Magnasco

Abstract: Finding the first time a fluctuating quantity reaches a given boundary is a deceptively simple-looking problem of vast practical importance in physics, biology, chemistry, neuroscience, economics and industry. Problems in which the bound to be traversed is itself a fluctuating function of time include widely studied settings in neural coding, such as neuronal integrators with irregular inputs and… ▽ More Finding the first time a fluctuating quantity reaches a given boundary is a deceptively simple-looking problem of vast practical importance in physics, biology, chemistry, neuroscience, economics and industry. Problems in which the bound to be traversed is itself a fluctuating function of time include widely studied settings in neural coding, such as neuronal integrators with irregular inputs and internal noise. We show that the probability p(t) that a Gauss-Markov process will first exceed the boundary at time t suffers a phase transition as a function of the roughness of the boundary, as measured by its Hölder exponent H, with critical value Hc = 1/2. For smoother boundaries, H > 1/2, the probability density is a continuous func- tion of time. For rougher boundaries, H < 1/2, the probability is concentrated on a Cantor-like set of zero measure: the probability density becomes divergent, almost everywhere either zero or infin- ity. The critical point Hc = 1/2 corresponds to a widely-studied case in the theory of neural coding, where the external input integrated by a model neuron is a white-noise process, such as uncorrelated but precisely balanced excitatory and inhibitory inputs. We argue this transition corresponds to a sharp boundary between rate codes, in which the neural firing probability varies smoothly, and temporal codes, in which the neuron fires at sharply-defined times regardless of the intensity of internal noise. △ Less

Submitted 26 June, 2012; originally announced June 2012.

A Topological Phase Transition in the Scheidegger Model of River Networks

Authors: Jacob N. Oppenheim, Marcelo O. Magnasco

Abstract: We investigate the canonical Scheidegger Model of river network morphology for the case of convergent and divergent underlying topography, by embedding it on a cone. We find two distinct phases corresponding to few, long basins and many, short basins, respectively, separated by a singularity in number of basins, indicating a phase transition. Quantifying basin shape through Hack's Law $l\sim a^h$… ▽ More We investigate the canonical Scheidegger Model of river network morphology for the case of convergent and divergent underlying topography, by embedding it on a cone. We find two distinct phases corresponding to few, long basins and many, short basins, respectively, separated by a singularity in number of basins, indicating a phase transition. Quantifying basin shape through Hack's Law $l\sim a^h$ gives distinct values for the exponent $h$, providing a method of testing our hypotheses. The generality of our model suggests implications for vascular morphology, in particular differing number and shapes of arterial and venous trees. △ Less

Submitted 22 August, 2012; v1 submitted 22 May, 2012; originally announced May 2012.

Comments: 6 pages, 4 figures

Journal ref: Physical Review E, August 2012

Quantifying loopy network architectures

Authors: Eleni Katifori, Marcelo O. Magnasco

Abstract: Biology presents many examples of planar distribution and structural networks having dense sets of closed loops. An archetype of this form of network organization is the vasculature of dicotyledonous leaves, which showcases a hierarchically-nested architecture containing closed loops at many different levels. Although a number of methods have been proposed to measure aspects of the structure of su… ▽ More Biology presents many examples of planar distribution and structural networks having dense sets of closed loops. An archetype of this form of network organization is the vasculature of dicotyledonous leaves, which showcases a hierarchically-nested architecture containing closed loops at many different levels. Although a number of methods have been proposed to measure aspects of the structure of such networks, a robust metric to quantify their hierarchical organization is still lacking. We present an algorithmic framework, the hierarchical loop decomposition, that allows map** loopy networks to binary trees, preserving in the connectivity of the trees the architecture of the original graph. We apply this framework to investigate computer generated graphs, such as artificial models and optimal distribution networks, as well as natural graphs extracted from digitized images of dicotyledonous leaves and vasculature of rat cerebral neocortex. We calculate various metrics based on the Asymmetry, the cumulative size distribution and the Strahler bifurcation ratios of the corresponding trees and discuss the relationship of these quantities to the architectural organization of the original graphs. This algorithmic framework decouples the geometric information (exact location of edges and nodes) from the metric topology (connectivity and edge weight) and it ultimately allows us to perform a quantitative statistical comparison between predictions of theoretical models and naturally occurring loopy graphs. △ Less

Submitted 6 October, 2011; originally announced October 2011.

Comments: 17 pages, 8 figures. During preparation of this manuscript the authors became aware of the work of Mileyko at al., concurrently submitted for publication

A Fast $\mathcal{L}_p$ Spike Alignment Metric

Authors: Alexander J. Dubbs, Brad A. Seiler, Marcelo O. Magnasco

Abstract: The metrization of the space of neural responses is an ongoing research program seeking to find natural ways to describe, in geometrical terms, the sets of possible activities in the brain. One component of this program are the {\em spike metrics}, notions of distance between two spike trains recorded from a neuron. Alignment spike metrics work by identifying "equivalent" spikes in one train and… ▽ More The metrization of the space of neural responses is an ongoing research program seeking to find natural ways to describe, in geometrical terms, the sets of possible activities in the brain. One component of this program are the {\em spike metrics}, notions of distance between two spike trains recorded from a neuron. Alignment spike metrics work by identifying "equivalent" spikes in one train and the other. We present an alignment spike metric having $\mathcal{L}_p$ underlying geometrical structure; the $\mathcal{L}_2$ version is Euclidean and is suitable for further embedding in Euclidean spaces by Multidimensional Scaling methods or related procedures. We show how to implement a fast algorithm for the computation of this metric based on bipartite graph matching theory. △ Less

Submitted 17 July, 2009; v1 submitted 17 July, 2009; originally announced July 2009.

Damage and fluctuations induce loops in optimal transport networks

Authors: Eleni Katifori, Gergely J. Szöllősi, Marcelo O. Magnasco

Abstract: Leaf venation is a pervasive example of a complex biological network, endowing leaves with a transport system and mechanical resilience. Transport networks optimized for efficiency have been shown to be trees, i.e. loopless. However, dicotyledon leaf venation has a large number of closed loops, which are functional and able to transport fluid in the event of damage to any vein, including the pri… ▽ More Leaf venation is a pervasive example of a complex biological network, endowing leaves with a transport system and mechanical resilience. Transport networks optimized for efficiency have been shown to be trees, i.e. loopless. However, dicotyledon leaf venation has a large number of closed loops, which are functional and able to transport fluid in the event of damage to any vein, including the primary veins. Inspired by leaf venation, we study two possible reasons for the existence of a high density of loops in transport networks: resilience to damage and fluctuations in load. In the first case, we seek the optimal transport network in the presence of random damage by averaging over damage to each link. In the second case, we seek the network that optimizes transport when the load is sparsely distributed: at any given time most sinks are closed. We find that both criteria lead to the presence of loops in the optimum state. △ Less

Submitted 29 May, 2009; originally announced June 2009.

Dynamical and Statistical Criticality in a Model of Neural Tissue

Authors: Marcelo O. Magnasco, Oreste Piro, Guillermo A. Cecchi

Abstract: For the nervous system to work at all, a delicate balance of excitation and inhibition must be achieved. However, when such a balance is sought by global strategies, only few modes remain balanced close to instability, and all other modes are strongly stable. Here we present a simple model of neural tissue in which this balance is sought locally by neurons following `anti-Hebbian' behavior: {\sl… ▽ More For the nervous system to work at all, a delicate balance of excitation and inhibition must be achieved. However, when such a balance is sought by global strategies, only few modes remain balanced close to instability, and all other modes are strongly stable. Here we present a simple model of neural tissue in which this balance is sought locally by neurons following `anti-Hebbian' behavior: {\sl all} degrees of freedom achieve a close balance of excitation and inhibition and become "critical" in the dynamical sense. At long timescales, the modes of our model oscillate around the instability line, so an extremely complex "breakout" dynamics ensues in which different modes of the system oscillate between prominence and extinction. We show the system develops various anomalous statistical behaviours and hence becomes self-organized critical in the statistical sense. △ Less

Submitted 28 August, 2008; originally announced August 2008.

A Haar-like Construction for the Ornstein Uhlenbeck Process

Authors: Thibaud Taillefumier, Marcelo O. Magnasco

Abstract: The classical Haar construction of Brownian motion uses a binary tree of triangular wedge-shaped functions. This basis has compactness properties which make it especially suited for certain classes of numerical algorithms. We present a similar basis for the Ornstein-Uhlenbeck process, in which the basis elements approach asymptotically the Haar functions as the index increases, and preserve the… ▽ More The classical Haar construction of Brownian motion uses a binary tree of triangular wedge-shaped functions. This basis has compactness properties which make it especially suited for certain classes of numerical algorithms. We present a similar basis for the Ornstein-Uhlenbeck process, in which the basis elements approach asymptotically the Haar functions as the index increases, and preserve the following properties of the Haar basis: all basis elements have compact support on an open interval with dyadic rational endpoints; these intervals are nested and become smaller for larger indices of the basis element, and for any dyadic rational, only a finite number of basis elements is nonzero at that number. Thus the expansion in our basis, when evaluated at a dyadic rational, terminates in a finite number of steps. We prove the covariance formulae for our expansion and discuss its statistical interpretation and connections to asymptotic scale invariance. △ Less

Submitted 11 September, 2007; originally announced September 2007.

Comments: 20 pages, 3 figures

Efficiency, selectivity and robustness of the nuclear pore complex transport

Authors: A. Zilman, S. DiTalia, B. T. Chait, M. P Rout, M. O. Magnasco

Abstract: All materials enter or exit the cell nucleus through nuclear pore complexes (NPCs), efficient transport devices that combine high selectivity and throughput. A central feature of this transport is the binding of cargo-carrying soluble transport factors to flexible, unstructured proteinaceous filaments called FG-nups that line the NPC. We have modeled the dynamics of transport factors and their i… ▽ More All materials enter or exit the cell nucleus through nuclear pore complexes (NPCs), efficient transport devices that combine high selectivity and throughput. A central feature of this transport is the binding of cargo-carrying soluble transport factors to flexible, unstructured proteinaceous filaments called FG-nups that line the NPC. We have modeled the dynamics of transport factors and their interaction with the flexible FG-nups as diffusion in an effective potential, using both analytical theory and computer simulations. We show that specific binding of transport factors to the FG-nups facilitates transport and provides the mechanism of selectivity. We show that the high selectivity of transport can be accounted for by competition for both binding sites and space inside the NPC, which selects for transport factors over other macromolecules that interact only non-specifically with the NPC. We also show that transport is relatively insensitive to changes in the number and distribution of FG-nups in the NPC, due mainly to their flexibility; this accounts for recent experiments where up to half of the total mass of the NPC has been deleted, without abolishing the transport. Notably, we demonstrate that previously established physical and structural properties of the NPC can account for observed features of nucleocytoplasmic transport. Finally, our results suggest strategies for creation of artificial nano-molecular sorting devices. △ Less

Submitted 26 September, 2006; originally announced September 2006.

Comments: 38 pages, six figures

Structure, Scaling and Phase Transition in the Optimal Transport Network

Authors: Steffen Bohn, Marcelo O. Magnasco

Abstract: We minimize the dissipation rate of an electrical network under a global constraint on the sum of powers of the conductances. We construct the explicit scaling relation between currents and conductances, and show equivalence to a a previous model [J. R. Banavar {\it et al} Phys. Rev. Lett. {\bf 84}, 004745 (2000)] optimizing a power-law cost function in an abstract network. We show the currents… ▽ More We minimize the dissipation rate of an electrical network under a global constraint on the sum of powers of the conductances. We construct the explicit scaling relation between currents and conductances, and show equivalence to a a previous model [J. R. Banavar {\it et al} Phys. Rev. Lett. {\bf 84}, 004745 (2000)] optimizing a power-law cost function in an abstract network. We show the currents derive from a potential, and the scaling of the conductances depends only locally on the currents. A numerical study reveals that the transition in the topology of the optimal network corresponds to a discontinuity in the slope of the power dissipation. △ Less

Submitted 31 July, 2006; originally announced July 2006.

Comments: 4 pages, 3 figures

Computational Models of Adult Neurogenesis

Authors: Guillermo A. Cecchi, Marcelo O. Magnasco

Abstract: Experimental results in recent years have shown that adult neurogenesis is a significant phenomenon in the mammalian brain. Little is known, however, about the functional role played by the generation and destruction of neurons in the context of and adult brain. Here we propose two models where new projection neurons are incorporated. We show that in both models, using incorporation and removal… ▽ More Experimental results in recent years have shown that adult neurogenesis is a significant phenomenon in the mammalian brain. Little is known, however, about the functional role played by the generation and destruction of neurons in the context of and adult brain. Here we propose two models where new projection neurons are incorporated. We show that in both models, using incorporation and removal of neurons as a computational tool, it is possible to achieve a higher computational efficiency that in purely static, synapse-learning driven networks. We also discuss the implication for understanding the role of adult neurogenesis in specific brain areas. △ Less

Submitted 16 December, 2004; originally announced December 2004.

Comments: To appear Physica A, 7 pages

Solving the riddle of the bright mismatches: hybridization in oligonucleotide arrays

Authors: Felix Naef, Marcelo O. Magnasco

Abstract: HDONA technology is predicated on two ideas. First, the differential between high-affinity (perfect match, PM) and lower-affinity (mismatch, MM) probes is used to minimize cross-hybridization. Second, several short probes along the transcript are combined, introducing redundancy. Both ideas have shown problems in practice: MMs are often brighter than PMs, and it is hard to combine the pairs beca… ▽ More HDONA technology is predicated on two ideas. First, the differential between high-affinity (perfect match, PM) and lower-affinity (mismatch, MM) probes is used to minimize cross-hybridization. Second, several short probes along the transcript are combined, introducing redundancy. Both ideas have shown problems in practice: MMs are often brighter than PMs, and it is hard to combine the pairs because their brightness often spans decades. Previous analysis suggested these problems were sequence-related; publication of the probe sequences has permitted us an in-depth study of this issue. Our results suggest that fluorescently labeling the nucleotides interferes with mRNA binding, causing a catch-22 since, to be detected, the target mRNA must both glow and stick to its probe: without labels it cannot be seen even if bound, while with too many it won't bind. We show that this conflict causes much of the complexity of HDONA raw data, suggesting that an accurate physical understanding of hybridization by incorporating sequence information is necessary to perfect microarray analysis. △ Less

Submitted 28 August, 2002; originally announced August 2002.

Comments: 4 figures

A study of accuracy and precision in oligonucleotide arrays: extracting more signal at large concentrations

Authors: Felix Naef, Nicholas D. Socci, Marcelo Magnasco

Abstract: Despite the success and popularity of oligonucleotide arrays as a high-throughput technique for measuring mRNA expression levels, quantitative calibration studies have until now been limited. The main reason is that suitable data was not available. However, calibration data recently produced by Affymetrix now permits detailed studies of the intensity dependent sensitivity. Given a certain transc… ▽ More Despite the success and popularity of oligonucleotide arrays as a high-throughput technique for measuring mRNA expression levels, quantitative calibration studies have until now been limited. The main reason is that suitable data was not available. However, calibration data recently produced by Affymetrix now permits detailed studies of the intensity dependent sensitivity. Given a certain transcript concentration, it is of particular interest to know whether current analysis methods are capable of detecting differential expression ratios of 2 or higher. Using the calibration data, we demonstrate that while current techniques are capable of detecting changes in the low to mid concentration range, the situation is noticeably worse for high concentrations. In this regime, expression changes as large as 4 fold are severely biased, and changes of 2 are often undetectable. Such effects are mainly the consequence of the sequence specific binding properties of probes, and not the result of optical saturation in the fluorescence measurements. GeneChips are manufactured such that each transcript is probed by a set of sequences with a wide affinity range. We show that this property can be used to design a method capable of reducing the high intensity bias. The idea behind our methods is to transfers the weight of a measurement to a subset of probes with optimal linear response at a given concentration, which can be achieved using local embedding techniques. △ Less

Submitted 27 August, 2002; v1 submitted 10 May, 2002; originally announced May 2002.

Comments: 11 pages, 5 figures, please email authors for better quality figures; accepted

Bailout Embeddings and Neutrally Buoyant Particles in Three-Dimensional Flows

Authors: J. H. E. Cartwright, M. O. Magnasco, O. Piro, I. tuval

Abstract: We use the bailout embeddings of three-dimensional volume-preserving maps to study qualitatively the dy- namics of small spherical neutrally buoyant impurities suspended in a time-periodic incompressible fluid flow. The accumulation of impurities in tubular vortical structures, the detachment of particles from fluid trajectories near hyperbolic invariant lines, and the formation of nontrivial thre… ▽ More We use the bailout embeddings of three-dimensional volume-preserving maps to study qualitatively the dy- namics of small spherical neutrally buoyant impurities suspended in a time-periodic incompressible fluid flow. The accumulation of impurities in tubular vortical structures, the detachment of particles from fluid trajectories near hyperbolic invariant lines, and the formation of nontrivial three-dimensional structures in the distribution of particles are predicted. △ Less

Submitted 30 June, 2012; v1 submitted 3 April, 2002; originally announced April 2002.

Comments: 4 pages, 3 figures

Journal ref: Phys. Rev. Lett. 89, 264501, 2002

The Cochlear Tuning Curve

Authors: Marcelo O. Magnasco

Abstract: The tuning curve of the cochlea measures how large an input is required to elicit a given output level as a function of the frequency. It is a fundamental object of auditory theory, for it summarizes how to infer what a sound was on the basis of the cochlear output. A simple model is presented showing that only two elements are sufficient for establishing the cochlear tuning curve: a broadly tun… ▽ More The tuning curve of the cochlea measures how large an input is required to elicit a given output level as a function of the frequency. It is a fundamental object of auditory theory, for it summarizes how to infer what a sound was on the basis of the cochlear output. A simple model is presented showing that only two elements are sufficient for establishing the cochlear tuning curve: a broadly tuned traveling wave, moving unidirectionally from high to low frequencies, and a set of mechanosensors poised at the threshold of an oscillatory (Hopf) instability. These two components suffice to generate the various frequency-response regimes which are needed for a cochlear tuning curve with a high slope. △ Less

Submitted 28 November, 2001; originally announced November 2001.

DNA hybridization to mismatched templates: a chip study

Authors: Felix Naef, Daniel A. Lim, Nila Patil, Marcelo Magnasco

Abstract: High-density oligonucleotide arrays are among the most rapidly expanding technologies in biology today. In the {\sl GeneChip} system, the reconstruction of the target concentration depends upon the differential signal generated from hybridizing the target RNA to two nearly identical templates: a perfect match (PM) and a single mismatch (MM) probe. It has been observed that a large fraction of MM… ▽ More High-density oligonucleotide arrays are among the most rapidly expanding technologies in biology today. In the {\sl GeneChip} system, the reconstruction of the target concentration depends upon the differential signal generated from hybridizing the target RNA to two nearly identical templates: a perfect match (PM) and a single mismatch (MM) probe. It has been observed that a large fraction of MM probes repeatably bind targets better than the PMs, against the usual expectation from sequence-specific hybridization; this is difficult to interpret in terms of the underlying physics. We examine this problem via a statistical analysis of a large set of microarray experiments. We classify the probes according to their signal to noise ($S/N$) ratio, defined as the eccentricity of a (PM, MM) pair's `trajectory' across many experiments. Of those probes having large $S/N$ ($>3$) only a fraction behave consistently with the commonly assumed hybridization model. Our results imply that the physics of DNA hybridization in microarrays is more complex than expected, and they suggest new ways of constructing estimators for the target RNA concentration. △ Less

Submitted 27 November, 2001; originally announced November 2001.

Comments: 3 figures 1 table

Noise and Inertia-Induced Inhomogeneity in the Distribution of Small Particles in Fluid Flows

Authors: Julyan H. E. Cartwright, Marcelo O. Magnasco, Oreste Piro

Abstract: The dynamics of small spherical neutrally buoyant particulate impurities immersed in a two-dimensional fluid flow are known to lead to particle accumulation in the regions of the flow in which rotation dominates over shear, provided that the Stokes number of the particles is sufficiently small. If the flow is viewed as a Hamiltonian dynamical system, it can be seen that the accumulations occur i… ▽ More The dynamics of small spherical neutrally buoyant particulate impurities immersed in a two-dimensional fluid flow are known to lead to particle accumulation in the regions of the flow in which rotation dominates over shear, provided that the Stokes number of the particles is sufficiently small. If the flow is viewed as a Hamiltonian dynamical system, it can be seen that the accumulations occur in the nonchaotic parts of the phase space: the Kolmogorov--Arnold--Moser tori. This has suggested a generalization of these dynamics to Hamiltonian maps, dubbed a bailout embedding. In this paper we use a bailout embedding of the standard map to mimic the dynamics of impurities subject not only to drag but also to fluctuating forces modelled as white noise. We find that the generation of inhomogeneities associated with the separation of particle from fluid trajectories is enhanced by the presence of noise, so that they appear in much broader ranges of the Stokes number than those allowing spontaneous separation. △ Less

Submitted 2 November, 2001; originally announced November 2001.

Journal ref: Chaos (2002) 12(2):489-495

Bailout Embeddings, Targeting of KAM Orbits, and the Control of Hamiltonian Chaos

Authors: Julyan H. E. Cartwright, Marcelo O. Magnasco, Oreste Piro

Abstract: We present a novel technique, which we term bailout embedding, that can be used to target orbits having particular properties out of all orbits in a flow or map. We explicitly construct a bailout embedding for Hamiltonian systems so as to target KAM orbits. We show how the bailout dynamics is able to lock onto extremely small KAM islands in an ergodic sea. We present a novel technique, which we term bailout embedding, that can be used to target orbits having particular properties out of all orbits in a flow or map. We explicitly construct a bailout embedding for Hamiltonian systems so as to target KAM orbits. We show how the bailout dynamics is able to lock onto extremely small KAM islands in an ergodic sea. △ Less

Submitted 2 November, 2001; originally announced November 2001.

Comments: 3 figures, 9 subpanels

Journal ref: Phys. Rev. E 65, 045203(R) (2002)

Negative Resistance in Brownian Transport

Authors: Guillermo A. Cecchi, Marcelo O. Magnasco

Abstract: We prove that negative incremental resistance cannot occur on 1D spaces like the circle or the line; we construct an explicit two-dimensional model on the cylinder, and its collapse into a branched 1D backbone. We derive an accurate numerical method for solving our 2D model, and discuss the relevance of the model to biological ion channels. We prove that negative incremental resistance cannot occur on 1D spaces like the circle or the line; we construct an explicit two-dimensional model on the cylinder, and its collapse into a branched 1D backbone. We derive an accurate numerical method for solving our 2D model, and discuss the relevance of the model to biological ion channels. △ Less

Submitted 4 May, 2001; originally announced May 2001.

Comments: 3 separate figures

Journal ref: Physical Review Letters 78 (11) 1968-1971 (1996)

On a common circle: natural scenes and Gestalt rules

Authors: M. Sigman, G. A. Cecchi, C. D. Gilbert, M. O. Magnasco

Abstract: To understand how the human visual system analyzes images, it is essential to know the structure of the visual environment. In particular, natural images display consistent statistical properties that distinguish them from random luminance distributions. We have studied the geometric regularities of oriented elements (edges or line segments) present in an ensemble of visual scenes, asking how mu… ▽ More To understand how the human visual system analyzes images, it is essential to know the structure of the visual environment. In particular, natural images display consistent statistical properties that distinguish them from random luminance distributions. We have studied the geometric regularities of oriented elements (edges or line segments) present in an ensemble of visual scenes, asking how much information the presence of a segment in a particular location of the visual scene carries about the presence of a second segment at different relative positions and orientations. We observed strong long-range correlations in the distribution of oriented segments that extend over the whole visual field. We further show that a very simple geometric rule, cocircularity, predicts the arrangement of segments in natural scenes, and that different geometrical arrangements show relevant differences in their scaling properties. Our results show similarities to geometric features of previous physiological and psychophysical studies. We discuss the implications of these findings for theories of early vision. △ Less

Submitted 4 May, 2001; originally announced May 2001.

Comments: 3 figures, 2 large figures not included

Journal ref: Proc. Natl. Acad. Sci. 98: 1935-1940 (2001)

Unsupervised learning and adaptation in a model of adult neurogenesis

Authors: Guillermo A. Cecchi, Leopoldo T. Petreanu, Arturo Alvarez-Buylla, Marcelo O. Magnasco

Abstract: Adult neurogenesis has long been documented in the vertebrate brain, and recently even in humans. Although it has been conjectured for many years that its functional role is related to the renewing of memories, no clear mechanism as to how this can be achieved has been proposed. We present a scheme in which incorporation of new neurons proceeds at a constant rate, while their survival is activit… ▽ More Adult neurogenesis has long been documented in the vertebrate brain, and recently even in humans. Although it has been conjectured for many years that its functional role is related to the renewing of memories, no clear mechanism as to how this can be achieved has been proposed. We present a scheme in which incorporation of new neurons proceeds at a constant rate, while their survival is activity-dependent and thus contingent upon new neurons establishing suitable connections. We show that a simple mathematical model following these rules organizes its activity so as to maximize the difference between its responses, and can adapt to changing environmental conditions in unsupervised fashion. △ Less

Submitted 3 May, 2001; originally announced May 2001.

Comments: 6 figures

From features to expression: High-density oligonucleotide array analysis revisited

Authors: Felix Naef, Daniel A. Lim, Nila Patil, Marcelo O. Magnasco

Abstract: One of the most popular tools for large scale gene expression studies are high-density oligonucleotide (GeneChip(R)) arrays. These currently have 16-20 small probe cells (``features'') for evaluating the transcript abundance of each gene. In addition, each probe is accompanied by a mismatched probe designed as a control for non-specificity. An algorithm is presented to compute comparative expres… ▽ More One of the most popular tools for large scale gene expression studies are high-density oligonucleotide (GeneChip(R)) arrays. These currently have 16-20 small probe cells (``features'') for evaluating the transcript abundance of each gene. In addition, each probe is accompanied by a mismatched probe designed as a control for non-specificity. An algorithm is presented to compute comparative expression levels from the intensities of the individual features, based on a statistical study of their distribution. Interestingly, MM probes need not be included in the analysis. We show that our algorithm improves significantly upon the current standard and leads to a substantially larger number of genes brought above the noise floor for further analysis. △ Less

Submitted 21 February, 2001; v1 submitted 5 February, 2001; originally announced February 2001.

Comments: 9 pages, 7 figures

The thunder of distant Net storms

Authors: Marcelo O. Magnasco

Abstract: Computers and routers on the Internet send each other error messages (called ICMP datagrams) to signal conditions such as network congestion or blackouts. While these datagrams are very rare, less than 0.001% of total traffic, they hold very important global information about problems and congestions elsewhere in the Net. A measurement of the flow of such error messages in our local cluster show… ▽ More Computers and routers on the Internet send each other error messages (called ICMP datagrams) to signal conditions such as network congestion or blackouts. While these datagrams are very rare, less than 0.001% of total traffic, they hold very important global information about problems and congestions elsewhere in the Net. A measurement of the flow of such error messages in our local cluster shows a very pathological distribution of inter-message times: $P(Δt) \approx 1/Δt$. This scaling extends for about seven decades, and is only punctuated by extraneously periodic signals from automatons. More than a half of these error messages were themselves generated erroneously. △ Less

Submitted 29 October, 2000; originally announced October 2000.

Essential nonlinearities in hearing

Authors: V. M. Eguiluz, M. Ospeck, Y. Choe, A. J. Hudspeth, M. O. Magnasco

Abstract: Our hearing organ, the cochlea, evidently poises itself at a Hopf bifurcation to maximize tuning and amplification. We show that in this condition several effects are expected to be generic: compression of the dynamic range, infinitely shrap tuning at zero input, and generation of combination tones. These effects are "essentially" nonlinear in that they become more marked the smaller the forcing… ▽ More Our hearing organ, the cochlea, evidently poises itself at a Hopf bifurcation to maximize tuning and amplification. We show that in this condition several effects are expected to be generic: compression of the dynamic range, infinitely shrap tuning at zero input, and generation of combination tones. These effects are "essentially" nonlinear in that they become more marked the smaller the forcing: there is no audible sound soft enough not to evoke them. All the well-documented nonlinear aspects of hearing therefore appear to be consequences of the same underlying mechanism. △ Less

Submitted 19 May, 2000; originally announced May 2000.

Comments: 4 pages, 3 figures

Journal ref: Phys. Rev. Lett. 84, 5232 (2000)

Noise in neurons is message-dependent

Authors: Guillermo A. Cecchi, Mariano Sigman, Jose-Manuel Alonso, Luis Martinez, Dante R. Chialvo, Marcelo O. Magnasco

Abstract: Neuronal responses are conspicuously variable. We focus on one particular aspect of that variability: the precision of action potential timing. We show that for common models of noisy spike generation, elementary considerations imply that such variability is a function of the input, and can be made arbitrarily large or small by a suitable choice of inputs. Our considerations are expected to exte… ▽ More Neuronal responses are conspicuously variable. We focus on one particular aspect of that variability: the precision of action potential timing. We show that for common models of noisy spike generation, elementary considerations imply that such variability is a function of the input, and can be made arbitrarily large or small by a suitable choice of inputs. Our considerations are expected to extend to virtually any mechanism of spike generation, and we illustrate them with data from the visual pathway. Thus, a simplification usually made in the application of information theory to neural processing is violated: noise {\sl is not independent of the message}. However, we also show the existence of {\sl error-correcting} topologies, which can achieve better timing reliability than their components. △ Less

Submitted 28 April, 2000; originally announced April 2000.

Comments: 6 pages,6 figures. Proceedings of the National Academy of Sciences (in press)

Journal ref: Proceedings of the National Academy of Sciences, 97(10), 5557-61 (2000)

Noise-induced memory in extended excitable systems

Authors: Dante R. Chialvo, Guillermo A. Cecchi, Marcelo O. Magnasco

Abstract: We describe a form of memory exhibited by extended excitable systems driven by stochastic fluctuations. Under such conditions, the system self-organizes into a state characterized by power-law correlations thus retaining long-term memory of previous states. The exponents are robust and model-independent. We discuss novel implications of these results for the functioning of cortical neurons as we… ▽ More We describe a form of memory exhibited by extended excitable systems driven by stochastic fluctuations. Under such conditions, the system self-organizes into a state characterized by power-law correlations thus retaining long-term memory of previous states. The exponents are robust and model-independent. We discuss novel implications of these results for the functioning of cortical neurons as well as for networks of neurons. △ Less

Submitted 4 May, 1999; originally announced May 1999.

Comments: 4 pages, latex + 5 eps figures