Showing 1–22 of 22 results for author: Maclaurin, J

Large Deviations of Piecewise-Deterministic-Markov-Processes with Application to Stochastic Calcium Waves

Authors: Gaetan Barbet, James MacLaurin, Moshe Silverstein

Abstract: We prove a Large Deviation Principle for Piecewise Deterministic Markov Processes (PDMPs). This is an asymptotic estimate for the probability of a trajectory in the large size limit. Explicit Euler-Lagrange equations are determined for computing optimal first-hitting-time trajectories. The results are applied to a model of stochastic calcium dynamics. It is widely conjectured that the mechanism of… ▽ More We prove a Large Deviation Principle for Piecewise Deterministic Markov Processes (PDMPs). This is an asymptotic estimate for the probability of a trajectory in the large size limit. Explicit Euler-Lagrange equations are determined for computing optimal first-hitting-time trajectories. The results are applied to a model of stochastic calcium dynamics. It is widely conjectured that the mechanism of calcium puff generation is a multiscale process: with microscopic stochastic fluctuations in the opening and closing of individual channels generating cell-wide waves via the diffusion of calcium and other signaling molecules. We model this system as a PDMP, with $N \gg 1$ stochastic calcium channels that are coupled via the ambient calcium concentration. We employ the Large Deviations theory to estimate the probability of cell-wide calcium waves being produced through microscopic stochasticity. △ Less

Submitted 18 June, 2024; originally announced June 2024.

Population Level Activity in Large Random Neural Networks

Authors: James MacLaurin, Moshe Silverstein, Pedro Vilanova

Abstract: We determine limiting equations for large asymmetric `spin glass' networks. The initial conditions are not assumed to be independent of the disordered connectivity: one of the main motivations for this is that allows one to understand how the structure of the limiting equations depends on the energy landscape of the random connectivity. The method is to determine the convergence of the double empi… ▽ More We determine limiting equations for large asymmetric `spin glass' networks. The initial conditions are not assumed to be independent of the disordered connectivity: one of the main motivations for this is that allows one to understand how the structure of the limiting equations depends on the energy landscape of the random connectivity. The method is to determine the convergence of the double empirical measure (this yields population density equations for the joint distribution of the spins and fields). The limiting dynamics is expressed in terms of a fixed point operator. It is proved that repeated applications of this operator must converge to the limiting dynamics (thus yielding a relatively efficient means of numerically simulating the limiting equations, △ Less

Submitted 11 February, 2024; v1 submitted 26 January, 2024; originally announced January 2024.

Extreme first passage times for populations of identical rare events

Authors: James MacLaurin, Jay M. Newby

Abstract: A collection of identical and independent rare event first passage times is considered. The problem of finding the fastest out of $N$ such events to occur is called an extreme first passage time. The rare event times are singular and limit to infinity as a positive parameter scaling the noise magnitude is reduced to zero. In contrast, previous work has shown that the mean of the fastest event time… ▽ More A collection of identical and independent rare event first passage times is considered. The problem of finding the fastest out of $N$ such events to occur is called an extreme first passage time. The rare event times are singular and limit to infinity as a positive parameter scaling the noise magnitude is reduced to zero. In contrast, previous work has shown that the mean of the fastest event time goes to zero in the limit of an infinite number of walkers. The combined limit is studied. In particular, the mean time and the most likely path taken by the fastest random walker are investigated. Using techniques from large deviation theory, it is shown that there is a distinguished limit where the mean time for the fastest walker can take any positive value, depending on a single proportionality constant. Furthermore, it is shown that the mean time and most likely path can be approximated using the solution to a variational problem related to the single-walker rare event. △ Less

Submitted 24 April, 2024; v1 submitted 4 September, 2023; originally announced September 2023.

The Isochronal Phase of Stochastic PDE and Integral Equations: Metastability and Other Properties

Authors: Zachary P. Adams, James MacLaurin

Abstract: We study the dynamics of waves, oscillations, and other spatio-temporal patterns in stochastic evolution systems, including SPDE and stochastic integral equations. Representing a given pattern as a smooth, stable invariant manifold of the deterministic dynamics, we reduce the stochastic dynamics to a finite dimensional SDE on this manifold using the isochronal phase. The isochronal phase is define… ▽ More We study the dynamics of waves, oscillations, and other spatio-temporal patterns in stochastic evolution systems, including SPDE and stochastic integral equations. Representing a given pattern as a smooth, stable invariant manifold of the deterministic dynamics, we reduce the stochastic dynamics to a finite dimensional SDE on this manifold using the isochronal phase. The isochronal phase is defined by map** a neighbourbhood of the manifold onto the manifold itself, analogous to the isochronal phase defined for finite-dimensional oscillators by A.T.~Winfree and J.~Guckenheimer. We then determine a probability measure that indicates the average position of the stochastic perturbation of the pattern/wave as it wanders over the manifold. It is proved that this probability measure is accurate on time-scales greater than $O(σ^{-2})$, but less than $O(\exp(Cσ^{-2}))$, where $σ\ll1$ is the amplitude of the stochastic perturbation. Moreover, using this measure, we determine the expected velocity of the difference between the deterministic and stochastic motion on the manifold. △ Less

Submitted 27 June, 2023; v1 submitted 19 October, 2022; originally announced October 2022.

Comments: 41 pages

MSC Class: 60H15; 35R60

Stochastic Rotating Waves

Authors: Christian Kuehn, James MacLaurin, Giulio Zucal

Abstract: Stochastic dynamics has emerged as one of the key themes ranging from models in applications to theoretical foundations in mathematics. One class of stochastic dynamics problems that has received considerable attention recently are travelling wave patterns occurring in stochastic partial differential equations (SPDEs), i.e., how deterministic travelling waves behave under stochastic perturbations.… ▽ More Stochastic dynamics has emerged as one of the key themes ranging from models in applications to theoretical foundations in mathematics. One class of stochastic dynamics problems that has received considerable attention recently are travelling wave patterns occurring in stochastic partial differential equations (SPDEs), i.e., how deterministic travelling waves behave under stochastic perturbations. In this paper, we start the mathematical study of related class of problems: stochastic rotating waves generated by SPDEs. We combine deterministic dynamics PDE techniques with methods from stochastic analysis. We establish two different approaches, the variational phase and the approximated variational phase, for defining stochastic phase variables along the rotating wave, which track the effect of noise on neutral spectral modes associated to the special Euclidean symmetry group of rotating waves. Furthermore, we prove transverse stability results for rotating waves showing that over certain time scales and for small noise, the stochastic rotating wave stays close to its deterministic counterpart. △ Less

Submitted 13 November, 2021; originally announced November 2021.

Comments: 40 pages, preprint; comments and suggestions welcome

Large Deviations of Non-Stochastic Interacting Particles on Sparse Random Graphs

Authors: James MacLaurin

Abstract: This paper concerns the large deviations of a system of interacting particles on a random graph. There is no stochasticity, and the only sources of disorder are the random graph connections, and the initial condition. The average number of afferent edges on any particular vertex must diverge to infinity as $N\to \infty$, but can do so at an arbitrarily slow rate. These results are thus accurate fo… ▽ More This paper concerns the large deviations of a system of interacting particles on a random graph. There is no stochasticity, and the only sources of disorder are the random graph connections, and the initial condition. The average number of afferent edges on any particular vertex must diverge to infinity as $N\to \infty$, but can do so at an arbitrarily slow rate. These results are thus accurate for both sparse and dense random graphs. A particular application to sparse Erdos-Renyi graphs is provided. The theorem is proved by pushing forward a Large Deviation Principle for a `nested empirical measure' generated by the initial conditions to the dynamics. The nested empirical measure can be thought of as the density of the density of edge connections: the associated weak topology is more coarse than the topology generated by the graph cut norm, and thus there is a broader range of application. △ Less

Submitted 3 March, 2021; v1 submitted 27 October, 2020; originally announced October 2020.

Comments: I rearranged section 4.1, reworking the compactness proof

Metastability of Waves and Patterns Subject to Spatially-Extended Noise

Authors: James MacLaurin

Abstract: In this paper we present a general framework in which one can rigorously study the effect of spatio-temporal noise on traveling waves, stationary patterns and oscillations that are invariant under the action of a finite-dimensional set of continuous isometries (such as translation or rotation). This formalism can accommodate patterns, waves and oscillations in reaction-diffusion systems and neural… ▽ More In this paper we present a general framework in which one can rigorously study the effect of spatio-temporal noise on traveling waves, stationary patterns and oscillations that are invariant under the action of a finite-dimensional set of continuous isometries (such as translation or rotation). This formalism can accommodate patterns, waves and oscillations in reaction-diffusion systems and neural field equations. To do this, we define the phase by precisely projecting the infinite-dimensional system onto the manifold of isometries. Two differing types of stochastic phase dynamics are defined: (i) a variational phase, obtained by insisting that the difference between the projection and the original solution is orthogonal to the non-decaying eigenmodes, and (ii) an isochronal phase, defined as the limiting point on manifold obtained by taking $t\to\infty$ in the absence of noise. We outline precise stochastic differential equations for both types of phase. The variational phase SDE is then used to show that the probability of the system leaving the attracting basin of the manifold after an exponentially long period of time (in $ε^{-2}$, the magnitude of the noise) is exponentially unlikely. In the case that the manifold is periodic (such as for spiral waves, spatially-distributed oscillations, or neural-field phenomena on a compact domain), the isochronal phase SDE is used to determine asymptotic limits for the average occupation times of the phase as it wanders in the basin of attraction of the manifold over very long times. In particular, we find that frequently the correlation structure of the noise biases the wandering in a particular direction, such that the noise induces a slow oscillation that would not be present in the absence of noise. △ Less

Submitted 22 June, 2020; originally announced June 2020.

An Emergent Autonomous Flow for Mean-Field Spin Glasses

Authors: James MacLaurin

Abstract: We study the dynamics of symmetric and asymmetric spin-glass models of size $N$. The analysis is in terms of the double empirical process: this contains both the spins, and the field felt by each spin, at a particular time (without any knowledge of the correlation history). It is demonstrated that in the large $N$ limit, the dynamics of the double empirical process becomes deterministic and autono… ▽ More We study the dynamics of symmetric and asymmetric spin-glass models of size $N$. The analysis is in terms of the double empirical process: this contains both the spins, and the field felt by each spin, at a particular time (without any knowledge of the correlation history). It is demonstrated that in the large $N$ limit, the dynamics of the double empirical process becomes deterministic and autonomous over finite time intervals. This does not contradict the well-known fact that SK spin-glass dynamics is non-Markovian (in the large $N$ limit) because the empirical process has a topology that does not discern correlations in individual spins at different times. In the large $N$ limit, the evolution of the density of the double empirical process approaches a nonlocal autonomous PDE operator $Φ_t$. Because the emergent dynamics is autonomous, in future work one will be able to apply PDE techniques to analyze bifurcations in $Φ_t$. Preliminary numerical results for the SK Glauber dynamics suggest that the `glassy dynamical phase transition' occurs when a stable fixed point of the flow operator $Φ_t$ destabilizes. △ Less

Submitted 23 February, 2021; v1 submitted 14 March, 2020; originally announced March 2020.

Comments: I have revised the manuscript, reorganising much of the structure, and including more details in many of the proofs

The meanfield limit of a network of Hopfield neurons with correlated synaptic weights

Authors: Olivier Faugeras, James Maclaurin, Etienne Tanre

Abstract: We study the asymptotic behaviour for asymmetric neuronal dynamics in a network of Hopfield neurons. The randomness in the network is modelled by random couplings which are centered Gaussian correlated random variables. We prove that the annealed law of the empirical measure satisfies a large deviation principle without any condition on time. We prove that the good rate function of this large devi… ▽ More We study the asymptotic behaviour for asymmetric neuronal dynamics in a network of Hopfield neurons. The randomness in the network is modelled by random couplings which are centered Gaussian correlated random variables. We prove that the annealed law of the empirical measure satisfies a large deviation principle without any condition on time. We prove that the good rate function of this large deviation principle achieves its minimum value at a unique Gaussian measure which is not Markovian. This implies almost sure convergence of the empirical measure under the quenched law. We prove that the limit equations are expressed as an infinite countable set of linear non Markovian SDEs. △ Less

Submitted 13 May, 2019; v1 submitted 29 January, 2019; originally announced January 2019.

Comments: 102 pages

MSC Class: 60F10; 60H10; 60K35; 82C44; 82C31; 82C22; 92B20

Phase Reduction of Stochastic Biochemical Oscillators

Authors: Paul C. Bressloff, James N. MacLaurin

Abstract: A common method for analyzing the effects of molecular noise in chemical reaction networks is to approximate the underlying chemical master equation by a Fokker-Planck equation, and to study the statistics of the associated chemical Langevin equation. This so-called diffusion approximation involves performing a perturbation expansion with respect to a small dimensionless parameter $ε=Ω^{-1}$, wher… ▽ More A common method for analyzing the effects of molecular noise in chemical reaction networks is to approximate the underlying chemical master equation by a Fokker-Planck equation, and to study the statistics of the associated chemical Langevin equation. This so-called diffusion approximation involves performing a perturbation expansion with respect to a small dimensionless parameter $ε=Ω^{-1}$, where $Ω$ characterizes the system size. For example, $Ω$ could be the mean number of proteins produced by a gene regulatory network. In the deterministic limit $Ω\rightarrow \infty$, the chemical reaction network evolves according to a system of ordinary differential equations based on classical mass action kinetics. In this paper we develop a phase reduction method for chemical reaction networks that support a stable limit cycle in the deterministic limit. We present a variational principle for the phase reduction, yielding an exact analytic expression for the resulting phase dynamics. We demonstrate that this decomposition is accurate over timescales that are exponential in the system size $Ω$. This contrasts with the phase equation obtained under the diffusion approximation, which is only accurate up to times $O(Ω)$. In particular, we show that for a constant $C$, the probability that the system leaves an $O(ζ)$ neighborhood of the limit cycle before time $T$ scales as $T\exp\big(-CΩbζ^2 \big)$, where $b$ is the rate of attraction to the limit cycle. We illustrate our analysis using the example of a chemical Brusselator. △ Less

Submitted 1 November, 2018; v1 submitted 17 October, 2018; originally announced October 2018.

Synchronization of stochastic hybrid oscillators driven by a common switching environment

Authors: Paul Bressloff, James MacLaurin

Abstract: Many systems in biology, physics and chemistry can be modeled through ordinary differential equations, which are piecewise smooth, but switch between different states according to a Markov jump process. In the fast switching limit, the dynamics converges to a deterministic ODE. In this paper we suppose that this limit ODE supports a stable limit cycle. We demonstrate that a set of such oscillators… ▽ More Many systems in biology, physics and chemistry can be modeled through ordinary differential equations, which are piecewise smooth, but switch between different states according to a Markov jump process. In the fast switching limit, the dynamics converges to a deterministic ODE. In this paper we suppose that this limit ODE supports a stable limit cycle. We demonstrate that a set of such oscillators can synchronize when they are uncoupled, but they share the same switching Markov jump process. The latter is taken to represent the effect of a common randomly switching environment. We determine the leading order of the Lyapunov coefficient governing the rate of decay of the phase difference in the fast switching limit. The analysis bears some similarities to the classical analysis of synchronization of stochastic oscillators subject to common white noise. However the discrete nature of the Markov jump process raises some difficulties: in fact we find that the Lyapunov coefficient from the quasi-steady-state approximation differs from the Lyapunov coefficient one obtains from a second order perturbation expansion in the waiting time between jumps. Finally, we demonstrate synchronization numerically in the radial isochron clock model and show that the latter Lyapinov exponent is more accurate. △ Less

Submitted 10 September, 2018; originally announced September 2018.

A variational method for analyzing stochastic limit cycle oscillators

Authors: Paul Bressloff, James MacLaurin

Abstract: We introduce a variational method for analyzing limit cycle oscillators in $\mathbb{R}^d$ driven by Gaussian noise. This allows us to derive exact stochastic differential equations (SDEs) for the amplitude and phase of the solution, which are accurate over times over order $\exp\big(Cbε^{-1}\big)$, where $ε$ is the amplitude of the noise and $b$ the magnitude of decay of transverse fluctuations. W… ▽ More We introduce a variational method for analyzing limit cycle oscillators in $\mathbb{R}^d$ driven by Gaussian noise. This allows us to derive exact stochastic differential equations (SDEs) for the amplitude and phase of the solution, which are accurate over times over order $\exp\big(Cbε^{-1}\big)$, where $ε$ is the amplitude of the noise and $b$ the magnitude of decay of transverse fluctuations. Within the variational framework, different choices of the amplitude-phase decomposition correspond to different choices of the inner product space $\mathbb{R}^d$. For concreteness, we take a weighted Euclidean norm, so that the minimization scheme determines the phase by projecting the full solution on to the limit cycle using Floquet vectors. Since there is coupling between the amplitude and phase equations, even in the weak noise limit, there is a small but non-zero probability of a rare event in which the stochastic trajectory makes a large excursion away from a neighborhood of the limit cycle. We use the amplitude and phase equations to bound the probability of it doing this: finding that the typical time the system takes to leave a neighborhood of the oscillator scales as $\exp\big(Cbε^{-1}\big)$. △ Less

Submitted 2 November, 2017; originally announced November 2017.

Large Deviations of a Network of Neurons with Dynamic Sparse Random Connections

Authors: James MacLaurin

Abstract: In this work we determine a process-level Large Deviation Principle (LDP) for a model of interacting particles indexed by a lattice $\mathbb{Z}^d$. The connections are random, sparse and unscaled, so that the system converges in the large size limit due to the probability of a connection between any two particles decreasing as the system size increases. The particles are also subject to noise (suc… ▽ More In this work we determine a process-level Large Deviation Principle (LDP) for a model of interacting particles indexed by a lattice $\mathbb{Z}^d$. The connections are random, sparse and unscaled, so that the system converges in the large size limit due to the probability of a connection between any two particles decreasing as the system size increases. The particles are also subject to noise (such as independent Brownian Motions). The method of proof is to assume a process-level (or Level 3) LDP for the double-layer empirical measure for the noise and connections, and then apply a series of transformations to this to obtain an LDP for the process-level empirical measure of our system. Although it is not explicitly necessary, we expect that most applications of this work should involve an assumption of stationarity of the probability law for the noise and connections under translations of the lattice, so that the system converged to an ergodic probability law in the large size limit. This work synthesizes the theory of large-size limits of interacting particles with that of random graphs and matrices. It should therefore be relevant to neuroscience and social networks theory in particular. △ Less

Submitted 16 April, 2020; v1 submitted 19 July, 2016; originally announced July 2016.

Mean Field Dynamics of a Network of Wilson-Cowan Neurons with Electrical Synapses

Authors: Jamil Salhi, James MacLaurin, Salwa Toumi

Abstract: In this paper we prove the propagation of chaos property for an ensemble of interacting neurons subject to independent Brownian noise. The propagation of chaos property means that in the large network size limit, the neurons behave as if they are probabilistically independent. The model for the internal dynamics of the neurons is taken to be that of Wilson and Cowan, and we consider there to be mu… ▽ More In this paper we prove the propagation of chaos property for an ensemble of interacting neurons subject to independent Brownian noise. The propagation of chaos property means that in the large network size limit, the neurons behave as if they are probabilistically independent. The model for the internal dynamics of the neurons is taken to be that of Wilson and Cowan, and we consider there to be multiple different populations. The synaptic connections are modelled with a nonlinear `electrical' model. The nonlinearity of the synaptic connections means that our model lies outside the scope of classical propagation of chaos results. We obtain the propagation of chaos result by taking advantage of the fact that the mean-field equations are Gaussian, which allows us to use Borell's Inequality to prove that its tails decay exponentially. △ Less

Submitted 2 May, 2017; v1 submitted 21 January, 2016; originally announced January 2016.

A general framework for stochastic traveling waves and patterns, with application to neural field equations

Authors: James Inglis, James MacLaurin

Abstract: In this paper we present a general framework in which to rigorously study the effect of spatio-temporal noise on traveling waves and stationary patterns. In particular the framework can incorporate versions of the stochastic neural field equation that may exhibit traveling fronts, pulses or stationary patterns. To do this, we first formulate a local SDE that describes the position of the stochasti… ▽ More In this paper we present a general framework in which to rigorously study the effect of spatio-temporal noise on traveling waves and stationary patterns. In particular the framework can incorporate versions of the stochastic neural field equation that may exhibit traveling fronts, pulses or stationary patterns. To do this, we first formulate a local SDE that describes the position of the stochastic wave up until a discontinuity time, at which point the position of the wave may jump. We then study the local stability of this stochastic front, obtaining a result that recovers a well-known deterministic result in the small-noise limit. We finish with a study of the long-time behavior of the stochastic wave. △ Less

Submitted 29 June, 2015; originally announced June 2015.

Comments: 43 pages, 3 figures

MSC Class: 60H20; 92B99

On Uniform Propagation of Chaos

Authors: Jamil Salhi, James MacLaurin, Salwa Toumi

Abstract: In this paper we obtain uniform propagation estimates for systems of interacting diffusions. We adopt a general model, satisfying various conditions which ensure that the decay resulting from the internal dynamics term dominates the interaction and noise terms. The result should have diverse applications, particularly in neuroscience, and allows for models more elaborate than that of Wilson and Co… ▽ More In this paper we obtain uniform propagation estimates for systems of interacting diffusions. We adopt a general model, satisfying various conditions which ensure that the decay resulting from the internal dynamics term dominates the interaction and noise terms. The result should have diverse applications, particularly in neuroscience, and allows for models more elaborate than that of Wilson and Cowan, not requiring the internal dynamics to be of linear decay. △ Less

Submitted 22 February, 2017; v1 submitted 26 March, 2015; originally announced March 2015.

Asymptotic description of stochastic neural networks. II - Characterization of the limit law

Authors: Olivier Faugeras, James MacLaurin

Abstract: We continue the development, started in of the asymptotic description of certain stochastic neural networks. We use the Large Deviation Principle (LDP) and the good rate function H announced there to prove that H has a unique minimum mu_e, a stationary measure on the set of trajectories. We characterize this measure by its two marginals, at time 0, and from time 1 to T. The second marginal is a st… ▽ More We continue the development, started in of the asymptotic description of certain stochastic neural networks. We use the Large Deviation Principle (LDP) and the good rate function H announced there to prove that H has a unique minimum mu_e, a stationary measure on the set of trajectories. We characterize this measure by its two marginals, at time 0, and from time 1 to T. The second marginal is a stationary Gaussian measure. With an eye on applications, we show that its mean and covariance operator can be inductively computed. Finally we use the LDP to establish various convergence results, averaged and quenched. △ Less

Submitted 9 July, 2014; originally announced July 2014.

Asymptotic description of stochastic neural networks. I - existence of a Large Deviation Principle

Authors: Olivier Faugeras, James MacLaurin

Abstract: We study the asymptotic law of a network of interacting neurons when the number of neurons becomes infinite. The dynamics of the neurons is described by a set of stochastic differential equations in discrete time. The neurons interact through the synaptic weights which are Gaussian correlated random variables. We describe the asymptotic law of the network when the number of neurons goes to infinit… ▽ More We study the asymptotic law of a network of interacting neurons when the number of neurons becomes infinite. The dynamics of the neurons is described by a set of stochastic differential equations in discrete time. The neurons interact through the synaptic weights which are Gaussian correlated random variables. We describe the asymptotic law of the network when the number of neurons goes to infinity. Unlike previous works which made the biologically unrealistic assumption that the weights were i.i.d. random variables, we assume that they are correlated. We introduce the process-level empirical measure of the trajectories of the solutions to the equations of the finite network of neurons and the averaged law (with respect to the synaptic weights) of the trajectories of the solutions to the equations of the network of neurons. The result is that the image law through the empirical measure satisfies a large deviation principle with a good rate function. We provide an analytical expression of this rate function in terms of the spectral representation of certain Gaussian processes. △ Less

Submitted 9 July, 2014; originally announced July 2014.

Large Deviations of a Spatially-Stationary Network of Interacting Neurons

Authors: Olivier Faugeras, James MacLaurin

Abstract: In this work we determine a process-level Large Deviation Principle (LDP) for a model of interacting neurons indexed by a lattice $\mathbb{Z}^d$. The neurons are subject to noise, which is modelled as a correlated martingale. The probability law governing the noise is strictly stationary, and we are therefore able to find a LDP for the probability laws $Π^n$ governing the stationary empirical meas… ▽ More In this work we determine a process-level Large Deviation Principle (LDP) for a model of interacting neurons indexed by a lattice $\mathbb{Z}^d$. The neurons are subject to noise, which is modelled as a correlated martingale. The probability law governing the noise is strictly stationary, and we are therefore able to find a LDP for the probability laws $Π^n$ governing the stationary empirical measure $\hatμ^n$ generated by the neurons in a cube of length $(2n+1)$. We use this LDP to determine an LDP for the neural network model. The connection weights between the neurons evolve according to a learning rule / neuronal plasticity, and these results are adaptable to a large variety of neural network models. This LDP is of great use in the mathematical modelling of neural networks, because it allows a quantification of the likelihood of the system deviating from its limit, and also a determination of which direction the system is likely to deviate. The work is also of interest because there are nontrivial correlations between the neurons even in the asymptotic limit, thereby presenting itself as a generalisation of traditional mean-field models. △ Less

Submitted 3 April, 2016; v1 submitted 2 April, 2014; originally announced April 2014.

On the form of the relative entropy between measures on the space of continuous functions

Authors: James MacLaurin, Olivier Faugeras

Abstract: In this paper we derive an integral (with respect to time) representation of the relative entropy (or Kullback-Leibler Divergence) between measures mu and P on the space of continuous functions from time 0 to T. The underlying measure P is a weak solution to a Martingale Problem with continuous coefficients. Since the relative entropy governs the exponential rate of convergence of the empirical me… ▽ More In this paper we derive an integral (with respect to time) representation of the relative entropy (or Kullback-Leibler Divergence) between measures mu and P on the space of continuous functions from time 0 to T. The underlying measure P is a weak solution to a Martingale Problem with continuous coefficients. Since the relative entropy governs the exponential rate of convergence of the empirical measure (according to Sanov's Theorem), this representation is of use in the numerical and analytical investigation of finite-size effects in systems of interacting diffusions. △ Less

Submitted 18 April, 2014; v1 submitted 20 December, 2013; originally announced December 2013.

Asymptotic description of neural networks with correlated synaptic weights

Authors: Olivier Faugeras, James MacLaurin

Abstract: We study the asymptotic law of a network of interacting neurons when the number of neurons becomes infinite. Given a completely connected network of neurons in which the synaptic weights are Gaussian correlated random variables, we describe the asymptotic law of the network when the number of neurons goes to infinity. We introduce the process-level empirical measure of the trajectories of the solu… ▽ More We study the asymptotic law of a network of interacting neurons when the number of neurons becomes infinite. Given a completely connected network of neurons in which the synaptic weights are Gaussian correlated random variables, we describe the asymptotic law of the network when the number of neurons goes to infinity. We introduce the process-level empirical measure of the trajectories of the solutions to the equations of the finite network of neurons and the averaged law (with respect to the synaptic weights) of the trajectories of the solutions to the equations of the network of neurons. The main result of this article is that the image law through the empirical measure satisfies a large deviation principle with a good rate function which is shown to have a unique global minimum. Our analysis of the rate function allows us also to characterize the limit measure as the image of a stationary Gaussian measure defined on a transformed set of trajectories. △ Less

Submitted 13 December, 2013; v1 submitted 18 November, 2013; originally announced November 2013.

Comments: This paper has been withdrawn by the authors. 50 pages. arXiv admin note: substantial text overlap with arXiv:1302.1029 This paper has been withdrawn because I meant to replace arXiv:1302.1029, not arXiv:1311.4400

MSC Class: 28C20; 34F05; 34K50; 37L55; 60B11; 60F10; 60G10; 60G15; 60G57; 60G60; 60H10; 62M45; 92C20

A large deviation principle for networks of rate neurons with correlated synaptic weights

Authors: Olivier Faugeras, James MacLaurin

Abstract: We study the asymptotic law of a network of interacting neurons when the number of neurons becomes infinite. Given a completely connected network of firing rate neurons in which the synaptic weights are Gaussian correlated random variables, we describe the asymptotic law of the network when the number of neurons goes to infinity. We introduce the process-level empirical measure of the trajectories… ▽ More We study the asymptotic law of a network of interacting neurons when the number of neurons becomes infinite. Given a completely connected network of firing rate neurons in which the synaptic weights are Gaussian correlated random variables, we describe the asymptotic law of the network when the number of neurons goes to infinity. We introduce the process-level empirical measure of the trajectories of the solutions to the equations of the finite network of neurons and the averaged law (with respect to the synaptic weights) of the trajectories of the solutions to the equations of the network of neurons. The main result of this article is that the image law through the empirical measure satisfies a large deviation principle with a good rate function which is shown to have a unique global minimum. Our analysis of the rate function allows us also to characterize the limit measure as the image of a stationary Gaussian measure defined on a transformed set of trajectories. This is potentially very useful for applications in neuroscience since the Gaussian measure can be completely characterized by its mean and spectral density. It also facilitates the assessment of the probability of finite-size effects. △ Less

Submitted 31 May, 2013; v1 submitted 5 February, 2013; originally announced February 2013.

Comments: 67 pages. Changed the order of presentation. Clarified and corrected several proofs. Give more details about the limit measure. Main result unchanged

MSC Class: 28C20; 34F05; 34K50; 37L55; 60B11; 60F10; 60G10; 60G15; 60G57; 60G60; 60H10; 62M45; 92C20