-
Path Signatures for Seizure Forecasting
Authors:
Jonas F. Haderlein,
Andre D. H. Peterson,
Parvin Zarei Eskikand,
Mark J. Cook,
Anthony N. Burkitt,
Iven M. Y. Mareels,
David B. Grayden
Abstract:
Predicting future system behaviour from past observed behaviour (time series) is fundamental to science and engineering. In computational neuroscience, the prediction of future epileptic seizures from brain activity measurements, using EEG data, remains largely unresolved despite much dedicated research effort. Based on a longitudinal and state-of-the-art data set using intercranial EEG measuremen…
▽ More
Predicting future system behaviour from past observed behaviour (time series) is fundamental to science and engineering. In computational neuroscience, the prediction of future epileptic seizures from brain activity measurements, using EEG data, remains largely unresolved despite much dedicated research effort. Based on a longitudinal and state-of-the-art data set using intercranial EEG measurements from people with epilepsy, we consider the automated discovery of predictive features (or biomarkers) to forecast seizures in a patient-specific way. To this end, we use the path signature, a recent development in the analysis of data streams, to map from measured time series to seizure prediction. The predictor is based on linear classification, here augmented with sparsity constraints, to discern time series with and without an impending seizure. This approach may be seen as a step towards a generic pattern recognition pipeline where the main advantages are simplicity and ease of customisation, while maintaining forecasting performance on par with modern machine learning. Nevertheless, it turns out that although the path signature method has some powerful theoretical guarantees, appropriate time series statistics can achieve essentially the same results in our context of seizure prediction. This suggests that, due to their inherent complexity and non-stationarity, the brain's dynamics are not identifiable from the available EEG measurement data, and, more concretely, epileptic episode prediction is not reliably achieved using EEG measurement data alone.
△ Less
Submitted 23 October, 2023; v1 submitted 18 August, 2023;
originally announced August 2023.
-
Autoregressive models for biomedical signal processing
Authors:
Jonas F. Haderlein,
Andre D. H. Peterson,
Anthony N. Burkitt,
Iven M. Y. Mareels,
David B. Grayden
Abstract:
Autoregressive models are ubiquitous tools for the analysis of time series in many domains such as computational neuroscience and biomedical engineering. In these domains, data is, for example, collected from measurements of brain activity. Crucially, this data is subject to measurement errors as well as uncertainties in the underlying system model. As a result, standard signal processing using au…
▽ More
Autoregressive models are ubiquitous tools for the analysis of time series in many domains such as computational neuroscience and biomedical engineering. In these domains, data is, for example, collected from measurements of brain activity. Crucially, this data is subject to measurement errors as well as uncertainties in the underlying system model. As a result, standard signal processing using autoregressive model estimators may be biased. We present a framework for autoregressive modelling that incorporates these uncertainties explicitly via an overparameterised loss function. To optimise this loss, we derive an algorithm that alternates between state and parameter estimation. Our work shows that the procedure is able to successfully denoise time series and successfully reconstruct system parameters. This new paradigm can be used in a multitude of applications in neuroscience such as brain-computer interface data analysis and better understanding of brain dynamics in diseases such as epilepsy.
△ Less
Submitted 1 May, 2023; v1 submitted 17 April, 2023;
originally announced April 2023.
-
On the benefit of overparameterisation in state reconstruction: An empirical study of the nonlinear case
Authors:
Jonas F. Haderlein,
Andre D. H. Peterson,
Parvin Zarei Eskikand,
Anthony N. Burkitt,
Iven M. Y. Mareels,
David B. Grayden
Abstract:
The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains such as deep learning, where one is interested in good (local) minima of complex, nonlinear loss functions. Optimisers, like gradient descent, perform well and c…
▽ More
The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains such as deep learning, where one is interested in good (local) minima of complex, nonlinear loss functions. Optimisers, like gradient descent, perform well and consistently reach good solutions. Similarly, nonlinear optimisation problems are encountered in the field of system identification. Examples of such high-dimensional problems are optimisation tasks ensuing from the reconstruction of model states and parameters of an assumed known dynamical system from observed time series. In this work, we identify explicit parallels in the benefits of overparameterisation between what has been analysed in the deep learning context and system identification. We test multiple chaotic time series models, analysing the optimisation process for unknown model states and parameters in batch mode. We find that gradient descent reaches better solutions if we assume more parameters to be unknown. We hypothesise that, indeed, overparameterisation leads us towards better minima, and that more degrees of freedom in the optimisation are beneficial so long as the system is, in principle, observable.
△ Less
Submitted 17 April, 2023;
originally announced April 2023.
-
Eigenvalue spectral properties of sparse random matrices obeying Dale's law
Authors:
Isabelle D Harris,
Hamish Meffin,
Anthony N Burkitt,
Andre D. H Peterson
Abstract:
This paper examines the relationship between sparse random network architectures and neural network stability by examining the eigenvalue spectral distribution. Specifically, we generalise classical eigenspectral results to sparse connectivity matrices obeying Dale's law: neurons function as either excitatory (E) or inhibitory (I). By defining sparsity as the probability that a neutron is connecte…
▽ More
This paper examines the relationship between sparse random network architectures and neural network stability by examining the eigenvalue spectral distribution. Specifically, we generalise classical eigenspectral results to sparse connectivity matrices obeying Dale's law: neurons function as either excitatory (E) or inhibitory (I). By defining sparsity as the probability that a neutron is connected to another neutron, we give explicit formulae that shows how sparsity interacts with the E/I population statistics to scale key features of the eigenspectrum, in both the balanced and unbalanced cases. Our results show that the eigenspectral outlier is linearly scaled by sparsity, but the eigenspectral radius and density now depend on a nonlinear interaction between sparsity, the E/I population means and variances. Contrary to previous results, we demonstrate that a non-uniform eigenspectral density results if any of the E/I population statistics differ, not just the E/I population variances. We also find that 'local' eigenvalue-outliers are present for sparse random matrices obeying Dale's law, and demonstrate that these eigenvalues can be controlled by a modified zero row-sum constraint for the balanced case, however, they persist in the unbalanced case. We examine all levels of connection (sparsity), and distributed E/I population weights, to describe a general class of sparse connectivity structures which unifies all the previous results as special cases of our framework. Sparsity and Dale's law are both fundamental anatomical properties of biological neural networks. We generalise their combined effects on the eigenspectrum of random neural networks, thereby gaining insight into network stability, state transitions and the structure-function relationship.
△ Less
Submitted 10 October, 2023; v1 submitted 3 December, 2022;
originally announced December 2022.
-
Neural Field Models: A mathematical overview and unifying framework
Authors:
Blake J. Cook,
Andre D. H. Peterson,
Wessel Woldman,
John R. Terry
Abstract:
Mathematical modelling of the macroscopic electrical activity of the brain is highly non-trivial and requires a detailed understanding of not only the associated mathematical techniques, but also the underlying physiology and anatomy. Neural field theory is a population-level approach to modelling the non-linear dynamics of large populations of neurons, while maintaining a degree of mathematical t…
▽ More
Mathematical modelling of the macroscopic electrical activity of the brain is highly non-trivial and requires a detailed understanding of not only the associated mathematical techniques, but also the underlying physiology and anatomy. Neural field theory is a population-level approach to modelling the non-linear dynamics of large populations of neurons, while maintaining a degree of mathematical tractability. This class of models provides a solid theoretical perspective on fundamental processes of neural tissue such as state transitions between different brain activities as observed during epilepsy or sleep. Various anatomical, physiological, and mathematical assumptions are essential for deriving a minimal set of equations that strike a balance between biophysical realism and mathematical tractability. However, these assumptions are not always made explicit throughout the literature. Even though neural field models (NFMs) first appeared in the literature in the early 1970's, the relationships between them have not been systematically addressed. This may partially be explained by the fact that the inter-dependencies between these models are often implicit and non-trivial. Herein we provide a review of key stages of the history and development of neural field theory and contemporary uses of this branch of mathematical neuroscience. First, the principles of the theory are summarised throughout a discussion of the pioneering models by Wilson and Cowan, Amari and Nunez. Upon thorough review of these models, we then present a unified mathematical framework in which all neural field models can be derived by applying different assumptions. We then use this framework to i) derive contemporary models by Robinson, Jansen and Rit, Wendling, Liley, and Steyn-Ross, and ii) make explicit the many significant inherited assumptions that exist in the current literature.
△ Less
Submitted 16 March, 2022; v1 submitted 18 March, 2021;
originally announced March 2021.
-
Consequences of Dale's law on the stability-complexity relationship of random neural networks
Authors:
J. R. Ipsen,
A. D. H. Peterson
Abstract:
In the study of randomly connected neural network dynamics there is a phase transition from a `simple' state with few equilibria to a `complex' state characterised by the number of equilibria growing exponentially with the neuron population. Such phase transitions are often used to describe pathological brain state transitions observed in neurological diseases such as epilepsy. In this paper we in…
▽ More
In the study of randomly connected neural network dynamics there is a phase transition from a `simple' state with few equilibria to a `complex' state characterised by the number of equilibria growing exponentially with the neuron population. Such phase transitions are often used to describe pathological brain state transitions observed in neurological diseases such as epilepsy. In this paper we investigate how more realistic heterogeneous network structures affect these phase transitions using techniques from random matrix theory. Specifically, we parameterise the network structure according to Dale's Law and use the Kac-Rice formalism to compute the change in the number of equilibria when a phase transition occurs. We also examine the condition where the network is not balanced between excitation and inhibition causing outliers to appear in the eigenspectrum. This enables us to compute the effects of different heterogeneous network connectivities on brain state transitions, which can provide new insights into pathological brain dynamics.
△ Less
Submitted 16 July, 2019;
originally announced July 2019.
-
Merging $K$-means with hierarchical clustering for identifying general-shaped groups
Authors:
Anna D. Peterson,
Arka P. Ghosh,
Ranjan Maitra
Abstract:
Clustering partitions a dataset such that observations placed together in a group are similar but different from those in other groups. Hierarchical and $K$-means clustering are two approaches but have different strengths and weaknesses. For instance, hierarchical clustering identifies groups in a tree-like structure but suffers from computational complexity in large datasets while $K$-means clust…
▽ More
Clustering partitions a dataset such that observations placed together in a group are similar but different from those in other groups. Hierarchical and $K$-means clustering are two approaches but have different strengths and weaknesses. For instance, hierarchical clustering identifies groups in a tree-like structure but suffers from computational complexity in large datasets while $K$-means clustering is efficient but designed to identify homogeneous spherically-shaped clusters. We present a hybrid non-parametric clustering approach that amalgamates the two methods to identify general-shaped clusters and that can be applied to larger datasets. Specifically, we first partition the dataset into spherical groups using $K$-means. We next merge these groups using hierarchical methods with a data-driven distance measure as a stop** criterion. Our proposal has the potential to reveal groups with general shapes and structure in a dataset. We demonstrate good performance on several simulated and real datasets.
△ Less
Submitted 23 December, 2017;
originally announced December 2017.
-
Automatic predictions in the Georgi-Machacek model at next-to-leading order accuracy
Authors:
Celine Degrande,
Katy Hartling,
Heather E. Logan,
Andrea D. Peterson,
Marco Zaro
Abstract:
We study the phenomenology of the Georgi-Machacek model at next-to-leading order (NLO) in QCD matched to parton shower, using a fully-automated tool chain based on MadGraph5_aMC@NLO and FeynRules. We focus on the production of the fermiophobic custodial fiveplet scalars H_5^0, H_5^+/-, and H_5^++/-- through vector boson fusion (VBF), associated production with a vector boson (V H_5), and scalar pa…
▽ More
We study the phenomenology of the Georgi-Machacek model at next-to-leading order (NLO) in QCD matched to parton shower, using a fully-automated tool chain based on MadGraph5_aMC@NLO and FeynRules. We focus on the production of the fermiophobic custodial fiveplet scalars H_5^0, H_5^+/-, and H_5^++/-- through vector boson fusion (VBF), associated production with a vector boson (V H_5), and scalar pair production (H_5 H_5). For these production mechanisms we compute NLO corrections to production rates as well as to differential distributions. Our results demonstrate that the Standard Model (SM) overall K-factors for such processes cannot in general be directly applied to beyond-the-SM distributions, due both to differences in the scalar electroweak charges and to variation of the K-factors over the differential distributions.
△ Less
Submitted 3 December, 2015;
originally announced December 2015.
-
A homotopic map** between current-based and conductance-based synapses in a mesoscopic neural model of epilepsy
Authors:
Andre D. H. Peterson,
Hamish Meffin,
Mark J. Cook,
David B. Grayden,
Iven M. Y Mareels,
Anthony N. Burkitt
Abstract:
Changes in brain states, as found in many neurological diseases such as epilepsy, are often described as bifurcations in mesoscopic neural models. Nearly all of these models rely on a mathematically convenient, but biophysically inaccurate, description of the synaptic input to neurons called current-based synapses. We develop a novel analytical framework to analyze the effects of a more biophysica…
▽ More
Changes in brain states, as found in many neurological diseases such as epilepsy, are often described as bifurcations in mesoscopic neural models. Nearly all of these models rely on a mathematically convenient, but biophysically inaccurate, description of the synaptic input to neurons called current-based synapses. We develop a novel analytical framework to analyze the effects of a more biophysically realistic description, known as conductance-based synapses. These are implemented in a mesoscopic neural model and compared to the standard approximation via a single parameter homotopic map**. A bifurcation analysis using the homotopy parameter demonstrates that if a more realistic synaptic coupling mechanism is used in this class of models, then a bifurcation or transition to an abnormal brain state does not occur in the same parameter space. We show that the more realistic coupling has additional mathematical parameters that require a fundamentally different biophysical mechanism to undergo a state transition. These results demonstrate the importance of incorporating more realistic synapses in mesoscopic neural models and challenge the accuracy of previous models, especially those describing brain state transitions such as epilepsy.
△ Less
Submitted 15 December, 2018; v1 submitted 1 October, 2015;
originally announced October 2015.
-
Implications of the observation of dark matter self-interactions for singlet scalar dark matter
Authors:
Robyn Campbell,
Stephen Godfrey,
Heather E. Logan,
Andrea D. Peterson,
Alexandre Poulin
Abstract:
Evidence for dark matter self-interactions has recently been reported based on the observation of a spatial offset between the dark matter halo and the stars in a galaxy in the cluster Abell 3827. Interpreting the offset as due to dark matter self-interactions leads to a cross section measurement of sigma_DM/m ~ (1-1.5) cm^2/g, where m is the mass of the dark matter particle. We use this observati…
▽ More
Evidence for dark matter self-interactions has recently been reported based on the observation of a spatial offset between the dark matter halo and the stars in a galaxy in the cluster Abell 3827. Interpreting the offset as due to dark matter self-interactions leads to a cross section measurement of sigma_DM/m ~ (1-1.5) cm^2/g, where m is the mass of the dark matter particle. We use this observation to constrain singlet scalar dark matter coupled to the Standard Model and to two-Higgs-doublet models. We show that the most natural scenario in this class of models is very light dark matter, below about 0.1 GeV, whose relic abundance is set by freeze-in, i.e., by slow production of dark matter in the early universe via extremely tiny interactions with the Higgs boson, never reaching thermal equilibrium. We also show that the dark matter abundance can be established through the usual thermal freeze-out mechanism in the singlet scalar extension of the Yukawa-aligned two-Higgs-doublet model, but that it requires rather severe fine tuning of the singlet scalar mass.
△ Less
Submitted 3 February, 2020; v1 submitted 7 May, 2015;
originally announced May 2015.
-
Measuring the 2HDM Scalar Potential at LHC14
Authors:
Vernon Barger,
Lisa L. Everett,
Chris B. Jackson,
Andrea D. Peterson,
Gabe Shaughnessy
Abstract:
After the extraordinary discovery of the Higgs boson at the LHC, the next goal is to pin down its underlying dynamics by measuring the Higgs self-couplings, along with its couplings to gauge and matter particles. As a prototype model of new physics in the scalar sector, we consider the Two Higgs Doublet Model (2HDM) with CP-conservation, and evaluate the prospects for measuring the trilinear scala…
▽ More
After the extraordinary discovery of the Higgs boson at the LHC, the next goal is to pin down its underlying dynamics by measuring the Higgs self-couplings, along with its couplings to gauge and matter particles. As a prototype model of new physics in the scalar sector, we consider the Two Higgs Doublet Model (2HDM) with CP-conservation, and evaluate the prospects for measuring the trilinear scalar couplings among the CP-even Higgs bosons $h$ and $H$ ($λ^{hhh}$, $λ^{hhH}$, $λ^{hHH}$) at LHC14. The continuum and resonant production of CP-even Higgs boson pairs, $hh$ and $hH$, offer complementary probes of the scalar potential away from the light-Higgs decoupling limit. We identify the viable search channels at LHC14 and estimate their expected discovery sensitivities.
△ Less
Submitted 11 August, 2014;
originally announced August 2014.
-
Neutrino Lighthouse at Sagittarius A*
Authors:
Y. Bai,
A. J. Barger,
V. Barger,
R. Lu,
A. D. Peterson,
J. Salvado
Abstract:
We investigate whether a subset of high-energy events observed by IceCube may be due to neutrinos from Sagittarius A*. We check both spatial and temporal coincidences of IceCube events with other transient activities of Sagittarius A*. Among the seven IceCube shower events nearest to the galactic center, we have found that event 25 has a time very close to (around three hours after) the brightest…
▽ More
We investigate whether a subset of high-energy events observed by IceCube may be due to neutrinos from Sagittarius A*. We check both spatial and temporal coincidences of IceCube events with other transient activities of Sagittarius A*. Among the seven IceCube shower events nearest to the galactic center, we have found that event 25 has a time very close to (around three hours after) the brightest X-ray flare of Sagittarius A* observed by the Chandra X-ray Observatory with a p-value of 0.9%. Furthermore, two of the seven events occurred within one day of each other (there is a 1.6% probability that this would occur for a random distribution in time). Thus, the determination that some IceCube events occur at similar times as X-ray flares and others occur in a burst could be the smoking gun that Sagittarius A* is a point source of very high energy neutrinos. We point out that if IceCube galactic center neutrino events originate from charged pion decays, then TeV gamma rays should come from neutral pion decays at a similar rate. We show that the CTA, HAWC, H.E.S.S. and VERITAS experiments should be sensitive enough to test this.
△ Less
Submitted 8 July, 2014;
originally announced July 2014.
-
W' signatures with odd Higgs particles
Authors:
Bogdan A. Dobrescu,
Andrea D. Peterson
Abstract:
We point out that W' bosons may decay predominantly into Higgs particles associated with their broken gauge symmetry. We demonstrate this in a renormalizable model where the W' and W couplings to fermions differ only by an overall normalization. This "meta-sequential" W' boson decays into a scalar pair, with the charged one subsequently decaying into a W boson and a neutral scalar. These scalars a…
▽ More
We point out that W' bosons may decay predominantly into Higgs particles associated with their broken gauge symmetry. We demonstrate this in a renormalizable model where the W' and W couplings to fermions differ only by an overall normalization. This "meta-sequential" W' boson decays into a scalar pair, with the charged one subsequently decaying into a W boson and a neutral scalar. These scalars are odd under a parity of the Higgs sector, which consists of a complex bidoublet and a doublet. The W' and Z' bosons have the same mass and branching fractions into scalars, and may show up at the LHC in final states involving one or two electroweak bosons and missing transverse energy.
△ Less
Submitted 16 February, 2014; v1 submitted 6 December, 2013;
originally announced December 2013.