-
Path Signatures for Seizure Forecasting
Authors:
Jonas F. Haderlein,
Andre D. H. Peterson,
Parvin Zarei Eskikand,
Mark J. Cook,
Anthony N. Burkitt,
Iven M. Y. Mareels,
David B. Grayden
Abstract:
Predicting future system behaviour from past observed behaviour (time series) is fundamental to science and engineering. In computational neuroscience, the prediction of future epileptic seizures from brain activity measurements, using EEG data, remains largely unresolved despite much dedicated research effort. Based on a longitudinal and state-of-the-art data set using intercranial EEG measuremen…
▽ More
Predicting future system behaviour from past observed behaviour (time series) is fundamental to science and engineering. In computational neuroscience, the prediction of future epileptic seizures from brain activity measurements, using EEG data, remains largely unresolved despite much dedicated research effort. Based on a longitudinal and state-of-the-art data set using intercranial EEG measurements from people with epilepsy, we consider the automated discovery of predictive features (or biomarkers) to forecast seizures in a patient-specific way. To this end, we use the path signature, a recent development in the analysis of data streams, to map from measured time series to seizure prediction. The predictor is based on linear classification, here augmented with sparsity constraints, to discern time series with and without an impending seizure. This approach may be seen as a step towards a generic pattern recognition pipeline where the main advantages are simplicity and ease of customisation, while maintaining forecasting performance on par with modern machine learning. Nevertheless, it turns out that although the path signature method has some powerful theoretical guarantees, appropriate time series statistics can achieve essentially the same results in our context of seizure prediction. This suggests that, due to their inherent complexity and non-stationarity, the brain's dynamics are not identifiable from the available EEG measurement data, and, more concretely, epileptic episode prediction is not reliably achieved using EEG measurement data alone.
△ Less
Submitted 23 October, 2023; v1 submitted 18 August, 2023;
originally announced August 2023.
-
Understanding visual processing of motion: Completing the picture using experimentally driven computational models of MT
Authors:
Parvin Zarei Eskikand,
David B Grayden,
Tatiana Kameneva,
Anthony N Burkitt,
Michael R Ibbotson
Abstract:
Computational modeling helps neuroscientists to integrate and explain experimental data obtained through neurophysiological and anatomical studies, thus providing a mechanism by which we can better understand and predict the principles of neural computation. Computational modeling of the neuronal pathways of the visual cortex has been successful in develo** theories of biological motion processi…
▽ More
Computational modeling helps neuroscientists to integrate and explain experimental data obtained through neurophysiological and anatomical studies, thus providing a mechanism by which we can better understand and predict the principles of neural computation. Computational modeling of the neuronal pathways of the visual cortex has been successful in develo** theories of biological motion processing. This review describes a range of computational models that have been inspired by neurophysiological experiments. Theories of local motion integration and pattern motion processing are presented, together with suggested neurophysiological experiments designed to test those hypotheses.
△ Less
Submitted 21 September, 2023; v1 submitted 16 May, 2023;
originally announced May 2023.
-
On the benefit of overparameterisation in state reconstruction: An empirical study of the nonlinear case
Authors:
Jonas F. Haderlein,
Andre D. H. Peterson,
Parvin Zarei Eskikand,
Anthony N. Burkitt,
Iven M. Y. Mareels,
David B. Grayden
Abstract:
The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains such as deep learning, where one is interested in good (local) minima of complex, nonlinear loss functions. Optimisers, like gradient descent, perform well and c…
▽ More
The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains such as deep learning, where one is interested in good (local) minima of complex, nonlinear loss functions. Optimisers, like gradient descent, perform well and consistently reach good solutions. Similarly, nonlinear optimisation problems are encountered in the field of system identification. Examples of such high-dimensional problems are optimisation tasks ensuing from the reconstruction of model states and parameters of an assumed known dynamical system from observed time series. In this work, we identify explicit parallels in the benefits of overparameterisation between what has been analysed in the deep learning context and system identification. We test multiple chaotic time series models, analysing the optimisation process for unknown model states and parameters in batch mode. We find that gradient descent reaches better solutions if we assume more parameters to be unknown. We hypothesise that, indeed, overparameterisation leads us towards better minima, and that more degrees of freedom in the optimisation are beneficial so long as the system is, in principle, observable.
△ Less
Submitted 17 April, 2023;
originally announced April 2023.
-
On the benefit of overparameterization in state reconstruction
Authors:
Jonas F. Haderlein,
Iven M. Y. Mareels,
Andre Peterson,
Parvin Zarei Eskikand,
Anthony N. Burkitt,
David B. Grayden
Abstract:
The identification of states and parameters from noisy measurements of a dynamical system is of great practical significance and has received a lot of attention. Classically, this problem is expressed as optimization over a class of models. This work presents such a method, where we augment the system in such a way that there is no distinction between parameter and state reconstruction. We pose th…
▽ More
The identification of states and parameters from noisy measurements of a dynamical system is of great practical significance and has received a lot of attention. Classically, this problem is expressed as optimization over a class of models. This work presents such a method, where we augment the system in such a way that there is no distinction between parameter and state reconstruction. We pose the resulting problem as a batch problem: given the model, reconstruct the state from a finite sequence of output measurements. In the case the model is linear, we derive an analytical expression for the state reconstruction given the model and the output measurements. Importantly, we estimate the state trajectory in its entirety and do not aim to estimate just an initial condition: that is, we use more degrees of freedom than strictly necessary in the optimization step. This particular approach can be reinterpreted as training of a neural network that estimates the state trajectory from available measurements. The technology associated with neural network optimization/training allows an easy extension to nonlinear models. The proposed framework is relatively easy to implement, does not depend on an informed initial guess, and provides an estimate for the state trajectory (which incorporates an estimate for the unknown parameters) over a given finite time horizon.
△ Less
Submitted 12 April, 2021;
originally announced April 2021.