-
Towards Develo** Brain-Computer Interfaces for People with Multiple Sclerosis
Authors:
John S. Russo,
Tim Mahoney,
Kirill Kokorin,
Ashley Reynolds,
Chin-Hsuan Sophie Lin,
Sam E. John,
David B. Grayden
Abstract:
Multiple Sclerosis (MS) is a severely disabling condition that leads to various neurological symptoms. A Brain-Computer Interface (BCI) may substitute some lost function; however, there is a lack of BCI research in people with MS. To progress this research area effectively and efficiently, we aimed to evaluate user needs and assess the feasibility and user-centric requirements of a BCI for people…
▽ More
Multiple Sclerosis (MS) is a severely disabling condition that leads to various neurological symptoms. A Brain-Computer Interface (BCI) may substitute some lost function; however, there is a lack of BCI research in people with MS. To progress this research area effectively and efficiently, we aimed to evaluate user needs and assess the feasibility and user-centric requirements of a BCI for people with MS. We conducted an online survey of 34 people with MS to qualitatively assess user preferences and establish the initial steps of user-centred design. The survey aimed to understand their interest and preferences in BCI and bionic applications. We demonstrated widespread interest for BCI applications in all stages of MS, with a preference for a non-invasive (n = 12) or minimally invasive (n = 15) BCI over carer assistance (n = 6). Qualitative assessment indicated that this preference was not influenced by level of independence. Additionally, strong interest was noted in bionic technology for sensory and autonomic functions. Considering the potential to enhance independence and quality of life for people living with MS, the results emphasise the importance of user-centred design for future advancement of BCIs that account for the unique pathological changes associated with MS.
△ Less
Submitted 8 April, 2024; v1 submitted 7 April, 2024;
originally announced April 2024.
-
Epileptic seizure forecasting with long short-term memory (LSTM) neural networks
Authors:
Daniel E. Payne,
Jordan D. Chambers,
Anthony Burkitt,
Mark J. Cook,
Levin Kuhlman,
Dean R. Freestone,
David B. Grayden
Abstract:
Objective: Forecasting epileptic seizures can reduce uncertainty for patients and allow preventative actions. While many models can predict the occurrence of seizures from features of the EEG, few models incorporate changes in features over time. Long Short-Term Memory (LSTM) neural networks are a machine learning architecture that can display temporal dynamics due to the recurrent connections. In…
▽ More
Objective: Forecasting epileptic seizures can reduce uncertainty for patients and allow preventative actions. While many models can predict the occurrence of seizures from features of the EEG, few models incorporate changes in features over time. Long Short-Term Memory (LSTM) neural networks are a machine learning architecture that can display temporal dynamics due to the recurrent connections. In this paper, we used LSTMs to monitor changes in EEG features over time to improve the accuracy of seizure forecasts and to alter the time window of the forecast. Methods: Long-term intracranial EEG recordings from eight patients from the NeuroVista dataset were used. A Fourier transform of 1-minute segments of EEG was fed into a Convolutional Neural Network (CNN). The outputs from the CNN were input to three different LSTM models at different time intervals: 1 minute, 1 hour and 1 day. The LSTM model outputs were used to predict seizure onset within a time window. The prediction and start of the time window were separated by the same length of time as the window. Window sizes tested included 2, 4, 10, 20 and 40 minutes. Results and Conclusion: Our model forecast seizure onsets well above a random predictor. Compared to other models using the same dataset, our model performed better for some patients and worse for others. Monitoring the change in EEG features over time allowed our model to produce good results over a range of different window sizes, which is an improvement on previous models and raises the possibility of altering the forecast to meet individual patient needs. Furthermore, a window size of 40 minutes provides a potential intervention time of 40 minutes, which is the first time an intervention time of more than 5 minutes have been forecast using long-term EEG recordings.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
Path Signatures for Seizure Forecasting
Authors:
Jonas F. Haderlein,
Andre D. H. Peterson,
Parvin Zarei Eskikand,
Mark J. Cook,
Anthony N. Burkitt,
Iven M. Y. Mareels,
David B. Grayden
Abstract:
Predicting future system behaviour from past observed behaviour (time series) is fundamental to science and engineering. In computational neuroscience, the prediction of future epileptic seizures from brain activity measurements, using EEG data, remains largely unresolved despite much dedicated research effort. Based on a longitudinal and state-of-the-art data set using intercranial EEG measuremen…
▽ More
Predicting future system behaviour from past observed behaviour (time series) is fundamental to science and engineering. In computational neuroscience, the prediction of future epileptic seizures from brain activity measurements, using EEG data, remains largely unresolved despite much dedicated research effort. Based on a longitudinal and state-of-the-art data set using intercranial EEG measurements from people with epilepsy, we consider the automated discovery of predictive features (or biomarkers) to forecast seizures in a patient-specific way. To this end, we use the path signature, a recent development in the analysis of data streams, to map from measured time series to seizure prediction. The predictor is based on linear classification, here augmented with sparsity constraints, to discern time series with and without an impending seizure. This approach may be seen as a step towards a generic pattern recognition pipeline where the main advantages are simplicity and ease of customisation, while maintaining forecasting performance on par with modern machine learning. Nevertheless, it turns out that although the path signature method has some powerful theoretical guarantees, appropriate time series statistics can achieve essentially the same results in our context of seizure prediction. This suggests that, due to their inherent complexity and non-stationarity, the brain's dynamics are not identifiable from the available EEG measurement data, and, more concretely, epileptic episode prediction is not reliably achieved using EEG measurement data alone.
△ Less
Submitted 23 October, 2023; v1 submitted 18 August, 2023;
originally announced August 2023.
-
Understanding visual processing of motion: Completing the picture using experimentally driven computational models of MT
Authors:
Parvin Zarei Eskikand,
David B Grayden,
Tatiana Kameneva,
Anthony N Burkitt,
Michael R Ibbotson
Abstract:
Computational modeling helps neuroscientists to integrate and explain experimental data obtained through neurophysiological and anatomical studies, thus providing a mechanism by which we can better understand and predict the principles of neural computation. Computational modeling of the neuronal pathways of the visual cortex has been successful in develo** theories of biological motion processi…
▽ More
Computational modeling helps neuroscientists to integrate and explain experimental data obtained through neurophysiological and anatomical studies, thus providing a mechanism by which we can better understand and predict the principles of neural computation. Computational modeling of the neuronal pathways of the visual cortex has been successful in develo** theories of biological motion processing. This review describes a range of computational models that have been inspired by neurophysiological experiments. Theories of local motion integration and pattern motion processing are presented, together with suggested neurophysiological experiments designed to test those hypotheses.
△ Less
Submitted 21 September, 2023; v1 submitted 16 May, 2023;
originally announced May 2023.
-
Comparison of Sub-Scalp EEG and Endovascular Stent-Electrode Array for Visual Evoked Potential Brain-Computer Interface
Authors:
Timothy B. Mahoney,
Po-Chen Liu,
David B Grayden,
Sam E. John
Abstract:
Brain-computer interfaces (BCI) have the potential to improve the quality of life for persons with paralysis. Sub-scalp EEG provides an alternative BCI signal acquisition method that compromises between the limitations of traditional EEG systems and the risks associated with intracranial electrodes, and has shown promise in long-term seizure monitoring. However, sub-scalp EEG has not yet been asse…
▽ More
Brain-computer interfaces (BCI) have the potential to improve the quality of life for persons with paralysis. Sub-scalp EEG provides an alternative BCI signal acquisition method that compromises between the limitations of traditional EEG systems and the risks associated with intracranial electrodes, and has shown promise in long-term seizure monitoring. However, sub-scalp EEG has not yet been assessed for suitability in BCI applications. This study presents a preliminary comparison of visual evoked potentials (VEPs) recorded using subscalp and endovascular stent electrodes in a sheep. Sub-scalp electrodes recorded comparable VEP amplitude, signal-to-noise ratio and bandwidth to the stent electrodes.
△ Less
Submitted 7 May, 2023; v1 submitted 25 April, 2023;
originally announced April 2023.
-
Autoregressive models for biomedical signal processing
Authors:
Jonas F. Haderlein,
Andre D. H. Peterson,
Anthony N. Burkitt,
Iven M. Y. Mareels,
David B. Grayden
Abstract:
Autoregressive models are ubiquitous tools for the analysis of time series in many domains such as computational neuroscience and biomedical engineering. In these domains, data is, for example, collected from measurements of brain activity. Crucially, this data is subject to measurement errors as well as uncertainties in the underlying system model. As a result, standard signal processing using au…
▽ More
Autoregressive models are ubiquitous tools for the analysis of time series in many domains such as computational neuroscience and biomedical engineering. In these domains, data is, for example, collected from measurements of brain activity. Crucially, this data is subject to measurement errors as well as uncertainties in the underlying system model. As a result, standard signal processing using autoregressive model estimators may be biased. We present a framework for autoregressive modelling that incorporates these uncertainties explicitly via an overparameterised loss function. To optimise this loss, we derive an algorithm that alternates between state and parameter estimation. Our work shows that the procedure is able to successfully denoise time series and successfully reconstruct system parameters. This new paradigm can be used in a multitude of applications in neuroscience such as brain-computer interface data analysis and better understanding of brain dynamics in diseases such as epilepsy.
△ Less
Submitted 1 May, 2023; v1 submitted 17 April, 2023;
originally announced April 2023.
-
On the benefit of overparameterisation in state reconstruction: An empirical study of the nonlinear case
Authors:
Jonas F. Haderlein,
Andre D. H. Peterson,
Parvin Zarei Eskikand,
Anthony N. Burkitt,
Iven M. Y. Mareels,
David B. Grayden
Abstract:
The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains such as deep learning, where one is interested in good (local) minima of complex, nonlinear loss functions. Optimisers, like gradient descent, perform well and c…
▽ More
The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains such as deep learning, where one is interested in good (local) minima of complex, nonlinear loss functions. Optimisers, like gradient descent, perform well and consistently reach good solutions. Similarly, nonlinear optimisation problems are encountered in the field of system identification. Examples of such high-dimensional problems are optimisation tasks ensuing from the reconstruction of model states and parameters of an assumed known dynamical system from observed time series. In this work, we identify explicit parallels in the benefits of overparameterisation between what has been analysed in the deep learning context and system identification. We test multiple chaotic time series models, analysing the optimisation process for unknown model states and parameters in batch mode. We find that gradient descent reaches better solutions if we assume more parameters to be unknown. We hypothesise that, indeed, overparameterisation leads us towards better minima, and that more degrees of freedom in the optimisation are beneficial so long as the system is, in principle, observable.
△ Less
Submitted 17 April, 2023;
originally announced April 2023.
-
Brain Model State Space Reconstruction Using an LSTM Neural Network
Authors:
Yueyang Liu,
Artemio Soto-Breceda,
Yun Zhao,
Phillipa Karoly,
Mark J. Cook,
David B. Grayden,
Daniel Schmidt,
Levin Kuhlmann1
Abstract:
Objective
Kalman filtering has previously been applied to track neural model states and parameters, particularly at the scale relevant to EEG. However, this approach lacks a reliable method to determine the initial filter conditions and assumes that the distribution of states remains Gaussian. This study presents an alternative, data-driven method to track the states and parameters of neural mas…
▽ More
Objective
Kalman filtering has previously been applied to track neural model states and parameters, particularly at the scale relevant to EEG. However, this approach lacks a reliable method to determine the initial filter conditions and assumes that the distribution of states remains Gaussian. This study presents an alternative, data-driven method to track the states and parameters of neural mass models (NMMs) from EEG recordings using deep learning techniques, specifically an LSTM neural network.
Approach
An LSTM filter was trained on simulated EEG data generated by a neural mass model using a wide range of parameters. With an appropriately customised loss function, the LSTM filter can learn the behaviour of NMMs. As a result, it can output the state vector and parameters of NMMs given observation data as the input.
Main Results
Test results using simulated data yielded correlations with R squared of around 0.99 and verified that the method is robust to noise and can be more accurate than a nonlinear Kalman filter when the initial conditions of the Kalman filter are not accurate. As an example of real-world application, the LSTM filter was also applied to real EEG data that included epileptic seizures, and revealed changes in connectivity strength parameters at the beginnings of seizures.
Significance
Tracking the state vector and parameters of mathematical brain models is of great importance in the area of brain modelling, monitoring, imaging and control. This approach has no need to specify the initial state vector and parameters, which is very difficult to do in practice because many of the variables being estimated cannot be measured directly in physiological experiments. This method may be applied using any neural mass model and, therefore, provides a general, novel, efficient approach to estimate brain model variables that are often difficult to measure.
△ Less
Submitted 19 January, 2023;
originally announced January 2023.
-
Frequency Superposition -- A Multi-Frequency Stimulation Method in SSVEP-based BCIs
Authors:
**g Mu,
David B. Grayden,
Ying Tan,
Denny Oetomo
Abstract:
The steady-state visual evoked potential (SSVEP) is one of the most widely used modalities in brain-computer interfaces (BCIs) due to its many advantages. However, the existence of harmonics and the limited range of responsive frequencies in SSVEP make it challenging to further expand the number of targets without sacrificing other aspects of the interface or putting additional constraints on the…
▽ More
The steady-state visual evoked potential (SSVEP) is one of the most widely used modalities in brain-computer interfaces (BCIs) due to its many advantages. However, the existence of harmonics and the limited range of responsive frequencies in SSVEP make it challenging to further expand the number of targets without sacrificing other aspects of the interface or putting additional constraints on the system. This paper introduces a novel multi-frequency stimulation method for SSVEP and investigates its potential to effectively and efficiently increase the number of targets presented. The proposed stimulation method, obtained by the superposition of the stimulation signals at different frequencies, is size-efficient, allows single-step target identification, puts no strict constraints on the usable frequency range, can be suited to self-paced BCIs, and does not require specific light sources. In addition to the stimulus frequencies and their harmonics, the evoked SSVEP waveforms include frequencies that are integer linear combinations of the stimulus frequencies. Results of decoding SSVEPs collected from nine subjects using canonical correlation analysis (CCA) with only the frequencies and harmonics as reference, also demonstrate the potential of using such a stimulation paradigm in SSVEP-based BCIs.
△ Less
Submitted 11 August, 2021; v1 submitted 25 April, 2021;
originally announced April 2021.
-
On the benefit of overparameterization in state reconstruction
Authors:
Jonas F. Haderlein,
Iven M. Y. Mareels,
Andre Peterson,
Parvin Zarei Eskikand,
Anthony N. Burkitt,
David B. Grayden
Abstract:
The identification of states and parameters from noisy measurements of a dynamical system is of great practical significance and has received a lot of attention. Classically, this problem is expressed as optimization over a class of models. This work presents such a method, where we augment the system in such a way that there is no distinction between parameter and state reconstruction. We pose th…
▽ More
The identification of states and parameters from noisy measurements of a dynamical system is of great practical significance and has received a lot of attention. Classically, this problem is expressed as optimization over a class of models. This work presents such a method, where we augment the system in such a way that there is no distinction between parameter and state reconstruction. We pose the resulting problem as a batch problem: given the model, reconstruct the state from a finite sequence of output measurements. In the case the model is linear, we derive an analytical expression for the state reconstruction given the model and the output measurements. Importantly, we estimate the state trajectory in its entirety and do not aim to estimate just an initial condition: that is, we use more degrees of freedom than strictly necessary in the optimization step. This particular approach can be reinterpreted as training of a neural network that estimates the state trajectory from available measurements. The technology associated with neural network optimization/training allows an easy extension to nonlinear models. The proposed framework is relatively easy to implement, does not depend on an informed initial guess, and provides an estimate for the state trajectory (which incorporates an estimate for the unknown parameters) over a given finite time horizon.
△ Less
Submitted 12 April, 2021;
originally announced April 2021.
-
Multi-Frequency Canonical Correlation Analysis (MFCCA): A Generalised Decoding Algorithm for Multi-Frequency SSVEP
Authors:
**g Mu,
Ying Tan,
David B. Grayden,
Denny Oetomo
Abstract:
Stimulation methods that utilise more than one stimulation frequency have been developed for steady-state visual evoked potential (SSVEP) brain-computer interfaces (BCIs) with the purpose of increasing the number of targets that can be presented simultaneously. However, there is no unified decoding algorithm that can be used without training for each individual users or cases, and applied to a lar…
▽ More
Stimulation methods that utilise more than one stimulation frequency have been developed for steady-state visual evoked potential (SSVEP) brain-computer interfaces (BCIs) with the purpose of increasing the number of targets that can be presented simultaneously. However, there is no unified decoding algorithm that can be used without training for each individual users or cases, and applied to a large class of multi-frequency stimulated SSVEP settings. This paper extends the widely used canonical correlation analysis (CCA) decoder to explicitly accommodate multi-frequency SSVEP by exploiting the interactions between the multiple stimulation frequencies. A concept of order, defined as the sum of absolute value of the coefficients in the linear combination of the input frequencies, was introduced to assist the design of Multi-Frequency CCA (MFCCA). The probability distribution of the order in the resulting SSVEP response was then used to improve decoding accuracy. Results show that, compared to the standard CCA formulation, the proposed MFCCA has a 20% improvement in decoding accuracy on average at order 2, while kee** its generality and training-free characteristics.
△ Less
Submitted 11 August, 2021; v1 submitted 27 October, 2020;
originally announced November 2020.
-
Impact of axonal delay on structure development in a multi-layered network
Authors:
Catherine E Davey,
David B Grayden,
Anthony N Burkitt
Abstract:
The mechanisms underlying how activity in the visual pathway may give rise through neural plasticity to many of the features observed experimentally in the early stages of visual processing was provided by Linkser in a seminal, three-paper series. Owing to the complexity of multi-layer models, an implicit assumption in Linsker's and subsequent papers has been that propagation delay is homogeneous…
▽ More
The mechanisms underlying how activity in the visual pathway may give rise through neural plasticity to many of the features observed experimentally in the early stages of visual processing was provided by Linkser in a seminal, three-paper series. Owing to the complexity of multi-layer models, an implicit assumption in Linsker's and subsequent papers has been that propagation delay is homogeneous and plays little functional role in neural behaviour. We relax this assumption to examine the impact of distance-dependent axonal propagation delay on neural learning. We show that propagation delay induces low-pass filtering by dispersing the arrival times of spikes from presynaptic neurons, providing a natural correlation cancellation mechanism for distal connections. The cut-off frequency decreases as the radial propagation delay within a layer increases relative to propagation delay between the layers, introducing an upper limit on temporal resolution. Given that the PSP also acts as a low-pass filter, we show that the effective time constant of each should enable the processing of similar scales of temporal information. This result has implications for the visual system, in which receptive field size and, thus, radial propagation delay, increases with eccentricity. Furthermore, the network response is frequency dependent since higher frequencies require increased input amplitude to compensate for attenuation. This concords with frequency-dependent contrast sensitivity in the visual system, which changes with eccentricity and receptive field size. We further show that the proportion of inhibition relative to excitation is larger where radial propagation delay is long relative to inter-laminar propagation delay. We show that the addition of propagation delay reduces the range in the cell's on-center size, providing stability to variations in homeostatic parameters.
△ Less
Submitted 27 November, 2020; v1 submitted 9 May, 2018;
originally announced May 2018.
-
Emergence of radial orientation selectivity: Effect of cell density changes and eccentricity in a layered network
Authors:
Catherine E. Davey,
David B. Grayden,
Anthony N. Burkitt
Abstract:
Previous work by Linsker revealed how simple cells can emerge in the absence of structured environmental input, via a self-organisation learning process. He empirically showed the development of spatial-opponent cells driven only by input noise, emerging as a result of structure in the initial synaptic connectivity distribution. To date, a complete set of radial eigenfunctions have not been provid…
▽ More
Previous work by Linsker revealed how simple cells can emerge in the absence of structured environmental input, via a self-organisation learning process. He empirically showed the development of spatial-opponent cells driven only by input noise, emerging as a result of structure in the initial synaptic connectivity distribution. To date, a complete set of radial eigenfunctions have not been provided for this multi-layer network. In this paper, the complete set of eigenfunctions and eigenvalues for a three-layered network is for the first time analytically derived. Initially a simplified learning equation is considered for which the homeostatic parameters are set to zero. To extend the eigenfunction analysis to the full learning equation, including non-zero homeostatic parameters, a perturbation analysis is used.
△ Less
Submitted 2 December, 2020; v1 submitted 9 May, 2018;
originally announced May 2018.
-
A homotopic map** between current-based and conductance-based synapses in a mesoscopic neural model of epilepsy
Authors:
Andre D. H. Peterson,
Hamish Meffin,
Mark J. Cook,
David B. Grayden,
Iven M. Y Mareels,
Anthony N. Burkitt
Abstract:
Changes in brain states, as found in many neurological diseases such as epilepsy, are often described as bifurcations in mesoscopic neural models. Nearly all of these models rely on a mathematically convenient, but biophysically inaccurate, description of the synaptic input to neurons called current-based synapses. We develop a novel analytical framework to analyze the effects of a more biophysica…
▽ More
Changes in brain states, as found in many neurological diseases such as epilepsy, are often described as bifurcations in mesoscopic neural models. Nearly all of these models rely on a mathematically convenient, but biophysically inaccurate, description of the synaptic input to neurons called current-based synapses. We develop a novel analytical framework to analyze the effects of a more biophysically realistic description, known as conductance-based synapses. These are implemented in a mesoscopic neural model and compared to the standard approximation via a single parameter homotopic map**. A bifurcation analysis using the homotopy parameter demonstrates that if a more realistic synaptic coupling mechanism is used in this class of models, then a bifurcation or transition to an abnormal brain state does not occur in the same parameter space. We show that the more realistic coupling has additional mathematical parameters that require a fundamentally different biophysical mechanism to undergo a state transition. These results demonstrate the importance of incorporating more realistic synapses in mesoscopic neural models and challenge the accuracy of previous models, especially those describing brain state transitions such as epilepsy.
△ Less
Submitted 15 December, 2018; v1 submitted 1 October, 2015;
originally announced October 2015.