-
Score-Based Data Generation for EEG Spatial Covariance Matrices: Towards Boosting BCI Performance
Authors:
Ce Ju,
Reinmar Josef Kobler,
Cuntai Guan
Abstract:
The efficacy of Electroencephalogram (EEG) classifiers can be augmented by increasing the quantity of available data. In the case of geometric deep learning classifiers, the input consists of spatial covariance matrices derived from EEGs. In order to synthesize these spatial covariance matrices and facilitate future improvements of geometric deep learning classifiers, we propose a generative model…
▽ More
The efficacy of Electroencephalogram (EEG) classifiers can be augmented by increasing the quantity of available data. In the case of geometric deep learning classifiers, the input consists of spatial covariance matrices derived from EEGs. In order to synthesize these spatial covariance matrices and facilitate future improvements of geometric deep learning classifiers, we propose a generative modeling technique based on state-of-the-art score-based models. The quality of generated samples is evaluated through visual and quantitative assessments using a left/right-hand-movement motor imagery dataset. The exceptional pixel-level resolution of these generative samples highlights the formidable capacity of score-based generative modeling. Additionally, the center (Frechet mean) of the generated samples aligns with neurophysiological evidence that event-related desynchronization and synchronization occur on electrodes C3 and C4 within the Mu and Beta frequency bands during motor imagery processing. The quantitative evaluation revealed that 84.3% of the generated samples could be accurately predicted by a pre-trained classifier and an improvement of up to 8.7% in the average accuracy over ten runs for a specific test subject in a holdout experiment.
△ Less
Submitted 15 December, 2023; v1 submitted 22 February, 2023;
originally announced February 2023.
-
SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEG
Authors:
Reinmar J Kobler,
Jun-ichiro Hirayama,
Qibin Zhao,
Motoaki Kawanabe
Abstract:
Electroencephalography (EEG) provides access to neuronal dynamics non-invasively with millisecond resolution, rendering it a viable method in neuroscience and healthcare. However, its utility is limited as current EEG technology does not generalize well across domains (i.e., sessions and subjects) without expensive supervised re-calibration. Contemporary methods cast this transfer learning (TL) pr…
▽ More
Electroencephalography (EEG) provides access to neuronal dynamics non-invasively with millisecond resolution, rendering it a viable method in neuroscience and healthcare. However, its utility is limited as current EEG technology does not generalize well across domains (i.e., sessions and subjects) without expensive supervised re-calibration. Contemporary methods cast this transfer learning (TL) problem as a multi-source/-target unsupervised domain adaptation (UDA) problem and address it with deep learning or shallow, Riemannian geometry aware alignment methods. Both directions have, so far, failed to consistently close the performance gap to state-of-the-art domain-specific methods based on tangent space map** (TSM) on the symmetric positive definite (SPD) manifold. Here, we propose a theory-based machine learning framework that enables, for the first time, learning domain-invariant TSM models in an end-to-end fashion. To achieve this, we propose a new building block for geometric deep learning, which we denote SPD domain-specific momentum batch normalization (SPDDSMBN). A SPDDSMBN layer can transform domain-specific SPD inputs into domain-invariant SPD outputs, and can be readily applied to multi-source/-target and online UDA scenarios. In extensive experiments with 6 diverse EEG brain-computer interface (BCI) datasets, we obtain state-of-the-art performance in inter-session and -subject TL with a simple, intrinsically interpretable network architecture, which we denote TSMNet.
△ Less
Submitted 12 October, 2022; v1 submitted 2 June, 2022;
originally announced June 2022.
-
On the interpretation of linear Riemannian tangent space model parameters in M/EEG
Authors:
Reinmar J. Kobler,
Jun-Ichiro Hirayama,
Lea Hehenberger Catarina Lopes-Dias,
Gernot R. Müller-Putz,
Motoaki Kawanabe
Abstract:
Riemannian tangent space methods offer state-of-the-art performance in magnetoencephalography (MEG) and electroencephalography (EEG) based applications such as brain-computer interfaces and biomarker development. One limitation, particularly relevant for biomarker development, is limited model interpretability compared to established component-based methods. Here, we propose a method to transform…
▽ More
Riemannian tangent space methods offer state-of-the-art performance in magnetoencephalography (MEG) and electroencephalography (EEG) based applications such as brain-computer interfaces and biomarker development. One limitation, particularly relevant for biomarker development, is limited model interpretability compared to established component-based methods. Here, we propose a method to transform the parameters of linear tangent space models into interpretable patterns. Using typical assumptions, we show that this approach identifies the true patterns of latent sources, encoding a target signal. In simulations and two real MEG and EEG datasets, we demonstrate the validity of the proposed approach and investigate its behavior when the model assumptions are violated. Our results confirm that Riemannian tangent space methods are robust to differences in the source patterns across observations. We found that this robustness property also transfers to the associated patterns.
△ Less
Submitted 29 July, 2021;
originally announced July 2021.
-
HEAR to remove pops and drifts: the high-variance electrode artifact removal (HEAR) algorithm
Authors:
Reinmar J. Kobler,
Andreea I. Sburlea,
Valeria Mondini,
Gernot R. Müller-Putz
Abstract:
A high fraction of artifact-free signals is highly desirable in functional neuroimaging and brain-computer interfacing (BCI). We present the high-variance electrode artifact removal (HEAR) algorithm to remove transient electrode pop and drift (PD) artifacts from electroencephalographic (EEG) signals. Transient PD artifacts reflect impedance variations at the electrode scalp interface that are caus…
▽ More
A high fraction of artifact-free signals is highly desirable in functional neuroimaging and brain-computer interfacing (BCI). We present the high-variance electrode artifact removal (HEAR) algorithm to remove transient electrode pop and drift (PD) artifacts from electroencephalographic (EEG) signals. Transient PD artifacts reflect impedance variations at the electrode scalp interface that are caused by ion concentration changes. HEAR and its online version (oHEAR) are open-source and publicly available. Both outperformed state of the art offline and online transient, high-variance artifact correction algorithms for simulated EEG signals. (o)HEAR attenuated PD artifacts by approx. 25 dB, and at the same time maintained a high SNR during PD artifact-free periods. For real-world EEG data, (o)HEAR reduced the fraction of outlier trials by half and maintained the waveform of a movement related cortical potential during a center-out reaching task. In the case of BCI training, using oHEAR can improve the reliability of the feedback a user receives through reducing a potential negative impact of PD artifacts.
△ Less
Submitted 29 July, 2019;
originally announced July 2019.