A Research Framework for Virtual Reality Neurosurgery Based on Open-Source Tools
Authors:
Lukas D. J. Fiederer,
Hisham Alwanni,
Martin Völker,
Oliver Schnell,
Jürgen Beck,
Tonio Ball
Abstract:
Fully immersive virtual reality (VR) has the potential to improve neurosurgical planning. For example, it may offer 3D visualizations of relevant anatomical structures with complex shapes, such as blood vessels and tumors. However, there is a lack of research tools specifically tailored for this area. We present a research framework for VR neurosurgery based on open-source tools and preliminary ev…
▽ More
Fully immersive virtual reality (VR) has the potential to improve neurosurgical planning. For example, it may offer 3D visualizations of relevant anatomical structures with complex shapes, such as blood vessels and tumors. However, there is a lack of research tools specifically tailored for this area. We present a research framework for VR neurosurgery based on open-source tools and preliminary evaluation results. We showcase the potential of such a framework using clinical data of two patients and research data of one subject. As a first step toward practical evaluations, two certified senior neurosurgeons positively assessed the usefulness of the VR visualizations using head-mounted displays. The methods and findings described in our study thus provide a foundation for research and development aiming at versatile and user-friendly VR tools for improving neurosurgical planning and training.
△ Less
Submitted 14 August, 2019;
originally announced August 2019.
A large-scale evaluation framework for EEG deep learning architectures
Authors:
Felix A. Heilmeyer,
Robin T. Schirrmeister,
Lukas D. J. Fiederer,
Martin Völker,
Joos Behncke,
Tonio Ball
Abstract:
EEG is the most common signal source for noninvasive BCI applications. For such applications, the EEG signal needs to be decoded and translated into appropriate actions. A recently emerging EEG decoding approach is deep learning with Convolutional or Recurrent Neural Networks (CNNs, RNNs) with many different architectures already published. Here we present a novel framework for the large-scale eva…
▽ More
EEG is the most common signal source for noninvasive BCI applications. For such applications, the EEG signal needs to be decoded and translated into appropriate actions. A recently emerging EEG decoding approach is deep learning with Convolutional or Recurrent Neural Networks (CNNs, RNNs) with many different architectures already published. Here we present a novel framework for the large-scale evaluation of different deep-learning architectures on different EEG datasets. This framework comprises (i) a collection of EEG datasets currently including 100 examples (recording sessions) from six different classification problems, (ii) a collection of different EEG decoding algorithms, and (iii) a wrapper linking the decoders to the data as well as handling structured documentation of all settings and (hyper-) parameters and statistics, designed to ensure transparency and reproducibility. As an applications example we used our framework by comparing three publicly available CNN architectures: the Braindecode Deep4 ConvNet, Braindecode Shallow ConvNet, and two versions of EEGNet. We also show how our framework can be used to study similarities and differences in the performance of different decoding methods across tasks. We argue that the deep learning EEG framework as described here could help to tap the full potential of deep learning for BCI applications.
△ Less
Submitted 25 July, 2018; v1 submitted 18 June, 2018;
originally announced June 2018.
