-
Review of Deep Representation Learning Techniques for Brain-Computer Interfaces and Recommendations
Authors:
Pierre Guetschel,
Sara Ahmadi,
Michael Tangermann
Abstract:
In the field of brain-computer interfaces (BCIs), the potential for leveraging deep learning techniques for representing electroencephalogram (EEG) signals has gained substantial interest. This review synthesizes empirical findings from a collection of articles using deep representation learning techniques for BCI decoding, to provide a comprehensive analysis of the current state-of-the-art. Each…
▽ More
In the field of brain-computer interfaces (BCIs), the potential for leveraging deep learning techniques for representing electroencephalogram (EEG) signals has gained substantial interest. This review synthesizes empirical findings from a collection of articles using deep representation learning techniques for BCI decoding, to provide a comprehensive analysis of the current state-of-the-art. Each article was scrutinized based on three criteria: (1) the deep representation learning technique employed, (2) the underlying motivation for its utilization, and (3) the approaches adopted for characterizing the learned representations. Among the 81 articles finally reviewed in depth, our analysis reveals a predominance of 31 articles using autoencoders. We identified 13 studies employing self-supervised learning (SSL) techniques, among which ten were published in 2022 or later, attesting to the relative youth of the field. However, at the time being, none of these have led to standard foundation models that are picked up by the BCI community. Likewise, only a few studies have introspected their learned representations. We observed that the motivation in most studies for using representation learning techniques is for solving transfer learning tasks, but we also found more specific motivations such as to learn robustness or invariances, as an algorithmic bridge, or finally to uncover the structure of the data. Given the potential of foundation models to effectively tackle these challenges, we advocate for a continued dedication to the advancement of foundation models specifically designed for EEG signal decoding by using SSL techniques. We also underline the imperative of establishing specialized benchmarks and datasets to facilitate the development and continuous improvement of such foundation models.
△ Less
Submitted 17 May, 2024;
originally announced May 2024.
-
Towards auditory attention decoding with noise-tagging: A pilot study
Authors:
H. A. Scheppink,
S. Ahmadi,
P. Desain,
M. Tangermann,
J. Thielen
Abstract:
Auditory attention decoding (AAD) aims to extract from brain activity the attended speaker amidst candidate speakers, offering promising applications for neuro-steered hearing devices and brain-computer interfacing. This pilot study makes a first step towards AAD using the noise-tagging stimulus protocol, which evokes reliable code-modulated evoked potentials, but is minimally explored in the audi…
▽ More
Auditory attention decoding (AAD) aims to extract from brain activity the attended speaker amidst candidate speakers, offering promising applications for neuro-steered hearing devices and brain-computer interfacing. This pilot study makes a first step towards AAD using the noise-tagging stimulus protocol, which evokes reliable code-modulated evoked potentials, but is minimally explored in the auditory modality. Participants were sequentially presented with two Dutch speech stimuli that were amplitude-modulated with a unique binary pseudo-random noise-code, effectively tagging these with additional decodable information. We compared the decoding of unmodulated audio against audio modulated with various modulation depths, and a conventional AAD method against a standard method to decode noise-codes. Our pilot study revealed higher performances for the conventional method with 70 to 100 percent modulation depths compared to unmodulated audio. The noise-code decoder did not further improve these results. These fundamental insights highlight the potential of integrating noise-codes in speech to enhance auditory speaker detection when multiple speakers are presented simultaneously.
△ Less
Submitted 17 May, 2024; v1 submitted 22 March, 2024;
originally announced March 2024.
-
Open-Source Skull Reconstruction with MONAI
Authors:
Jianning Li,
André Ferreira,
Behrus Puladi,
Victor Alves,
Michael Kamp,
Moon-Sung Kim,
Felix Nensa,
Jens Kleesiek,
Seyed-Ahmad Ahmadi,
Jan Egger
Abstract:
We present a deep learning-based approach for skull reconstruction for MONAI, which has been pre-trained on the MUG500+ skull dataset. The implementation follows the MONAI contribution guidelines, hence, it can be easily tried out and used, and extended by MONAI users. The primary goal of this paper lies in the investigation of open-sourcing codes and pre-trained deep learning models under the MON…
▽ More
We present a deep learning-based approach for skull reconstruction for MONAI, which has been pre-trained on the MUG500+ skull dataset. The implementation follows the MONAI contribution guidelines, hence, it can be easily tried out and used, and extended by MONAI users. The primary goal of this paper lies in the investigation of open-sourcing codes and pre-trained deep learning models under the MONAI framework. Nowadays, open-sourcing software, especially (pre-trained) deep learning models, has become increasingly important. Over the years, medical image analysis experienced a tremendous transformation. Over a decade ago, algorithms had to be implemented and optimized with low-level programming languages, like C or C++, to run in a reasonable time on a desktop PC, which was not as powerful as today's computers. Nowadays, users have high-level scripting languages like Python, and frameworks like PyTorch and TensorFlow, along with a sea of public code repositories at hand. As a result, implementations that had thousands of lines of C or C++ code in the past, can now be scripted with a few lines and in addition executed in a fraction of the time. To put this even on a higher level, the Medical Open Network for Artificial Intelligence (MONAI) framework tailors medical imaging research to an even more convenient process, which can boost and push the whole field. The MONAI framework is a freely available, community-supported, open-source and PyTorch-based framework, that also enables to provide research contributions with pre-trained models to others. Codes and pre-trained weights for skull reconstruction are publicly available at: https://github.com/Project-MONAI/research-contributions/tree/master/SkullRec
△ Less
Submitted 15 June, 2023; v1 submitted 25 November, 2022;
originally announced November 2022.
-
Upside Risk Effect on Reliability of Microgrids Considering Demand Response Program and COVID-19: An Investigation on Health System and Power System Interactions
Authors:
Tohid Khalili,
Seyed Iman Habibi,
Seyyed Ali Ghorashi Khalil Abadi,
Sadaf Ahmadi,
Ali Bidram
Abstract:
COVID-19 has a vast impact on the power systems considering the customers demand and human resources. During this situation, the utilization of microgrids (MGs) may help the power systems balance the generation and consumption of power, which leads to customer satisfaction. In this paper, the optimal power scheduling of energy sources in an islanded MG by considering the upside risk (UR) is propos…
▽ More
COVID-19 has a vast impact on the power systems considering the customers demand and human resources. During this situation, the utilization of microgrids (MGs) may help the power systems balance the generation and consumption of power, which leads to customer satisfaction. In this paper, the optimal power scheduling of energy sources in an islanded MG by considering the upside risk (UR) is proposed for the very first time. The intended islanded MG consists of various sources such as wind turbine (WT), photovoltaic (PV), diesel generator (DGR), and battery. The goals of this work are minimizing the energy not supplied (ENS) in islanded mode considering the COVID-19s effect and implementing the demand response program (DRP). The difference between target ENS and actual ENS when actual ENS is less than the target is defined as UR. The results indicate that the UR related to the ENS of the islanded MG decreases significantly by slightly increasing the ENS. Moreover, COVID-19 decreases the ENS considerably and has a bigger effect than the DRP.
△ Less
Submitted 14 April, 2022;
originally announced April 2022.
-
Thermographic detection of internal defects using 2D photothermal super resolution reconstruction with sequential laser heating
Authors:
Julien Lecompagnon,
Samim Ahmadi,
Philipp Hirsch,
Christian Rupprecht,
Mathias Ziegler
Abstract:
Thermographic photothermal super resolution reconstruction enables the resolution of internal defects/inhomogeneities below the classical limit which is governed by the diffusion properties of thermal wave propagation. Based on a combination of the application of special sampling strategies and a subsequent numerical optimization step in post-processing, thermographic super resolution has already…
▽ More
Thermographic photothermal super resolution reconstruction enables the resolution of internal defects/inhomogeneities below the classical limit which is governed by the diffusion properties of thermal wave propagation. Based on a combination of the application of special sampling strategies and a subsequent numerical optimization step in post-processing, thermographic super resolution has already proven to be superior to standard thermographic methods in the detection of one-dimensional defect/inhomogeneity structures. In our work, we report an extension of the capabilities of the method for efficient detection and resolution of defect cross sections with fully two-dimensional structured laser-based heating. The reconstruction is carried out using one of two different algorithms which are proposed within this work. Both algorithms utilize the combination of several coherent measurements using convex optimization and exploit the sparse nature of defects/inhomogeneities as is typical for most nondestructive testing scenarios. Finally, the performance of each algorithm is rated on reconstruction quality and algorithmic complexity. The presented experimental approach is based on repeated spatially structured heating by a high power laser. As a result, a two-dimensional sparse defect/inhomogeneity map can be obtained. In addition, the obtained results are compared with those of conventional thermographic inspection methods which make use of homogeneous illumination. Due to the sparse nature of the reconstructed defect/inhomogeneity map, this comparison is performed qualitatively.
△ Less
Submitted 24 April, 2022; v1 submitted 1 March, 2022;
originally announced March 2022.
-
Granger Causality from Quantized Measurements
Authors:
Salman Ahmadi,
Girish N. Nair,
Erik Weyer
Abstract:
An approach is proposed for inferring Granger causality between jointly stationary, Gaussian signals from quantized data. First, a necessary and sufficient rank criterion for the equality of two conditional Gaussian distributions is proved. Assuming a partial finite-order Markov property, a characterization of Granger causality in terms of the rank of a matrix involving the covariances is presente…
▽ More
An approach is proposed for inferring Granger causality between jointly stationary, Gaussian signals from quantized data. First, a necessary and sufficient rank criterion for the equality of two conditional Gaussian distributions is proved. Assuming a partial finite-order Markov property, a characterization of Granger causality in terms of the rank of a matrix involving the covariances is presented. We call this the causality matrix. The smallest singular value of the causality matrix gives a lower bound on the distance between the two conditional Gaussian distributions appearing in the definition of Granger causality and yields a new measure of causality. Then, conditions are derived under which Granger causality between jointly Gaussian processes can be reliably inferred from the second order moments of quantized measurements. A necessary and sufficient condition is proposed for Granger causality inference under binary quantization. Furthermore, sufficient conditions are introduced to infer Granger causality between jointly Gaussian signals through measurements quantized via non-uniform, uniform or high resolution quantizers. Apart from the assumed partial Markov order and joint Gaussianity, this approach does not require the parameters of a system model to be identified. No assumptions are made on the identifiability of the jointly Gaussian random processes through the quantized observations. The effectiveness of the proposed method is illustrated by simulation results.
△ Less
Submitted 4 February, 2022; v1 submitted 2 June, 2021;
originally announced June 2021.
-
There is no data like more data -- current status of machine learning datasets in remote sensing
Authors:
Michael Schmitt,
Seyed Ali Ahmadi,
Ronny Hänsch
Abstract:
Annotated datasets have become one of the most crucial preconditions for the development and evaluation of machine learning-based methods designed for the automated interpretation of remote sensing data. In this paper, we review the historic development of such datasets, discuss their features based on a few selected examples, and address open issues for future developments.
Annotated datasets have become one of the most crucial preconditions for the development and evaluation of machine learning-based methods designed for the automated interpretation of remote sensing data. In this paper, we review the historic development of such datasets, discuss their features based on a few selected examples, and address open issues for future developments.
△ Less
Submitted 17 June, 2021; v1 submitted 25 May, 2021;
originally announced May 2021.
-
Photothermal-SR-Net: A Customized Deep Unfolding Neural Network for Photothermal Super Resolution Imaging
Authors:
Samim Ahmadi,
Linh Kästner,
Jan Christian Hauffen,
Peter Jung,
Mathias Ziegler
Abstract:
This paper presents deep unfolding neural networks to handle inverse problems in photothermal radiometry enabling super resolution (SR) imaging. Photothermal imaging is a well-known technique in active thermography for nondestructive inspection of defects in materials such as metals or composites. A grand challenge of active thermography is to overcome the spatial resolution limitation imposed by…
▽ More
This paper presents deep unfolding neural networks to handle inverse problems in photothermal radiometry enabling super resolution (SR) imaging. Photothermal imaging is a well-known technique in active thermography for nondestructive inspection of defects in materials such as metals or composites. A grand challenge of active thermography is to overcome the spatial resolution limitation imposed by heat diffusion in order to accurately resolve each defect. The photothermal SR approach enables to extract high-frequency spatial components based on the deconvolution with the thermal point spread function. However, stable deconvolution can only be achieved by using the sparse structure of defect patterns, which often requires tedious, hand-crafted tuning of hyperparameters and results in computationally intensive algorithms. On this account, Photothermal-SR-Net is proposed in this paper, which performs deconvolution by deep unfolding considering the underlying physics. This enables to super resolve 2D thermal images for nondestructive testing with a substantially improved convergence rate. Since defects appear sparsely in materials, Photothermal-SR-Net applies trained block-sparsity thresholding to the acquired thermal images in each convolutional layer. The performance of the proposed approach is evaluated and discussed using various deep unfolding and thresholding approaches applied to 2D thermal images. Subsequently, studies are conducted on how to increase the reconstruction quality and the computational performance of Photothermal-SR-Net is evaluated. Thereby, it was found that the computing time for creating high-resolution images could be significantly reduced without decreasing the reconstruction quality by using pixel binning as a preprocessing step.
△ Less
Submitted 21 April, 2021;
originally announced April 2021.
-
Domain-specific loss design for unsupervised physical training: A new approach to modeling medical ML solutions
Authors:
Hendrik Burwinkel,
Holger Matz,
Stefan Saur,
Christoph Hauger,
Ayse Mine Evren,
Nino Hirnschall,
Oliver Findl,
Nassir Navab,
Seyed-Ahmad Ahmadi
Abstract:
Today, cataract surgery is the most frequently performed ophthalmic surgery in the world. The cataract, a develo** opacity of the human eye lens, constitutes the world's most frequent cause for blindness. During surgery, the lens is removed and replaced by an artificial intraocular lens (IOL). To prevent patients from needing strong visual aids after surgery, a precise prediction of the optical…
▽ More
Today, cataract surgery is the most frequently performed ophthalmic surgery in the world. The cataract, a develo** opacity of the human eye lens, constitutes the world's most frequent cause for blindness. During surgery, the lens is removed and replaced by an artificial intraocular lens (IOL). To prevent patients from needing strong visual aids after surgery, a precise prediction of the optical properties of the inserted IOL is crucial. There has been lots of activity towards develo** methods to predict these properties from biometric eye data obtained by OCT devices, recently also by employing machine learning. They consider either only biometric data or physical models, but rarely both, and often neglect the IOL geometry. In this work, we propose OpticNet, a novel optical refraction network, loss function, and training scheme which is unsupervised, domain-specific, and physically motivated. We derive a precise light propagation eye model using single-ray raytracing and formulate a differentiable loss function that back-propagates physical gradients into the network. Further, we propose a new transfer learning procedure, which allows unsupervised training on the physical model and fine-tuning of the network on a cohort of real IOL patient cases. We show that our network is not only superior to systems trained with standard procedures but also that our method outperforms the current state of the art in IOL calculation when compared on two biometric data sets.
△ Less
Submitted 9 May, 2020;
originally announced May 2020.
-
Adaptive Image-Feature Learning for Disease Classification Using Inductive Graph Networks
Authors:
Hendrik Burwinkel,
Anees Kazi,
Gerome Vivar,
Shadi Albarqouni,
Guillaume Zahnd,
Nassir Navab,
Seyed-Ahmad Ahmadi
Abstract:
Recently, Geometric Deep Learning (GDL) has been introduced as a novel and versatile framework for computer-aided disease classification. GDL uses patient meta-information such as age and gender to model patient cohort relations in a graph structure. Concepts from graph signal processing are leveraged to learn the optimal map** of multi-modal features, e.g. from images to disease classes. Relate…
▽ More
Recently, Geometric Deep Learning (GDL) has been introduced as a novel and versatile framework for computer-aided disease classification. GDL uses patient meta-information such as age and gender to model patient cohort relations in a graph structure. Concepts from graph signal processing are leveraged to learn the optimal map** of multi-modal features, e.g. from images to disease classes. Related studies so far have considered image features that are extracted in a pre-processing step. We hypothesize that such an approach prevents the network from optimizing feature representations towards achieving the best performance in the graph network. We propose a new network architecture that exploits an inductive end-to-end learning approach for disease classification, where filters from both the CNN and the graph are trained jointly. We validate this architecture against state-of-the-art inductive graph networks and demonstrate significantly improved classification scores on a modified MNIST toy dataset, as well as comparable classification results with higher stability on a chest X-ray image dataset. Additionally, we explain how the structural information of the graph affects both the image filters and the feature learning.
△ Less
Submitted 19 August, 2019; v1 submitted 8 May, 2019;
originally announced May 2019.
