-
UltraCortex: Submillimeter Ultra-High Field 9.4 T1 Brain MR Image Collection and Manual Cortical Segmentations
Authors:
Lucas Mahler,
Julius Steiglechner,
Benjamin Bender,
Tobias Lindig,
Dana Ramadan,
Jonas Bause,
Florian Birk,
Rahel Heule,
Edyta Charyasz,
Michael Erb,
Vinod Jangir Kumar,
Gisela E Hagberg,
Pascal Martin,
Gabriele Lohmann,
Klaus Scheffler
Abstract:
The UltraCortex repository (https://www.ultracortex.org) houses magnetic resonance imaging data of the human brain obtained at an ultra-high field strength of 9.4 T. It contains 86 structural MR images with spatial resolutions ranging from 0.6 to 0.8 mm. Additionally, the repository includes segmentations of 12 brains into gray and white matter compartments. These segmentations have been independe…
▽ More
The UltraCortex repository (https://www.ultracortex.org) houses magnetic resonance imaging data of the human brain obtained at an ultra-high field strength of 9.4 T. It contains 86 structural MR images with spatial resolutions ranging from 0.6 to 0.8 mm. Additionally, the repository includes segmentations of 12 brains into gray and white matter compartments. These segmentations have been independently validated by two expert neuroradiologists, thus establishing them as a reliable gold standard. This resource provides researchers with access to high-quality brain imaging data and validated segmentations, facilitating neuroimaging studies and advancing our understanding of brain structure and function. Existing repositories do not accommodate field strengths beyond 7 T, nor do they offer validated segmentations, underscoring the significance of this new resource.
△ Less
Submitted 5 July, 2024; v1 submitted 3 June, 2024;
originally announced June 2024.
-
DISGAN: Wavelet-informed Discriminator Guides GAN to MRI Super-resolution with Noise Cleaning
Authors:
Qi Wang,
Lucas Mahler,
Julius Steiglechner,
Florian Birk,
Klaus Scheffler,
Gabriele Lohmann
Abstract:
MRI super-resolution (SR) and denoising tasks are fundamental challenges in the field of deep learning, which have traditionally been treated as distinct tasks with separate paired training data. In this paper, we propose an innovative method that addresses both tasks simultaneously using a single deep learning model, eliminating the need for explicitly paired noisy and clean images during trainin…
▽ More
MRI super-resolution (SR) and denoising tasks are fundamental challenges in the field of deep learning, which have traditionally been treated as distinct tasks with separate paired training data. In this paper, we propose an innovative method that addresses both tasks simultaneously using a single deep learning model, eliminating the need for explicitly paired noisy and clean images during training. Our proposed model is primarily trained for SR, but also exhibits remarkable noise-cleaning capabilities in the super-resolved images. Instead of conventional approaches that introduce frequency-related operations into the generative process, our novel approach involves the use of a GAN model guided by a frequency-informed discriminator. To achieve this, we harness the power of the 3D Discrete Wavelet Transform (DWT) operation as a frequency constraint within the GAN framework for the SR task on magnetic resonance imaging (MRI) data. Specifically, our contributions include: 1) a 3D generator based on residual-in-residual connected blocks; 2) the integration of the 3D DWT with $1\times 1$ convolution into a DWT+conv unit within a 3D Unet for the discriminator; 3) the use of the trained model for high-quality image SR, accompanied by an intrinsic denoising process. We dub the model "Denoising Induced Super-resolution GAN (DISGAN)" due to its dual effects of SR image generation and simultaneous denoising. Departing from the traditional approach of training SR and denoising tasks as separate models, our proposed DISGAN is trained only on the SR task, but also achieves exceptional performance in denoising. The model is trained on 3D MRI data from dozens of subjects from the Human Connectome Project (HCP) and further evaluated on previously unseen MRI data from subjects with brain tumours and epilepsy to assess its denoising and SR performance.
△ Less
Submitted 23 August, 2023;
originally announced August 2023.
-
Pretraining is All You Need: A Multi-Atlas Enhanced Transformer Framework for Autism Spectrum Disorder Classification
Authors:
Lucas Mahler,
Qi Wang,
Julius Steiglechner,
Florian Birk,
Samuel Heczko,
Klaus Scheffler,
Gabriele Lohmann
Abstract:
Autism spectrum disorder (ASD) is a prevalent psychiatric condition characterized by atypical cognitive, emotional, and social patterns. Timely and accurate diagnosis is crucial for effective interventions and improved outcomes in individuals with ASD. In this study, we propose a novel Multi-Atlas Enhanced Transformer framework, METAFormer, ASD classification. Our framework utilizes resting-state…
▽ More
Autism spectrum disorder (ASD) is a prevalent psychiatric condition characterized by atypical cognitive, emotional, and social patterns. Timely and accurate diagnosis is crucial for effective interventions and improved outcomes in individuals with ASD. In this study, we propose a novel Multi-Atlas Enhanced Transformer framework, METAFormer, ASD classification. Our framework utilizes resting-state functional magnetic resonance imaging data from the ABIDE I dataset, comprising 406 ASD and 476 typical control (TC) subjects. METAFormer employs a multi-atlas approach, where flattened connectivity matrices from the AAL, CC200, and DOS160 atlases serve as input to the transformer encoder. Notably, we demonstrate that self-supervised pretraining, involving the reconstruction of masked values from the input, significantly enhances classification performance without the need for additional or separate training data. Through stratified cross-validation, we evaluate the proposed framework and show that it surpasses state-of-the-art performance on the ABIDE I dataset, with an average accuracy of 83.7% and an AUC-score of 0.832. The code for our framework is available at https://github.com/Lugges991/METAFormer
△ Less
Submitted 6 August, 2023; v1 submitted 4 July, 2023;
originally announced July 2023.
-
A Three-Player GAN for Super-Resolution in Magnetic Resonance Imaging
Authors:
Qi Wang,
Lucas Mahler,
Julius Steiglechner,
Florian Birk,
Klaus Scheffler,
Gabriele Lohmann
Abstract:
Learning based single image super resolution (SISR) task is well investigated in 2D images. However, SISR for 3D Magnetics Resonance Images (MRI) is more challenging compared to 2D, mainly due to the increased number of neural network parameters, the larger memory requirement and the limited amount of available training data. Current SISR methods for 3D volumetric images are based on Generative Ad…
▽ More
Learning based single image super resolution (SISR) task is well investigated in 2D images. However, SISR for 3D Magnetics Resonance Images (MRI) is more challenging compared to 2D, mainly due to the increased number of neural network parameters, the larger memory requirement and the limited amount of available training data. Current SISR methods for 3D volumetric images are based on Generative Adversarial Networks (GANs), especially Wasserstein GANs due to their training stability. Other common architectures in the 2D domain, e.g. transformer models, require large amounts of training data and are therefore not suitable for the limited 3D data. However, Wasserstein GANs can be problematic because they may not converge to a global optimum and thus produce blurry results. Here, we propose a new method for 3D SR based on the GAN framework. Specifically, we use instance noise to balance the GAN training. Furthermore, we use a relativistic GAN loss function and an updating feature extractor during the training process. We show that our method produces highly accurate results. We also show that we need very few training samples. In particular, we need less than 30 samples instead of thousands of training samples that are typically required in previous studies. Finally, we show improved out-of-sample results produced by our model.
△ Less
Submitted 24 March, 2023;
originally announced March 2023.
-
Smart Fog: Fog Computing Framework for Unsupervised Clustering Analytics in Wearable Internet of Things
Authors:
Debanjan Borthakur,
Harishchandra Dubey,
Nicholas Constant,
Leslie Mahler,
Kunal Mankodiya
Abstract:
The increasing use of wearables in smart telehealth generates heterogeneous medical big data. Cloud and fog services process these data for assisting clinical procedures. IoT based ehealthcare have greatly benefited from efficient data processing. This paper proposed and evaluated use of low resource machine learning on Fog devices kept close to the wearables for smart healthcare. In state of the…
▽ More
The increasing use of wearables in smart telehealth generates heterogeneous medical big data. Cloud and fog services process these data for assisting clinical procedures. IoT based ehealthcare have greatly benefited from efficient data processing. This paper proposed and evaluated use of low resource machine learning on Fog devices kept close to the wearables for smart healthcare. In state of the art telecare systems, the signal processing and machine learning modules are deployed in the cloud for processing physiological data. We developed a prototype of Fog-based unsupervised machine learning big data analysis for discovering patterns in physiological data. We employed Intel Edison and Raspberry Pi as Fog computer in proposed architecture. We performed validation studies on real-world pathological speech data from in home monitoring of patients with Parkinson's disease (PD). Proposed architecture employed machine learning for analysis of pathological speech data obtained from smartwatches worn by the patients with PD. Results showed that proposed architecture is promising for low-resource clinical machine learning. It could be useful for other applications within wearable IoT for smart telehealth scenarios by translating machine learning approaches from the cloud backend to edge computing devices such as Fog.
△ Less
Submitted 24 December, 2017;
originally announced December 2017.
-
Fog Computing in Medical Internet-of-Things: Architecture, Implementation, and Applications
Authors:
Harishchandra Dubey,
Admir Monteiro,
Nicholas Constant,
Mohammadreza Abtahi,
Debanjan Borthakur,
Leslie Mahler,
Yan Sun,
Qing Yang,
Umer Akbar,
Kunal Mankodiya
Abstract:
In the era when the market segment of Internet of Things (IoT) tops the chart in various business reports, it is apparently envisioned that the field of medicine expects to gain a large benefit from the explosion of wearables and internet-connected sensors that surround us to acquire and communicate unprecedented data on symptoms, medication, food intake, and daily-life activities impacting one's…
▽ More
In the era when the market segment of Internet of Things (IoT) tops the chart in various business reports, it is apparently envisioned that the field of medicine expects to gain a large benefit from the explosion of wearables and internet-connected sensors that surround us to acquire and communicate unprecedented data on symptoms, medication, food intake, and daily-life activities impacting one's health and wellness. However, IoT-driven healthcare would have to overcome many barriers, such as: 1) There is an increasing demand for data storage on cloud servers where the analysis of the medical big data becomes increasingly complex, 2) The data, when communicated, are vulnerable to security and privacy issues, 3) The communication of the continuously collected data is not only costly but also energy hungry, 4) Operating and maintaining the sensors directly from the cloud servers are non-trial tasks. This book chapter defined Fog Computing in the context of medical IoT. Conceptually, Fog Computing is a service-oriented intermediate layer in IoT, providing the interfaces between the sensors and cloud servers for facilitating connectivity, data transfer, and queryable local database. The centerpiece of Fog computing is a low-power, intelligent, wireless, embedded computing node that carries out signal conditioning and data analytics on raw data collected from wearables or other medical sensors and offers efficient means to serve telehealth interventions. We implemented and tested an fog computing system using the Intel Edison and Raspberry Pi that allows acquisition, computing, storage and communication of the various medical data such as pathological speech data of individuals with speech disorders, Phonocardiogram (PCG) signal for heart rate estimation, and Electrocardiogram (ECG)-based Q, R, S detection.
△ Less
Submitted 24 June, 2017;
originally announced June 2017.
-
EchoWear: Smartwatch Technology for Voice and Speech Treatments of Patients with Parkinson's Disease
Authors:
Harishchandra Dubey,
Jon C. Goldberg,
Mohammadreza Abtahi,
Leslie Mahler,
Kunal Mankodiya
Abstract:
About 90 percent of people with Parkinson's disease (PD) experience decreased functional communication due to the presence of voice and speech disorders associated with dysarthria that can be characterized by monotony of pitch (or fundamental frequency), reduced loudness, irregular rate of speech, imprecise consonants, and changes in voice quality. Speech-language pathologists (SLPs) work with pat…
▽ More
About 90 percent of people with Parkinson's disease (PD) experience decreased functional communication due to the presence of voice and speech disorders associated with dysarthria that can be characterized by monotony of pitch (or fundamental frequency), reduced loudness, irregular rate of speech, imprecise consonants, and changes in voice quality. Speech-language pathologists (SLPs) work with patients with PD to improve speech intelligibility using various intensive in-clinic speech treatments. SLPs also prescribe home exercises to enhance generalization of speech strategies outside of the treatment room. Even though speech therapies are found to be highly effective in improving vocal loudness and speech quality, patients with PD find it difficult to follow the prescribed exercise regimes outside the clinic and to continue exercises once the treatment is completed. SLPs need techniques to monitor compliance and accuracy of their patients exercises at home and in ecologically valid communication situations. We have designed EchoWear, a smartwatch-based system, to remotely monitor speech and voice exercises as prescribed by SLPs. We conducted a study of 6 individuals; three with PD and three healthy controls. To assess the performance of EchoWear technology compared with high quality audio equipment obtained in a speech laboratory. Our preliminary analysis shows promising outcomes for using EchoWear in speech therapies for people with PD.
Keywords: Dysarthria; knowledge-based speech processing; Parkinson's disease; smartwatch; speech therapy; wearable system.
△ Less
Submitted 20 December, 2016;
originally announced December 2016.
-
A Multi-Smartwatch System for Assessing Speech Characteristics of People with Dysarthria in Group Settings
Authors:
Harishchandra Dubey,
J. Cody Goldberg,
Kunal Mankodiya,
Leslie Mahler
Abstract:
Speech-language pathologists (SLPs) frequently use vocal exercises in the treatment of patients with speech disorders. Patients receive treatment in a clinical setting and need to practice outside of the clinical setting to generalize speech goals to functional communication. In this paper, we describe the development of technology that captures mixed speech signals in a group setting and allows t…
▽ More
Speech-language pathologists (SLPs) frequently use vocal exercises in the treatment of patients with speech disorders. Patients receive treatment in a clinical setting and need to practice outside of the clinical setting to generalize speech goals to functional communication. In this paper, we describe the development of technology that captures mixed speech signals in a group setting and allows the SLP to analyze the speech signals relative to treatment goals. The mixed speech signals are blindly separated into individual signals that are preprocessed before computation of loudness, pitch, shimmer, jitter, semitone standard deviation and sharpness. The proposed method has been previously validated on data obtained from clinical trials of people with Parkinson disease and healthy controls.
△ Less
Submitted 20 May, 2016;
originally announced May 2016.
-
FIT A Fog Computing Device for Speech TeleTreatments
Authors:
Admir Monteiro,
Harishchandra Dubey,
Leslie Mahler,
Qing Yang,
Kunal Mankodiya
Abstract:
There is an increasing demand for smart fogcomputing gateways as the size of cloud data is growing. This paper presents a Fog computing interface (FIT) for processing clinical speech data. FIT builds upon our previous work on EchoWear, a wearable technology that validated the use of smartwatches for collecting clinical speech data from patients with Parkinson's disease (PD). The fog interface is a…
▽ More
There is an increasing demand for smart fogcomputing gateways as the size of cloud data is growing. This paper presents a Fog computing interface (FIT) for processing clinical speech data. FIT builds upon our previous work on EchoWear, a wearable technology that validated the use of smartwatches for collecting clinical speech data from patients with Parkinson's disease (PD). The fog interface is a low-power embedded system that acts as a smart interface between the smartwatch and the cloud. It collects, stores, and processes the speech data before sending speech features to secure cloud storage. We developed and validated a working prototype of FIT that enabled remote processing of clinical speech data to get speech clinical features such as loudness, short-time energy, zero-crossing rate, and spectral centroid. We used speech data from six patients with PD in their homes for validating FIT. Our results showed the efficacy of FIT as a Fog interface to translate the clinical speech processing chain (CLIP) from a cloud-based backend to a fog-based smart gateway.
△ Less
Submitted 20 May, 2016;
originally announced May 2016.
-
Glassy low-energy spin fluctuations and anisotropy gap in La1.88Sr0.12CuO4
Authors:
A. T. Rømer,
J. Chang,
N. B. Christensen,
B. M. Andersen,
K. Lefmann,
L. Mähler,
J. Gavilano,
R. Gilardi,
Ch. Niedermayer,
H. M. Rønnow,
A. Schneidewind,
P. Link,
M. Oda,
M. Ido,
N. Momono,
J. Mesot
Abstract:
We present high-resolution triple-axis neutron scattering studies of the high-temperature superconductor La1.88Sr0.12CuO4 (Tc=27 K). The temperature dependence of the low-energy incommensurate magnetic fluctuations reveals distinctly glassy features. The glassiness is confirmed by the difference between the ordering temperature TN ~ Tc inferred from elastic neutron scattering and the freezing temp…
▽ More
We present high-resolution triple-axis neutron scattering studies of the high-temperature superconductor La1.88Sr0.12CuO4 (Tc=27 K). The temperature dependence of the low-energy incommensurate magnetic fluctuations reveals distinctly glassy features. The glassiness is confirmed by the difference between the ordering temperature TN ~ Tc inferred from elastic neutron scattering and the freezing temperature Tf ~ 11 K obtained from muon spin rotation studies. The magnetic field independence of the observed excitation spectrum as well as the observation of a partial suppression of magnetic spectral weight below 0.75 meV for temperatures smaller than Tf, indicate that the stripe frozen state is capable of supporting a spin anisotropy gap, of a magnitude similar to that observed in the spin and charge stripe ordered ground state of La1.875Ba0.125CuO4. The difference between TN and Tf implies that the significant enhancement in a magnetic field of nominally elastic incommensurate scattering is caused by strictly in-elastic scattering -- at least in the temperature range between Tf and Tc -- which is not resolved in the present experiment. Combining the results obtained from our study of La1.88Sr0.12CuO4 with a critical reappraisal of published neutron scattering work on samples with chemical composition close to p=0.12, where local probes indicate a sharp maximum in Tf(p), we arrive at the view that the low-energy fluctuations are strongly dependent on composition in this regime, with anisotropy gaps dominating only sufficiently close to p=0.12 and superconducting spin gaps dominating elsewhere.
△ Less
Submitted 4 April, 2013;
originally announced April 2013.
-
Lasing in planar semiconductor diodes
Authors:
Giorgio De Simoni,
Lukas Mahler,
Vincenzo Piazza,
Alessandro Tredicucci,
Christine A. Nicoll,
Harvey E. Beere,
David A. Ritchie,
Fabio Beltram
Abstract:
We present a planar laser diode based on a simple fabrication scheme compatible with virtually any geometry accessible by standard semiconductor lithography technique. We show that our lasers exhibit ~1 GHz -3dB-modulation-bandwidth already in this prototypical implementation. Directions for a significant speed increase are discussed.
We present a planar laser diode based on a simple fabrication scheme compatible with virtually any geometry accessible by standard semiconductor lithography technique. We show that our lasers exhibit ~1 GHz -3dB-modulation-bandwidth already in this prototypical implementation. Directions for a significant speed increase are discussed.
△ Less
Submitted 7 November, 2011;
originally announced November 2011.
