-
Unsupervised Federated Domain Adaptation for Segmentation of MRI Images
Authors:
Navapat Nananukul,
Hamid Soltanian-zadeh,
Mohammad Rostami
Abstract:
Automatic semantic segmentation of magnetic resonance imaging (MRI) images using deep neural networks greatly assists in evaluating and planning treatments for various clinical applications. However, training these models is conditioned on the availability of abundant annotated data to implement the end-to-end supervised learning procedure. Even if we annotate enough data, MRI images display consi…
▽ More
Automatic semantic segmentation of magnetic resonance imaging (MRI) images using deep neural networks greatly assists in evaluating and planning treatments for various clinical applications. However, training these models is conditioned on the availability of abundant annotated data to implement the end-to-end supervised learning procedure. Even if we annotate enough data, MRI images display considerable variability due to factors such as differences in patients, MRI scanners, and imaging protocols. This variability necessitates retraining neural networks for each specific application domain, which, in turn, requires manual annotation by expert radiologists for all new domains. To relax the need for persistent data annotation, we develop a method for unsupervised federated domain adaptation using multiple annotated source domains. Our approach enables the transfer of knowledge from several annotated source domains to adapt a model for effective use in an unannotated target domain. Initially, we ensure that the target domain data shares similar representations with each source domain in a latent embedding space, modeled as the output of a deep encoder, by minimizing the pair-wise distances of the distributions for the target domain and the source domains. We then employ an ensemble approach to leverage the knowledge obtained from all domains. We provide theoretical analysis and perform experiments on the MICCAI 2016 multi-site dataset to demonstrate our method is effective.
△ Less
Submitted 13 January, 2024; v1 submitted 1 January, 2024;
originally announced January 2024.
-
Neural modulation enhancement using connectivity-based EEG neurofeedback with simultaneous fMRI for emotion regulation
Authors:
Amin Dehghani,
Hamid Soltanian-Zadeh,
Gholam-Ali Hossein-Zadeh
Abstract:
Emotion regulation plays a key role in human behavior and overall well-being. Neurofeedback is a non-invasive self-brain training technique used for emotion regulation to enhance brain function and treatment of mental disorders through behavioral changes. Previous neurofeedback research often focused on using activity from a single brain region as measured by fMRI or power from one or two EEG elec…
▽ More
Emotion regulation plays a key role in human behavior and overall well-being. Neurofeedback is a non-invasive self-brain training technique used for emotion regulation to enhance brain function and treatment of mental disorders through behavioral changes. Previous neurofeedback research often focused on using activity from a single brain region as measured by fMRI or power from one or two EEG electrodes. In a new study, we employed connectivity-based EEG neurofeedback through recalling positive autobiographical memories and simultaneous fMRI to upregulate positive emotion. In our novel approach, the feedback was determined by the coherence of EEG electrodes rather than the power of one or two electrodes. We compared the efficiency of this connectivity-based neurofeedback to traditional activity-based neurofeedback through multiple experiments. The results showed that connectivity-based neurofeedback effectively improved BOLD signal change and connectivity in key emotion regulation regions such as the amygdala, thalamus, and insula, and increased EEG frontal asymmetry, which is a biomarker for emotion regulation and treatment of mental disorders such as PTSD, anxiety, and depression and coherence among EEG channels. The psychometric evaluations conducted both before and after the neurofeedback experiments revealed that participants demonstrated improvements in enhancing positive emotions and reducing negative emotions when utilizing connectivity-based neurofeedback, as compared to traditional activity-based and sham neurofeedback approaches. These findings suggest that connectivity-based neurofeedback may be a superior method for regulating emotions and could be a useful alternative therapy for mental disorders, providing individuals with greater control over their brain and mental functions.
△ Less
Submitted 2 November, 2023; v1 submitted 3 April, 2022;
originally announced April 2022.
-
Multi-Scale Convolutional Neural Network for Automated AMD Classification using Retinal OCT Images
Authors:
Saman Sotoudeh-Paima,
Ata Jodeiri,
Fedra Hajizadeh,
Hamid Soltanian-Zadeh
Abstract:
Age-related macular degeneration (AMD) is the most common cause of blindness in developed countries, especially in people over 60 years of age. The workload of specialists and the healthcare system in this field has increased in recent years mainly due to the prevalence of population aging worldwide and the chronic nature of AMD. Recent developments in deep learning have provided a unique opportun…
▽ More
Age-related macular degeneration (AMD) is the most common cause of blindness in developed countries, especially in people over 60 years of age. The workload of specialists and the healthcare system in this field has increased in recent years mainly due to the prevalence of population aging worldwide and the chronic nature of AMD. Recent developments in deep learning have provided a unique opportunity to develop fully automated diagnosis frameworks. Considering the presence of AMD-related retinal pathologies in varying sizes in OCT images, our objective was to propose a multi-scale convolutional neural network (CNN) capable of distinguishing pathologies using receptive fields with various sizes. The multi-scale CNN was designed based on the feature pyramid network (FPN) structure and was used to diagnose normal and two common clinical characteristics of dry and wet AMD, namely drusen and choroidal neovascularization (CNV). The proposed method was evaluated on a national dataset gathered at Noor Eye Hospital (NEH) and the UCSD public dataset. Experimental results show the superior performance of our proposed multi-scale structure over several well-known OCT classification frameworks. This feature combination strategy has proved to be effective on all tested backbone models, with improvements ranging from 0.4% to 3.3%. In addition, gradual learning has proven to improve performance in two consecutive stages. In the first stage, the performance was boosted from 87.2%+-2.5% to 92.0%+-1.6% using pre-trained ImageNet weights. In the second stage, another performance boost from 92.0%+-1.6% to 93.4%+-1.4% was observed due to fine-tuning the previous model on the UCSD dataset. Lastly, generating heatmaps provided additional proof for the effectiveness of our multi-scale structure, enabling the detection of retinal pathologies appearing in different sizes.
△ Less
Submitted 4 February, 2022; v1 submitted 6 October, 2021;
originally announced October 2021.
-
CXR-Net: An Artificial Intelligence Pipeline for Quick Covid-19 Screening of Chest X-Rays
Authors:
Haikal Abdulah,
Benjamin Huber,
Sinan Lal,
Hassan Abdallah,
Luigi L. Palese,
Hamid Soltanian-Zadeh,
Domenico L. Gatti
Abstract:
CXR-Net is a two-module Artificial Intelligence pipeline for the quick detection of SARS-CoV-2 from chest X-rays (CXRs). Module 1 was trained on a public dataset of 6395 CXRs with radiologist annotated lung contours to generate masks of the lungs that overlap the heart and large vasa. Module 2 is a hybrid convnet in which the first convolutional layer with learned coefficients is replaced by a lay…
▽ More
CXR-Net is a two-module Artificial Intelligence pipeline for the quick detection of SARS-CoV-2 from chest X-rays (CXRs). Module 1 was trained on a public dataset of 6395 CXRs with radiologist annotated lung contours to generate masks of the lungs that overlap the heart and large vasa. Module 2 is a hybrid convnet in which the first convolutional layer with learned coefficients is replaced by a layer with fixed coefficients provided by the Wavelet Scattering Transform (WST). Module 2 takes as inputs the patients CXRs and corresponding lung masks calculated by Module 1, and produces as outputs a class assignment (Covid vs. non-Covid) and high resolution heat maps that identify the SARS associated lung regions. Module 2 was trained on a dataset of CXRs from non-Covid and RT-PCR confirmed Covid patients acquired at the Henry Ford Health System (HFHS) Hospital in Detroit. All non-Covid CXRs were from pre-Covid era (2018-2019), and included images from both normal lungs and lungs affected by non-Covid pathologies. Training and test sets consisted of 2265 CXRs (1417 Covid negative, 848 Covid positive), and 1532 CXRs (945 Covid negative, 587 Covid positive), respectively. Six distinct cross-validation models, each trained on 1887 images and validated against 378 images, were combined into an ensemble model that was used to classify the CXR images of the test set with resulting Accuracy = 0.789, Precision = 0.739, Recall = 0.693, F1 score = 0.715, ROC(AUC) = 0.852.
△ Less
Submitted 26 February, 2021;
originally announced March 2021.
-
Epistocracy Algorithm: A Novel Hyper-heuristic Optimization Strategy for Solving Complex Optimization Problems
Authors:
Seyed Ziae Mousavi Mojab,
Seyedmohammad Shams,
Hamid Soltanian-Zadeh,
Farshad Fotouhi
Abstract:
This paper proposes a novel evolutionary algorithm called Epistocracy which incorporates human socio-political behavior and intelligence to solve complex optimization problems. The inspiration of the Epistocracy algorithm originates from a political regime where educated people have more voting power than the uneducated or less educated. The algorithm is a self-adaptive, and multi-population optim…
▽ More
This paper proposes a novel evolutionary algorithm called Epistocracy which incorporates human socio-political behavior and intelligence to solve complex optimization problems. The inspiration of the Epistocracy algorithm originates from a political regime where educated people have more voting power than the uneducated or less educated. The algorithm is a self-adaptive, and multi-population optimizer in which the evolution process takes place in parallel for many populations led by a council of leaders. To avoid stagnation in poor local optima and to prevent a premature convergence, the algorithm employs multiple mechanisms such as dynamic and adaptive leadership based on gravitational force, dynamic population allocation and diversification, variance-based step-size determination, and regression-based leadership adjustment. The algorithm uses a stratified sampling method called Latin Hypercube Sampling (LHS) to distribute the initial population more evenly for exploration of the search space and exploitation of the accumulated knowledge. To investigate the performance and evaluate the reliability of the algorithm, we have used a set of multimodal benchmark functions, and then applied the algorithm to the MNIST dataset to further verify the accuracy, scalability, and robustness of the algorithm. Experimental results show that the Epistocracy algorithm outperforms the tested state-of-the-art evolutionary and swarm intelligence algorithms in terms of performance, precision, and convergence.
△ Less
Submitted 30 January, 2021;
originally announced February 2021.
-
Lung Segmentation in Chest X-rays with Res-CR-Net
Authors:
Haikal Abdulah,
Benjamin Huber,
Sinan Lal,
Hassan Abdallah,
Hamid Soltanian-Zadeh,
Domenico L. Gatti
Abstract:
Deep Neural Networks (DNN) are widely used to carry out segmentation tasks in biomedical images. Most DNNs developed for this purpose are based on some variation of the encoder-decoder U-Net architecture. Here we show that Res-CR-Net, a new type of fully convolutional neural network, which was originally developed for the semantic segmentation of microscopy images, and which does not adopt a U-Net…
▽ More
Deep Neural Networks (DNN) are widely used to carry out segmentation tasks in biomedical images. Most DNNs developed for this purpose are based on some variation of the encoder-decoder U-Net architecture. Here we show that Res-CR-Net, a new type of fully convolutional neural network, which was originally developed for the semantic segmentation of microscopy images, and which does not adopt a U-Net architecture, is very effective at segmenting the lung fields in chest X-rays from either healthy patients or patients with a variety of lung pathologies.
△ Less
Submitted 13 November, 2020;
originally announced November 2020.
-
Comparative Evaluation Of Three Methods Of Automatic Segmentation Of Brain Structures Using 426 Cases
Authors:
Mohammad-Parsa Hosseini,
Esmaeil Davoodi,
Evangelia Bouzos,
Kost Elisevich,
Hamid Soltanian-Zadeh
Abstract:
Segmentation of brain structures in a large dataset of magnetic resonance images (MRI) necessitates automatic segmentation instead of manual tracing. Automatic segmentation methods provide a much-needed alternative to manual segmentation which is both labor intensive and time-consuming. Among brain structures, the hippocampus presents a challenging segmentation task due to its irregular shape, sma…
▽ More
Segmentation of brain structures in a large dataset of magnetic resonance images (MRI) necessitates automatic segmentation instead of manual tracing. Automatic segmentation methods provide a much-needed alternative to manual segmentation which is both labor intensive and time-consuming. Among brain structures, the hippocampus presents a challenging segmentation task due to its irregular shape, small size, and unclear edges. In this work, we use T1-weighted MRI of 426 subjects to validate the approach and compare three automatic segmentation methods: FreeSurfer, LocalInfo, and ABSS. Four evaluation measures are used to assess agreement between automatic and manual segmentation of the hippocampus. ABSS outperformed the others based on the Dice coefficient, precision, Hausdorff distance, ASSD, RMS, similarity, sensitivity, and volume agreement. Moreover, comparison of the segmentation results, acquired using 1.5T and 3T MRI systems, showed that ABSS is more sensitive than the others to the field inhomogeneity of 3T MRI.
△ Less
Submitted 7 August, 2020;
originally announced August 2020.
-
Probing fMRI brain connectivity and activity changes during emotion regulation by EEG neurofeedback
Authors:
Amin Dehghani,
Hamid Soltanian-Zadeh,
Gholam-Ali Hossein-Zadeh
Abstract:
Neurofeedback is a non-invasive brain training with long-term medical and non-medical applications. Despite the existence of several emotion regulation studies using neurofeedback, further investigation is needed to understand interactions of the brain regions involved in the process. We implemented EEG neurofeedback with simultaneous fMRI using a modified happiness-inducing task through autobiogr…
▽ More
Neurofeedback is a non-invasive brain training with long-term medical and non-medical applications. Despite the existence of several emotion regulation studies using neurofeedback, further investigation is needed to understand interactions of the brain regions involved in the process. We implemented EEG neurofeedback with simultaneous fMRI using a modified happiness-inducing task through autobiographical memories to upregulate positive emotion. The results showed increased activity of prefrontal, occipital, parietal, and limbic regions and increased functional connectivity between prefrontal, parietal, limbic system, and insula in the experimental group. New connectivity links were identified by comparing the functional connectivity of different experimental conditions within the experimental group and between the experimental and control groups. The proposed multimodal approach quantified the changes in the brain activity (up to 1.9% increase) and connectivity (FDR-corrected for multiple comparison, q = 0.05) during emotion regulation in/between prefrontal, parietal, limbic, and insula regions. Psychometric assessments confirmed significant changes in positive and negative mood states by neurofeedback with a p-value smaller than 0.002 in the experimental group. This study quantifies the effects of EEG neurofeedback in changing functional connectivity of all brain regions involved in emotion regulation. For the brain regions involved in emotion regulation, we found significant BOLD and functional connectivity increases due to neurofeedback in the experimental group but no learning effect was observed in the control group. The results reveal the neurobiological substrate of emotion regulation by the EEG neurofeedback and separate the effect of the neurofeedback and the recall of the autobiographical memories.
△ Less
Submitted 11 June, 2020;
originally announced June 2020.
-
Using image-extracted features to determine heart rate and blink duration for driver sleepiness detection
Authors:
Erfan Darzi,
Armin Mohammadie-Zand,
Hamid Soltanian-Zadeh
Abstract:
Heart rate and blink duration are two vital physiological signals which give information about cardiac activity and consciousness. Monitoring these two signals is crucial for various applications such as driver drowsiness detection. As there are several problems posed by the conventional systems to be used for continuous, long-term monitoring, a remote blink and ECG monitoring system can be used a…
▽ More
Heart rate and blink duration are two vital physiological signals which give information about cardiac activity and consciousness. Monitoring these two signals is crucial for various applications such as driver drowsiness detection. As there are several problems posed by the conventional systems to be used for continuous, long-term monitoring, a remote blink and ECG monitoring system can be used as an alternative. For estimating the blink duration, two strategies are used. In the first approach, pictures of open and closed eyes are fed into an Artificial Neural Network (ANN) to decide whether the eyes are open or close. In the second approach, they are classified and labeled using Linear Discriminant Analysis (LDA). The labeled images are then be used to determine the blink duration. For heart rate variability, two strategies are used to evaluate the passing blood volume: Independent Component Analysis (ICA); and a chrominance based method. Eye recognition yielded 78-92% accuracy in classifying open/closed eyes with ANN and 71-91% accuracy with LDA. Heart rate evaluations had a mean loss of around 16 Beats Per Minute (BPM) for the ICA strategy and 13 BPM for the chrominance based technique.
△ Less
Submitted 8 December, 2019; v1 submitted 4 November, 2019;
originally announced November 2019.
-
Enhancing performance of subject-specific models via subject-independent information for SSVEP-based BCIs
Authors:
Mohammad Hadi Mehdizavareh,
Sobhan Hemati,
Hamid Soltanian-Zadeh
Abstract:
Recently, brain-computer interface (BCI) systems developed based on steady-state visual evoked potential (SSVEP) have attracted much attention due to their high information transfer rate (ITR) and increasing number of targets. However, SSVEP-based methods can be improved in terms of their accuracy and target detection time. We propose a new method based on canonical correlation analysis (CCA) to i…
▽ More
Recently, brain-computer interface (BCI) systems developed based on steady-state visual evoked potential (SSVEP) have attracted much attention due to their high information transfer rate (ITR) and increasing number of targets. However, SSVEP-based methods can be improved in terms of their accuracy and target detection time. We propose a new method based on canonical correlation analysis (CCA) to integrate subject-specific models and subject-independent information and enhance BCI performance. We propose to use training data of other subjects to optimize hyperparameters for CCA-based model of a specific subject. An ensemble version of the proposed method is also developed for a fair comparison with ensemble task-related component analysis (TRCA). The proposed method is compared with TRCA and extended CCA methods. A publicly available, 35-subject SSVEP benchmark dataset is used for comparison studies and performance is quantified by classification accuracy and ITR. The ITR of the proposed method is higher than those of TRCA and extended CCA. The proposed method outperforms extended CCA in all conditions and TRCA for time windows greater than 0.3 s. The proposed method also outperforms TRCA when there are limited training blocks and electrodes. This study illustrates that adding subject-independent information to subject-specific models can improve performance of SSVEP-based BCIs.
△ Less
Submitted 15 January, 2020; v1 submitted 19 July, 2019;
originally announced July 2019.
-
Cloud-based Deep Learning of Big EEG Data for Epileptic Seizure Prediction
Authors:
Mohammad-Parsa Hosseini,
Hamid Soltanian-Zadeh,
Kost Elisevich,
Dario Pompili
Abstract:
Develo** a Brain-Computer Interface~(BCI) for seizure prediction can help epileptic patients have a better quality of life. However, there are many difficulties and challenges in develo** such a system as a real-life support for patients. Because of the nonstationary nature of EEG signals, normal and seizure patterns vary across different patients. Thus, finding a group of manually extracted f…
▽ More
Develo** a Brain-Computer Interface~(BCI) for seizure prediction can help epileptic patients have a better quality of life. However, there are many difficulties and challenges in develo** such a system as a real-life support for patients. Because of the nonstationary nature of EEG signals, normal and seizure patterns vary across different patients. Thus, finding a group of manually extracted features for the prediction task is not practical. Moreover, when using implanted electrodes for brain recording massive amounts of data are produced. This big data calls for the need for safe storage and high computational resources for real-time processing. To address these challenges, a cloud-based BCI system for the analysis of this big EEG data is presented. First, a dimensionality-reduction technique is developed to increase classification accuracy as well as to decrease the communication bandwidth and computation time. Second, following a deep-learning approach, a stacked autoencoder is trained in two steps for unsupervised feature extraction and classification. Third, a cloud-computing solution is proposed for real-time analysis of big EEG data. The results on a benchmark clinical dataset illustrate the superiority of the proposed patient-specific BCI as an alternative method and its expected usefulness in real-life support of epilepsy patients.
△ Less
Submitted 16 February, 2017;
originally announced February 2017.
-
Automatic and Manual Segmentation of Hippocampus in Epileptic Patients MRI
Authors:
Mohammad-Parsa Hosseini,
Mohammad-Reza Nazem-Zadeh,
Dario Pompili,
Kourosh Jafari-Khouzani,
Kost Elisevich,
Hamid Soltanian-Zadeh
Abstract:
The hippocampus is a seminal structure in the most common surgically-treated form of epilepsy. Accurate segmentation of the hippocampus aids in establishing asymmetry regarding size and signal characteristics in order to disclose the likely site of epileptogenicity. With sufficient refinement, it may ultimately aid in the avoidance of invasive monitoring with its expense and risk for the patient.…
▽ More
The hippocampus is a seminal structure in the most common surgically-treated form of epilepsy. Accurate segmentation of the hippocampus aids in establishing asymmetry regarding size and signal characteristics in order to disclose the likely site of epileptogenicity. With sufficient refinement, it may ultimately aid in the avoidance of invasive monitoring with its expense and risk for the patient. To this end, a reliable and consistent method for segmentation of the hippocampus from magnetic resonance imaging (MRI) is needed. In this work, we present a systematic and statistical analysis approach for evaluation of automated segmentation methods in order to establish one that reliably approximates the results achieved by manual tracing of the hippocampus.
△ Less
Submitted 26 October, 2016; v1 submitted 24 October, 2016;
originally announced October 2016.
-
Computerized Processing and Analysis of CT Images for Develo** a New Criterion in COPD Diagnosis
Authors:
Mohammad-Parsa Hosseini,
Hamid Soltanian-Zadeh,
Shahram Akhlaghpoor
Abstract:
Background: Chronic obstructive pulmonary disease (COPD) is one of the most prevalent and dangerous pulmonary diseases in the world. It is forecasted that COPD will be the third deadly disease in the future. Therefore, develo** non-invasive methods for diagnosis of the disease would be helpful for physicians and patients.
Methods: Based on clinical investigations and spirometry tests, ten adul…
▽ More
Background: Chronic obstructive pulmonary disease (COPD) is one of the most prevalent and dangerous pulmonary diseases in the world. It is forecasted that COPD will be the third deadly disease in the future. Therefore, develo** non-invasive methods for diagnosis of the disease would be helpful for physicians and patients.
Methods: Based on clinical investigations and spirometry tests, ten adult patients with COPD (6 male and 4 female) with mean age of 49.8 years were enrolled as the case group. In addition, ten age and sex-matched healthy, non-COPD individuals (6 male and 4 female) with mean age of 45.4 years were recruited as the controls. Lung CT-scan images of the subjects were processed and analyzed by a computer to find a relationship.
Findings: The elasticity of lung parenchyma variation was obtained with digital image processing. The normalized average of this pattern was found to be 21.6% in patients and 40.7% in controls. In addition, normalized mean value of Hounsfield unit variations in square 10 pixel * 10 pixel windows in the expiratory images were calculated as a parameter of air-trap** in COPD. Differences between the groups were shown by student t-test (P < 0.05).
Conclusion: This study showed that the variation of lung parenchyma elasticity and Hounsfield units are found by processing and analysis of the full inspiration and expiration images. These factors can be used as criteria in diagnosis of COPD. Moreover, the severity of the disease can be presented by the proposed method.
Keywords: Air-trap**, Chronic obstructive pulmonary disease, Image processing and analysis, CT-scan lung images
△ Less
Submitted 27 May, 2016;
originally announced May 2016.
-
Pigment Melanin: Pattern for Iris Recognition
Authors:
Mahdi S. Hosseini,
Babak N. Araabi,
Hamid Soltanian-Zadeh
Abstract:
Recognition of iris based on Visible Light (VL) imaging is a difficult problem because of the light reflection from the cornea. Nonetheless, pigment melanin provides a rich feature source in VL, unavailable in Near-Infrared (NIR) imaging. This is due to biological spectroscopy of eumelanin, a chemical not stimulated in NIR. In this case, a plausible solution to observe such patterns may be provi…
▽ More
Recognition of iris based on Visible Light (VL) imaging is a difficult problem because of the light reflection from the cornea. Nonetheless, pigment melanin provides a rich feature source in VL, unavailable in Near-Infrared (NIR) imaging. This is due to biological spectroscopy of eumelanin, a chemical not stimulated in NIR. In this case, a plausible solution to observe such patterns may be provided by an adaptive procedure using a variational technique on the image histogram. To describe the patterns, a shape analysis method is used to derive feature-code for each subject. An important question is how much the melanin patterns, extracted from VL, are independent of iris texture in NIR. With this question in mind, the present investigation proposes fusion of features extracted from NIR and VL to boost the recognition performance. We have collected our own database (UTIRIS) consisting of both NIR and VL images of 158 eyes of 79 individuals. This investigation demonstrates that the proposed algorithm is highly sensitive to the patterns of cromophores and improves the iris recognition rate.
△ Less
Submitted 29 November, 2009;
originally announced November 2009.