-
Unified Embeddings of Structural and Functional Connectome via a Function-Constrained Structural Graph Variational Auto-Encoder
Authors:
Carlo Amodeo,
Igor Fortel,
Olusola Ajilore,
Liang Zhan,
Alex Leow,
Theja Tulabandhula
Abstract:
Graph theoretical analyses have become standard tools in modeling functional and anatomical connectivity in the brain. With the advent of connectomics, the primary graphs or networks of interest are structural connectome (derived from DTI tractography) and functional connectome (derived from resting-state fMRI). However, most published connectome studies have focused on either structural or functi…
▽ More
Graph theoretical analyses have become standard tools in modeling functional and anatomical connectivity in the brain. With the advent of connectomics, the primary graphs or networks of interest are structural connectome (derived from DTI tractography) and functional connectome (derived from resting-state fMRI). However, most published connectome studies have focused on either structural or functional connectome, yet complementary information between them, when available in the same dataset, can be jointly leveraged to improve our understanding of the brain. To this end, we propose a function-constrained structural graph variational autoencoder (FCS-GVAE) capable of incorporating information from both functional and structural connectome in an unsupervised fashion. This leads to a joint low-dimensional embedding that establishes a unified spatial coordinate system for comparing across different subjects. We evaluate our approach using the publicly available OASIS-3 Alzheimer's disease (AD) dataset and show that a variational formulation is necessary to optimally encode functional brain dynamics. Further, the proposed joint embedding approach can more accurately distinguish different patient sub-populations than approaches that do not use complementary connectome information.
△ Less
Submitted 5 July, 2022;
originally announced July 2022.
-
Functional2Structural: Cross-Modality Brain Networks Representation Learning
Authors:
Haoteng Tang,
Xiyao Fu,
Lei Guo,
Yalin Wang,
Scott Mackin,
Olusola Ajilore,
Alex Leow,
Paul Thompson,
Heng Huang,
Liang Zhan
Abstract:
MRI-based modeling of brain networks has been widely used to understand functional and structural interactions and connections among brain regions, and factors that affect them, such as brain development and disease. Graph mining on brain networks may facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Since brain networks derived from functional an…
▽ More
MRI-based modeling of brain networks has been widely used to understand functional and structural interactions and connections among brain regions, and factors that affect them, such as brain development and disease. Graph mining on brain networks may facilitate the discovery of novel biomarkers for clinical phenotypes and neurodegenerative diseases. Since brain networks derived from functional and structural MRI describe the brain topology from different perspectives, exploring a representation that combines these cross-modality brain networks is non-trivial. Most current studies aim to extract a fused representation of the two types of brain network by projecting the structural network to the functional counterpart. Since the functional network is dynamic and the structural network is static, map** a static object to a dynamic object is suboptimal. However, map** in the opposite direction is not feasible due to the non-negativity requirement of current graph learning techniques. Here, we propose a novel graph learning framework, known as Deep Signed Brain Networks (DSBN), with a signed graph encoder that, from an opposite perspective, learns the cross-modality representations by projecting the functional network to the structural counterpart. We validate our framework on clinical phenotype and neurodegenerative disease prediction tasks using two independent, publicly available datasets (HCP and OASIS). The experimental results clearly demonstrate the advantages of our model compared to several state-of-the-art methods.
△ Less
Submitted 5 May, 2022;
originally announced May 2022.
-
TempoCave: Visualizing Dynamic Connectome Datasets to Support Cognitive Behavioral Therapy
Authors:
Ran Xu,
Manu Mathew Thomas,
Alex Leow,
Olusola Ajilore,
Angus G. Forbes
Abstract:
We introduce TempoCave, a novel visualization application for analyzing dynamic brain networks, or connectomes. TempoCave provides a range of functionality to explore metrics related to the activity patterns and modular affiliations of different regions in the brain. These patterns are calculated by processing raw data retrieved functional magnetic resonance imaging (fMRI) scans, which creates a n…
▽ More
We introduce TempoCave, a novel visualization application for analyzing dynamic brain networks, or connectomes. TempoCave provides a range of functionality to explore metrics related to the activity patterns and modular affiliations of different regions in the brain. These patterns are calculated by processing raw data retrieved functional magnetic resonance imaging (fMRI) scans, which creates a network of weighted edges between each brain region, where the weight indicates how likely these regions are to activate synchronously. In particular, we support the analysis needs of clinical psychologists, who examine these modular affiliations and weighted edges and their temporal dynamics, utilizing them to understand relationships between neurological disorders and brain activity, which could have a significant impact on the way in which patients are diagnosed and treated. We summarize the core functionality of TempoCave, which supports a range of comparative tasks, and runs both in a desktop mode and in an immersive mode. Furthermore, we present a real-world use case that analyzes pre- and post-treatment connectome datasets from 27 subjects in a clinical study investigating the use of cognitive behavior therapy to treat major depression disorder, indicating that TempoCave can provide new insight into the dynamic behavior of the human brain.
△ Less
Submitted 6 August, 2019; v1 submitted 18 June, 2019;
originally announced June 2019.
-
EEG Classification by factoring in Sensor Configuration
Authors:
Lubna Shibly Mokatren,
Rashid Ansari,
Ahmet Enis Cetin,
Alex D Leow,
Heide Klumpp,
Olusola Ajilore,
Fatos Yarman Vural
Abstract:
Electroencephalography (EEG) serves as an effective diagnostic tool for mental disorders and neurological abnormalities. Enhanced analysis and classification of EEG signals can help improve detection performance. A new approach is examined here for enhancing EEG classification performance by leveraging knowledge of spatial layout of EEG sensors. Performance of two classification models - model 1 t…
▽ More
Electroencephalography (EEG) serves as an effective diagnostic tool for mental disorders and neurological abnormalities. Enhanced analysis and classification of EEG signals can help improve detection performance. A new approach is examined here for enhancing EEG classification performance by leveraging knowledge of spatial layout of EEG sensors. Performance of two classification models - model 1 that ignores the sensor layout and model 2 that factors it in - is investigated and found to achieve consistently higher detection accuracy. The analysis is based on the information content of these signals represented in two different ways: concatenation of the channels of the frequency bands and an image-like 2D representation of the EEG channel locations. Performance of these models is examined on two tasks, social anxiety disorder (SAD) detection, and emotion recognition using a dataset for emotion analysis using physiological signals (DEAP). We hypothesized that model 2 will significantly outperform model 1 and this was validated in our results as model 2 yielded $5$--$8\%$ higher accuracy in all machine learning algorithms investigated. Convolutional Neural Networks (CNN) provided the best performance far exceeding that of Support Vector Machine (SVM) and k-Nearest Neighbors (kNNs) algorithms.
△ Less
Submitted 7 February, 2020; v1 submitted 22 May, 2019;
originally announced May 2019.
-
EEG Classification based on Image Configuration in Social Anxiety Disorder
Authors:
Lubna Shibly Mokatren,
Rashid Ansari,
Ahmet Enis Cetin,
Alex D. Leow,
Olusola Ajilore,
Heide Klumpp,
Fatos T. Yarman Vural
Abstract:
The problem of detecting the presence of Social Anxiety Disorder (SAD) using Electroencephalography (EEG) for classification has seen limited study and is addressed with a new approach that seeks to exploit the knowledge of EEG sensor spatial configuration. Two classification models, one which ignores the configuration (model 1) and one that exploits it with different interpolation methods (model…
▽ More
The problem of detecting the presence of Social Anxiety Disorder (SAD) using Electroencephalography (EEG) for classification has seen limited study and is addressed with a new approach that seeks to exploit the knowledge of EEG sensor spatial configuration. Two classification models, one which ignores the configuration (model 1) and one that exploits it with different interpolation methods (model 2), are studied. Performance of these two models is examined for analyzing 34 EEG data channels each consisting of five frequency bands and further decomposed with a filter bank. The data are collected from 64 subjects consisting of healthy controls and patients with SAD. Validity of our hypothesis that model 2 will significantly outperform model 1 is borne out in the results, with accuracy $6$--$7\%$ higher for model 2 for each machine learning algorithm we investigated. Convolutional Neural Networks (CNN) were found to provide much better performance than SVM and kNNs.
△ Less
Submitted 6 December, 2018;
originally announced December 2018.
-
DeepMood: Modeling Mobile Phone Ty** Dynamics for Mood Detection
Authors:
Bokai Cao,
Lei Zheng,
Chenwei Zhang,
Philip S. Yu,
Andrea Piscitello,
John Zulueta,
Olu Ajilore,
Kelly Ryan,
Alex D. Leow
Abstract:
The increasing use of electronic forms of communication presents new opportunities in the study of mental health, including the ability to investigate the manifestations of psychiatric diseases unobtrusively and in the setting of patients' daily lives. A pilot study to explore the possible connections between bipolar affective disorder and mobile phone usage was conducted. In this study, participa…
▽ More
The increasing use of electronic forms of communication presents new opportunities in the study of mental health, including the ability to investigate the manifestations of psychiatric diseases unobtrusively and in the setting of patients' daily lives. A pilot study to explore the possible connections between bipolar affective disorder and mobile phone usage was conducted. In this study, participants were provided a mobile phone to use as their primary phone. This phone was loaded with a custom keyboard that collected metadata consisting of keypress entry time and accelerometer movement. Individual character data with the exceptions of the backspace key and space bar were not collected due to privacy concerns. We propose an end-to-end deep architecture based on late fusion, named DeepMood, to model the multi-view metadata for the prediction of mood scores. Experimental results show that 90.31% prediction accuracy on the depression score can be achieved based on session-level mobile phone ty** dynamics which is typically less than one minute. It demonstrates the feasibility of using mobile phone metadata to infer mood disturbance and severity.
△ Less
Submitted 23 March, 2018;
originally announced March 2018.
-
Sex-by-age differences in the resting-state brain connectivity
Authors:
Sean D. Conrin,
Liang Zhan,
Zachery D. Morrissey,
Mengqi Xing,
Angus Forbes,
Pauline Maki,
Mohammed R. Milad,
Olusola Ajilore,
Alex D. Leow
Abstract:
Recently we developed a novel method for assessing the hierarchical modularity of functional brain networks - the probability associated community estimation(PACE). The PACE algorithm is unique in that it permits a dual formulation, thus yielding equivalent connectome modular structure regardless of whether considering positive or negative edges. This method was rigorously validated using F1000 an…
▽ More
Recently we developed a novel method for assessing the hierarchical modularity of functional brain networks - the probability associated community estimation(PACE). The PACE algorithm is unique in that it permits a dual formulation, thus yielding equivalent connectome modular structure regardless of whether considering positive or negative edges. This method was rigorously validated using F1000 and HCP data. We detected novel sex differences in resting-state connectivity that were not previously reported. This current study more thoroughly examined sex differences as a function of age and their clinical correlates, with findings supporting a basal configuration framework. To this end, we found that men and women do not significantly differ in the 22-25 age range. However, these same non-significant differences attained statistical significance in the 26-30 age group, while becoming highly statistically significant in the 31-35 age group. At the most global level, areas of diverging sex difference include parts of the prefrontal cortex and the temporal lobe, amygdala, hippocampus, inferior parietal lobule, posterior cingulate, and precuneus. Further, we identified statistically different self-reported summary scores of inattention, hyperactivity, and anxiety problems between men and women. These self-reports additionally divergently interact with age and the basal configuration between sexes. In sum, our study supports a paradigm change in how we conceptualize the functional connectome, shifting away from simple concepts, and towards thinking globally and probabilistically how the brain exhibits dynamic sex-specific connectivity configuration as a function of age, and the role this sex-by-age configuration at rest might play in mental health frequency and presentation, including symptom patterns in depression.
△ Less
Submitted 4 January, 2018;
originally announced January 2018.
-
Exploring the Human Connectome Topology in Group Studies
Authors:
Johnson J. G. Keiriz,
Liang Zhan,
Morris Chukhman,
Olu Ajilore,
Alex D. Leow,
Angus G. Forbes
Abstract:
Visually comparing brain networks, or connectomes, is an essential task in the field of neuroscience. Especially relevant to the field of clinical neuroscience, group studies that examine differences between populations or changes over time within a population enable neuroscientists to reason about effective diagnoses and treatments for a range of neuropsychiatric disorders. In this paper, we spec…
▽ More
Visually comparing brain networks, or connectomes, is an essential task in the field of neuroscience. Especially relevant to the field of clinical neuroscience, group studies that examine differences between populations or changes over time within a population enable neuroscientists to reason about effective diagnoses and treatments for a range of neuropsychiatric disorders. In this paper, we specifically explore how visual analytics tools can be used to facilitate various clinical neuroscience tasks, in which observation and analysis of meaningful patterns in the connectome can support patient diagnosis and treatment. We conduct a survey of visualization tasks that enable clinical neuroscience activities, and further explore how existing connectome visualization tools support or fail to support these tasks. Based on our investigation of these tasks, we introduce a novel visualization tool, NeuroCave, to support group studies analyses. We discuss how our design decisions (the use of immersive visualization, the use of hierarchical clustering and dimensionality reduction techniques, and the choice of visual encodings) are motivated by these tasks. We evaluate NeuroCave through two use cases that illustrate the utility of interactive connectome visualization in clinical neuroscience contexts. In the first use case, we study sex differences using functional connectomes and discover hidden connectome patterns associated with well-known cognitive differences in spatial and verbal abilities. In the second use case, we show how the utility of visualizing the brain in different topological space coupled with clustering information can reveal the brain's intrinsic structure.
△ Less
Submitted 30 June, 2017;
originally announced June 2017.
-
The Importance of Being Negative: A serious treatment of non-trivial edges in brain functional connectome
Authors:
Liang Zhan,
Lisanne M. Jenkins,
Ouri E. Wolfson,
Johnson J. GadElkarim,
Kevin Nocito,
Paul M. Thompson,
Olusola A. Ajilore,
Moo K. Chung,
Alex D. Leow
Abstract:
Understanding the modularity of fMRI-derived brain networks or connectomes can inform the study of brain function organization. However, fMRI connectomes additionally involve negative edges, which are not rigorously accounted for by existing approaches to modularity that either ignores or arbitrarily weight these connections. Furthermore, most Q maximization-based modularity algorithms yield varia…
▽ More
Understanding the modularity of fMRI-derived brain networks or connectomes can inform the study of brain function organization. However, fMRI connectomes additionally involve negative edges, which are not rigorously accounted for by existing approaches to modularity that either ignores or arbitrarily weight these connections. Furthermore, most Q maximization-based modularity algorithms yield variable results with suboptimal reproducibility. Here we present an alternative, reproducible approach that exploits how frequent the BOLD-signal correlation between two nodes is negative. We validated this novel probability-based modularity approach on two independent publicly-available resting-state connectome dataset (the Human Connectome Project and the 1000 Functional Connectomes) and demonstrated that negative correlations alone are sufficient in understanding resting-state modularity. In fact, this approach a) permits a dual formulation, leading to equivalent solutions regardless of whether one considers positive or negative edges; b) is theoretically linked to the Ising model defined on the connectome, thus yielding modularity result that maximizes data likelihood. We additionally were able to detect sex differences in modularity that the most widely utilized methods did not. Results confirmed the superiority of our approach in that: a) correlations with the highest probability of being negative are consistently placed between modules, b) due to the equivalent dual forms, no arbitrary weighting factor is required to balance the influence between negative and positive correlations, unlike existing Q maximization-based modularity approaches. As datasets like HCP become widely available for analysis by the neuroscience community at large, appropriate computational tools to understand the neurobiological information of negative edges in fMRI connectomes are increasingly important.
△ Less
Submitted 5 June, 2017; v1 submitted 6 September, 2016;
originally announced September 2016.