-
Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classification
Authors:
Rui Yang,
Wenrui Dai,
Huajun She,
Yi** P. Du,
Dapeng Wu,
Hongkai Xiong
Abstract:
Building comprehensive brain connectomes has proved of fundamental importance in resting-state fMRI (rs-fMRI) analysis. Based on the foundation of brain network, spatial-temporal-based graph convolutional networks have dramatically improved the performance of deep learning methods in rs-fMRI time series classification. However, existing works either pre-define the brain network as the correlation…
▽ More
Building comprehensive brain connectomes has proved of fundamental importance in resting-state fMRI (rs-fMRI) analysis. Based on the foundation of brain network, spatial-temporal-based graph convolutional networks have dramatically improved the performance of deep learning methods in rs-fMRI time series classification. However, existing works either pre-define the brain network as the correlation matrix derived from the raw time series or jointly learn the connectome and model parameters without any topology constraint. These methods could suffer from degraded classification performance caused by the deviation from the intrinsic brain connectivity and lack biological interpretability of demonstrating the causal structure (i.e., effective connectivity) among brain regions. Moreover, most existing methods for effective connectivity learning are unaware of the downstream classification task and cannot sufficiently exploit useful rs-fMRI label information. To address these issues in an end-to-end manner, we model the brain network as a directed acyclic graph (DAG) to discover direct causal connections between brain regions and propose Spatial-Temporal DAG Convolutional Network (ST-DAGCN) to jointly infer effective connectivity and classify rs-fMRI time series by learning brain representations based on nonlinear structural equation model. The optimization problem is formulated into a continuous program and solved with score-based learning method via gradient descent. We evaluate ST-DAGCN on two public rs-fMRI databases. Experiments show that ST-DAGCN outperforms existing models by evident margins in rs-fMRI classification and simultaneously learns meaningful edges of effective connectivity that help understand brain activity patterns and pathological mechanisms in brain disease.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
scBiGNN: Bilevel Graph Representation Learning for Cell Type Classification from Single-cell RNA Sequencing Data
Authors:
Rui Yang,
Wenrui Dai,
Chenglin Li,
Junni Zou,
Dapeng Wu,
Hongkai Xiong
Abstract:
Single-cell RNA sequencing (scRNA-seq) technology provides high-throughput gene expression data to study the cellular heterogeneity and dynamics of complex organisms. Graph neural networks (GNNs) have been widely used for automatic cell type classification, which is a fundamental problem to solve in scRNA-seq analysis. However, existing methods do not sufficiently exploit both gene-gene and cell-c…
▽ More
Single-cell RNA sequencing (scRNA-seq) technology provides high-throughput gene expression data to study the cellular heterogeneity and dynamics of complex organisms. Graph neural networks (GNNs) have been widely used for automatic cell type classification, which is a fundamental problem to solve in scRNA-seq analysis. However, existing methods do not sufficiently exploit both gene-gene and cell-cell relationships, and thus the true potential of GNNs is not realized. In this work, we propose a bilevel graph representation learning method, named scBiGNN, to simultaneously mine the relationships at both gene and cell levels for more accurate single-cell classification. Specifically, scBiGNN comprises two GNN modules to identify cell types. A gene-level GNN is established to adaptively learn gene-gene interactions and cell representations via the self-attention mechanism, and a cell-level GNN builds on the cell-cell graph that is constructed from the cell representations generated by the gene-level GNN. To tackle the scalability issue for processing a large number of cells, scBiGNN adopts an Expectation Maximization (EM) framework in which the two modules are alternately trained via the E-step and M-step to learn from each other. Through this interaction, the gene- and cell-level structural information is integrated to gradually enhance the classification performance of both GNN modules. Experiments on benchmark datasets demonstrate that our scBiGNN outperforms a variety of existing methods for cell type classification from scRNA-seq data.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
Human Comprehensible Active Learning of Genome-Scale Metabolic Networks
Authors:
Lun Ai,
Shi-Shun Liang,
Wang-Zhou Dai,
Liam Hallett,
Stephen H. Muggleton,
Geoff S. Baldwin
Abstract:
An important application of Synthetic Biology is the engineering of the host cell system to yield useful products. However, an increase in the scale of the host system leads to huge design space and requires a large number of validation trials with high experimental costs. A comprehensible machine learning approach that efficiently explores the hypothesis space and guides experimental design is ur…
▽ More
An important application of Synthetic Biology is the engineering of the host cell system to yield useful products. However, an increase in the scale of the host system leads to huge design space and requires a large number of validation trials with high experimental costs. A comprehensible machine learning approach that efficiently explores the hypothesis space and guides experimental design is urgently needed for the Design-Build-Test-Learn (DBTL) cycle of the host cell system. We introduce a novel machine learning framework ILP-iML1515 based on Inductive Logic Programming (ILP) that performs abductive logical reasoning and actively learns from training examples. In contrast to numerical models, ILP-iML1515 is built on comprehensible logical representations of a genome-scale metabolic model and can update the model by learning new logical structures from auxotrophic mutant trials. The ILP-iML1515 framework 1) allows high-throughput simulations and 2) actively selects experiments that reduce the experimental cost of learning gene functions in comparison to randomly selected experiments.
△ Less
Submitted 31 August, 2023; v1 submitted 24 August, 2023;
originally announced August 2023.
-
Transformer-Based Hierarchical Clustering for Brain Network Analysis
Authors:
Wei Dai,
Hejie Cui,
Xuan Kan,
Ying Guo,
Sanne van Rooij,
Carl Yang
Abstract:
Brain networks, graphical models such as those constructed from MRI, have been widely used in pathological prediction and analysis of brain functions. Within the complex brain system, differences in neuronal connection strengths parcellate the brain into various functional modules (network communities), which are critical for brain analysis. However, identifying such communities within the brain h…
▽ More
Brain networks, graphical models such as those constructed from MRI, have been widely used in pathological prediction and analysis of brain functions. Within the complex brain system, differences in neuronal connection strengths parcellate the brain into various functional modules (network communities), which are critical for brain analysis. However, identifying such communities within the brain has been a nontrivial issue due to the complexity of neuronal interactions. In this work, we propose a novel interpretable transformer-based model for joint hierarchical cluster identification and brain network classification. Extensive experimental results on real-world brain network datasets show that with the help of hierarchical clustering, the model achieves increased accuracy and reduced runtime complexity while providing plausible insight into the functional organization of brain regions. The implementation is available at https://github.com/DDVD233/THC.
△ Less
Submitted 6 May, 2023;
originally announced May 2023.
-
Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis
Authors:
Hejie Cui,
Wei Dai,
Yanqiao Zhu,
Xiaoxiao Li,
Lifang He,
Carl Yang
Abstract:
Human brains lie at the core of complex neurobiological systems, where the neurons, circuits, and subsystems interact in enigmatic ways. Understanding the structural and functional mechanisms of the brain has long been an intriguing pursuit for neuroscience research and clinical disorder therapy. Map** the connections of the human brain as a network is one of the most pervasive paradigms in neur…
▽ More
Human brains lie at the core of complex neurobiological systems, where the neurons, circuits, and subsystems interact in enigmatic ways. Understanding the structural and functional mechanisms of the brain has long been an intriguing pursuit for neuroscience research and clinical disorder therapy. Map** the connections of the human brain as a network is one of the most pervasive paradigms in neuroscience. Graph Neural Networks (GNNs) have recently emerged as a potential method for modeling complex network data. Deep models, on the other hand, have low interpretability, which prevents their usage in decision-critical contexts like healthcare. To bridge this gap, we propose an interpretable framework to analyze disorder-specific Regions of Interest (ROIs) and prominent connections. The proposed framework consists of two modules: a brain-network-oriented backbone model for disease prediction and a globally shared explanation generator that highlights disorder-specific biomarkers including salient ROIs and important connections. We conduct experiments on three real-world datasets of brain disorders. The results verify that our framework can obtain outstanding performance and also identify meaningful biomarkers. All code for this work is available at https://github.com/HennyJie/IBGNN.git.
△ Less
Submitted 23 July, 2022; v1 submitted 30 June, 2022;
originally announced July 2022.
-
BrainGB: A Benchmark for Brain Network Analysis with Graph Neural Networks
Authors:
Hejie Cui,
Wei Dai,
Yanqiao Zhu,
Xuan Kan,
Antonio Aodong Chen Gu,
Joshua Lukemire,
Liang Zhan,
Lifang He,
Ying Guo,
Carl Yang
Abstract:
Map** the connectome of the human brain using structural or functional connectivity has become one of the most pervasive paradigms for neuroimaging analysis. Recently, Graph Neural Networks (GNNs) motivated from geometric deep learning have attracted broad interest due to their established power for modeling complex networked data. Despite their superior performance in many fields, there has not…
▽ More
Map** the connectome of the human brain using structural or functional connectivity has become one of the most pervasive paradigms for neuroimaging analysis. Recently, Graph Neural Networks (GNNs) motivated from geometric deep learning have attracted broad interest due to their established power for modeling complex networked data. Despite their superior performance in many fields, there has not yet been a systematic study of how to design effective GNNs for brain network analysis. To bridge this gap, we present BrainGB, a benchmark for brain network analysis with GNNs. BrainGB standardizes the process by (1) summarizing brain network construction pipelines for both functional and structural neuroimaging modalities and (2) modularizing the implementation of GNN designs. We conduct extensive experiments on datasets across cohorts and modalities and recommend a set of general recipes for effective GNN designs on brain networks. To support open and reproducible research on GNN-based brain network analysis, we host the BrainGB website at https://braingb.us with models, tutorials, examples, as well as an out-of-box Python package. We hope that this work will provide useful empirical evidence and offer insights for future research in this novel and promising direction.
△ Less
Submitted 28 November, 2022; v1 submitted 17 March, 2022;
originally announced April 2022.
-
BrainNNExplainer: An Interpretable Graph Neural Network Framework for Brain Network based Disease Analysis
Authors:
Hejie Cui,
Wei Dai,
Yanqiao Zhu,
Xiaoxiao Li,
Lifang He,
Carl Yang
Abstract:
Interpretable brain network models for disease prediction are of great value for the advancement of neuroscience. GNNs are promising to model complicated network data, but they are prone to overfitting and suffer from poor interpretability, which prevents their usage in decision-critical scenarios like healthcare. To bridge this gap, we propose BrainNNExplainer, an interpretable GNN framework for…
▽ More
Interpretable brain network models for disease prediction are of great value for the advancement of neuroscience. GNNs are promising to model complicated network data, but they are prone to overfitting and suffer from poor interpretability, which prevents their usage in decision-critical scenarios like healthcare. To bridge this gap, we propose BrainNNExplainer, an interpretable GNN framework for brain network analysis. It is mainly composed of two jointly learned modules: a backbone prediction model that is specifically designed for brain networks and an explanation generator that highlights disease-specific prominent brain network connections. Extensive experimental results with visualizations on two challenging disease prediction datasets demonstrate the unique interpretability and outstanding performance of BrainNNExplainer.
△ Less
Submitted 11 July, 2021;
originally announced July 2021.
-
Emergence of a Balanced Core through Dynamical Competition in Heterogeneous Neuronal Networks
Authors:
Qing-long L. Gu,
Songting Li,
Wei P. Dai,
Douglas Zhou,
David Cai
Abstract:
The balance between excitation and inhibition is crucial for neuronal computation. It is observed that the balanced state of neuronal networks exists in many experiments, yet its underlying mechanism remains to be fully clarified. Theoretical studies of the balanced state mainly focus on the analysis of the homogeneous Erd$\ddot{\text{o}}$s-Rényi network. However, neuronal networks have been found…
▽ More
The balance between excitation and inhibition is crucial for neuronal computation. It is observed that the balanced state of neuronal networks exists in many experiments, yet its underlying mechanism remains to be fully clarified. Theoretical studies of the balanced state mainly focus on the analysis of the homogeneous Erd$\ddot{\text{o}}$s-Rényi network. However, neuronal networks have been found to be inhomogeneous in many cortical areas. In particular, the connectivity of neuronal networks can be of the type of scale-free, small-world, or even with specific motifs. In this work, we examine the questions of whether the balanced state is universal with respect to network topology and what characteristics the balanced state possesses in inhomogeneous networks such as scale-free and small-world networks. We discover that, for a sparsely but strongly connected inhomogeneous network, despite that the whole network receives external inputs, there is a small active subnetwork (active core) inherently embedded within it. The neurons in this active core have relatively high firing rates while the neurons in the rest of the network are quiescent. Surprisingly, the active core possesses a balanced state and this state is independent of the model of single-neuron dynamics. The dynamics of the active core can be well predicted using the Fokker-Planck equation with the mean-field assumption. Our results suggest that, in the presence of inhomogeneous network connectivity, the balanced state may be ubiquitous in the brain, and the network connectivity in the active core is essentially close to the Erd$\ddot{\text{o}}$s-Rényi structure. The existence of the small active core embedded in a large network may provide a potential dynamical scenario underlying sparse coding in neuronal networks.
△ Less
Submitted 14 October, 2017;
originally announced October 2017.
-
Convolutional Neural Networks for Automated Annotation of Cellular Cryo-Electron Tomograms
Authors:
Muyuan Chen,
Wei Dai,
Ying Sun,
Darius Jonasch,
Cynthia Y He,
Michael F. Schmid,
Wah Chiu,
Steven J Ludtke
Abstract:
Cellular Electron Cryotomography (CryoET) offers the ability to look inside cells and observe macromolecules frozen in action. A primary challenge for this technique is identifying and extracting the molecular components within the crowded cellular environment. We introduce a method using neural networks to dramatically reduce the time and human effort required for subcellular annotation and featu…
▽ More
Cellular Electron Cryotomography (CryoET) offers the ability to look inside cells and observe macromolecules frozen in action. A primary challenge for this technique is identifying and extracting the molecular components within the crowded cellular environment. We introduce a method using neural networks to dramatically reduce the time and human effort required for subcellular annotation and feature extraction. Subsequent subtomogram classification and averaging yields in-situ structures of molecular components of interest.
△ Less
Submitted 11 June, 2017; v1 submitted 19 January, 2017;
originally announced January 2017.
