-
Spatial-Temporal DAG Convolutional Networks for End-to-End Joint Effective Connectivity Learning and Resting-State fMRI Classification
Authors:
Rui Yang,
Wenrui Dai,
Huajun She,
Yi** P. Du,
Dapeng Wu,
Hongkai Xiong
Abstract:
Building comprehensive brain connectomes has proved of fundamental importance in resting-state fMRI (rs-fMRI) analysis. Based on the foundation of brain network, spatial-temporal-based graph convolutional networks have dramatically improved the performance of deep learning methods in rs-fMRI time series classification. However, existing works either pre-define the brain network as the correlation…
▽ More
Building comprehensive brain connectomes has proved of fundamental importance in resting-state fMRI (rs-fMRI) analysis. Based on the foundation of brain network, spatial-temporal-based graph convolutional networks have dramatically improved the performance of deep learning methods in rs-fMRI time series classification. However, existing works either pre-define the brain network as the correlation matrix derived from the raw time series or jointly learn the connectome and model parameters without any topology constraint. These methods could suffer from degraded classification performance caused by the deviation from the intrinsic brain connectivity and lack biological interpretability of demonstrating the causal structure (i.e., effective connectivity) among brain regions. Moreover, most existing methods for effective connectivity learning are unaware of the downstream classification task and cannot sufficiently exploit useful rs-fMRI label information. To address these issues in an end-to-end manner, we model the brain network as a directed acyclic graph (DAG) to discover direct causal connections between brain regions and propose Spatial-Temporal DAG Convolutional Network (ST-DAGCN) to jointly infer effective connectivity and classify rs-fMRI time series by learning brain representations based on nonlinear structural equation model. The optimization problem is formulated into a continuous program and solved with score-based learning method via gradient descent. We evaluate ST-DAGCN on two public rs-fMRI databases. Experiments show that ST-DAGCN outperforms existing models by evident margins in rs-fMRI classification and simultaneously learns meaningful edges of effective connectivity that help understand brain activity patterns and pathological mechanisms in brain disease.
△ Less
Submitted 15 December, 2023;
originally announced December 2023.
-
IMJENSE: Scan-specific Implicit Representation for Joint Coil Sensitivity and Image Estimation in Parallel MRI
Authors:
Ruimin Feng,
Qing Wu,
Jie Feng,
Huajun She,
Chunlei Liu,
Yuyao Zhang,
Hongjiang Wei
Abstract:
Parallel imaging is a commonly used technique to accelerate magnetic resonance imaging (MRI) data acquisition. Mathematically, parallel MRI reconstruction can be formulated as an inverse problem relating the sparsely sampled k-space measurements to the desired MRI image. Despite the success of many existing reconstruction algorithms, it remains a challenge to reliably reconstruct a high-quality im…
▽ More
Parallel imaging is a commonly used technique to accelerate magnetic resonance imaging (MRI) data acquisition. Mathematically, parallel MRI reconstruction can be formulated as an inverse problem relating the sparsely sampled k-space measurements to the desired MRI image. Despite the success of many existing reconstruction algorithms, it remains a challenge to reliably reconstruct a high-quality image from highly reduced k-space measurements. Recently, implicit neural representation has emerged as a powerful paradigm to exploit the internal information and the physics of partially acquired data to generate the desired object. In this study, we introduced IMJENSE, a scan-specific implicit neural representation-based method for improving parallel MRI reconstruction. Specifically, the underlying MRI image and coil sensitivities were modeled as continuous functions of spatial coordinates, parameterized by neural networks and polynomials, respectively. The weights in the networks and coefficients in the polynomials were simultaneously learned directly from sparsely acquired k-space measurements, without fully sampled ground truth data for training. Benefiting from the powerful continuous representation and joint estimation of the MRI image and coil sensitivities, IMJENSE outperforms conventional image or k-space domain reconstruction algorithms. With extremely limited calibration data, IMJENSE is more stable than supervised calibrationless and calibration-based deep-learning methods. Results show that IMJENSE robustly reconstructs the images acquired at 5$\mathbf{\times}$ and 6$\mathbf{\times}$ accelerations with only 4 or 8 calibration lines in 2D Cartesian acquisitions, corresponding to 22.0% and 19.5% undersampling rates. The high-quality results and scanning specificity make the proposed method hold the potential for further accelerating the data acquisition of parallel MRI.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
Automated segmentaiton and classification of arterioles and venules using Cascading Dilated Convolutional Neural Networks
Authors:
Meng Li,
Yan Zhang,
Haicheng She,
**qiong Zhou,
Jia Jia,
Danmei He,
Li Zhang
Abstract:
The change of retinal vasculature is an early sign of many vascular and systematic diseases, such as diabetes and hypertension. Different behaviors of retinal arterioles and venules form an important metric to measure the disease severity. Therefore, an accurate classification of arterioles and venules is of great necessity. In this work, we propose a novel architecture of deep convolutional neura…
▽ More
The change of retinal vasculature is an early sign of many vascular and systematic diseases, such as diabetes and hypertension. Different behaviors of retinal arterioles and venules form an important metric to measure the disease severity. Therefore, an accurate classification of arterioles and venules is of great necessity. In this work, we propose a novel architecture of deep convolutional neural network for segmenting and classifying arterioles and venules on retinal fundus images. This network takes the original color fundus image as inputs and multi-class labels as outputs. We adopt the encoding-decoding structure (Unet) as the backbone network of our proposed model. To improve the classification accuracy, we develop a special encoding path that couples InceptionV4 modules and Cascading Dilated Convolutions (CDCs) on top of the backbone network. The model is thus able to extract and fuse high-level semantic features from multi-scale receptive fields. The proposed method has outperformed the previous state-of-the-art method on DRIVE dataset with an accuracy of 0.955 $\pm$ 0.002.
△ Less
Submitted 30 November, 2018;
originally announced December 2018.
-
Directed Energy Interception of Satellites
Authors:
Harrison She,
Will Hettel,
Philip Lubin
Abstract:
High power Earth and orbital-based directed energy (DE) systems pose a potential hazard to Earth orbiting spacecraft. The use of very high power, large aperture DE systems to propel spacecraft is being pursued as the only known, feasible method to achieve relativistic flight in our NASA Starlight and Breakthrough Starshot programs. In addition, other beamed power mission scenarios, such as orbital…
▽ More
High power Earth and orbital-based directed energy (DE) systems pose a potential hazard to Earth orbiting spacecraft. The use of very high power, large aperture DE systems to propel spacecraft is being pursued as the only known, feasible method to achieve relativistic flight in our NASA Starlight and Breakthrough Starshot programs. In addition, other beamed power mission scenarios, such as orbital debris removal and our NASA program using DE for powering high performance ion engine missions, pose similar concerns. It is critical to quantify the probability and rates of interception of the DE beam with the approximately 2000 active Earth orbiting spacecraft. We have modeled the interception of the beam with satellites by using their orbital parameters and computing the likelihood of interception for many of the scenarios of the proposed systems we are working on. We are able to simulate both the absolute interception as well as the distance and angle from the beam to the spacecraft, and have modeled a number of scenarios to obtain general probabilities. We have established that the probability of beam interception of any active satellite, including its orbital position uncertainty, during any of the proposed mission scenarios is low ($\approx10^{-4}$). The outcome of this work gives us the ability to predict when to energize the beam without intercept, as well as the capability to turn off the DE as needed for extended mission scenarios. As additional satellites are launched, our work can be readily extended to accommodate them. Our work can also be used to predict interception of astronomical adaptive optics guide-star lasers as well as more general laser use.
△ Less
Submitted 27 February, 2019; v1 submitted 24 September, 2018;
originally announced September 2018.
-
Bag-of-Words Representation for Biomedical Time Series Classification
Authors:
** Wang,
** Liu,
Mary F. H. She,
Saeid Nahavandi,
and Abbas Kouzani
Abstract:
Automatic analysis of biomedical time series such as electroencephalogram (EEG) and electrocardiographic (ECG) signals has attracted great interest in the community of biomedical engineering due to its important applications in medicine. In this work, a simple yet effective bag-of-words representation that is able to capture both local and global structure similarity information is proposed for bi…
▽ More
Automatic analysis of biomedical time series such as electroencephalogram (EEG) and electrocardiographic (ECG) signals has attracted great interest in the community of biomedical engineering due to its important applications in medicine. In this work, a simple yet effective bag-of-words representation that is able to capture both local and global structure similarity information is proposed for biomedical time series representation. In particular, similar to the bag-of-words model used in text document domain, the proposed method treats a time series as a text document and extracts local segments from the time series as words. The biomedical time series is then represented as a histogram of codewords, each entry of which is the count of a codeword appeared in the time series. Although the temporal order of the local segments is ignored, the bag-of-words representation is able to capture high-level structural information because both local and global structural information are well utilized. The performance of the bag-of-words model is validated on three datasets extracted from real EEG and ECG signals. The experimental results demonstrate that the proposed method is not only insensitive to parameters of the bag-of-words model such as local segment length and codebook size, but also robust to noise.
△ Less
Submitted 10 December, 2012;
originally announced December 2012.
