-
A novel 3D multi-path DenseNet for improving automatic segmentation of glioblastoma on pre-operative multi-modal MR images
Authors:
Jie Fu,
Kamal Singhrao,
X. Sharon Qi,
Yingli Yang,
Dan Ruan,
John H. Lewis
Abstract:
Convolutional neural networks have achieved excellent results in automatic medical image segmentation. In this study, we proposed a novel 3D multi-path DenseNet for generating the accurate glioblastoma (GBM) tumor contour from four multi-modal pre-operative MR images. We hypothesized that the multi-path architecture could achieve more accurate segmentation than a single-path architecture. 258 GBM…
▽ More
Convolutional neural networks have achieved excellent results in automatic medical image segmentation. In this study, we proposed a novel 3D multi-path DenseNet for generating the accurate glioblastoma (GBM) tumor contour from four multi-modal pre-operative MR images. We hypothesized that the multi-path architecture could achieve more accurate segmentation than a single-path architecture. 258 GBM patients were included in this study. Each patient had four MR images (T1-weighted, contrast-enhanced T1-weighted, T2-weighted, and FLAIR) and the manually segmented tumor contour. We built a 3D multi-path DenseNet that could be trained to generate the corresponding GBM tumor contour from the four MR images. A 3D single-path DenseNet was also built for comparison. Both DenseNets were based on the encoder-decoder architecture. All four images were concatenated and fed into a single encoder path in the single-path DenseNet, while each input image had its own encoder path in the multi-path DenseNet. The patient cohort was randomly split into a training set of 180 patients, a validation set of 39 patients, and a testing set of 39 patients. Model performance was evaluated using the Dice similarity coefficient (DSC), average surface distance (ASD), and 95% Hausdorff distance (HD95%). Wilcoxon signed-rank tests were conducted to examine the model differences. The single-path DenseNet achieved a DSC of 0.911$\pm$0.060, ASD of 1.3$\pm$0.7 mm, and HD95% of 5.2$\pm$7.1 mm, while the multi-path DenseNet achieved a DSC of 0.922$\pm$0.041, ASD of 1.1$\pm$0.5 mm, and HD95% of 3.9$\pm$3.3 mm. The p-values of all Wilcoxon signed-rank tests were less than 0.05. Both 3D DenseNets generated GBM tumor contours in good agreement with the manually segmented contours from multi-modal MR images. The multi-path DenseNet achieved more accurate tumor segmentation than the single-path DenseNet.
△ Less
Submitted 11 May, 2020;
originally announced May 2020.
-
An automatic deep learning-based workflow for glioblastoma survival prediction using pre-operative multimodal MR images
Authors:
Jie Fu,
Kamal Singhrao,
Xinran Zhong,
Yu Gao,
Sharon Qi,
Yingli Yang,
Dan Ruan,
John H Lewis
Abstract:
We proposed a fully automatic workflow for glioblastoma (GBM) survival prediction using deep learning (DL) methods. 285 glioma (210 GBM, 75 low-grade glioma) patients were included. 163 of the GBM patients had overall survival (OS) data. Every patient had four pre-operative MR scans and manually drawn tumor contours. For automatic tumor segmentation, a 3D convolutional neural network (CNN) was tra…
▽ More
We proposed a fully automatic workflow for glioblastoma (GBM) survival prediction using deep learning (DL) methods. 285 glioma (210 GBM, 75 low-grade glioma) patients were included. 163 of the GBM patients had overall survival (OS) data. Every patient had four pre-operative MR scans and manually drawn tumor contours. For automatic tumor segmentation, a 3D convolutional neural network (CNN) was trained and validated using 122 glioma patients. The trained model was applied to the remaining 163 GBM patients to generate tumor contours. The handcrafted and DL-based radiomic features were extracted from auto-contours using explicitly designed algorithms and a pre-trained CNN respectively. 163 GBM patients were randomly split into training (n=122) and testing (n=41) sets for survival analysis. Cox regression models with regularization techniques were trained to construct the handcrafted and DL-based signatures. The prognostic power of the two signatures was evaluated and compared. The 3D CNN achieved an average Dice coefficient of 0.85 across 163 GBM patients for tumor segmentation. The handcrafted signature achieved a C-index of 0.64 (95% CI: 0.55-0.73), while the DL-based signature achieved a C-index of 0.67 (95% CI: 0.57-0.77). Unlike the handcrafted signature, the DL-based signature successfully stratified testing patients into two prognostically distinct groups (p-value<0.01, HR=2.80, 95% CI: 1.26-6.24). The proposed 3D CNN generated accurate GBM tumor contours from four MR images. The DL-based signature resulted in better GBM survival prediction, in terms of higher C-index and significant patient stratification, than the handcrafted signature. The proposed automatic radiomic workflow demonstrated the potential of improving patient stratification and survival prediction in GBM patients.
△ Less
Submitted 29 January, 2020;
originally announced January 2020.
-
Generation of abdominal synthetic CTs from 0.35T MR images using generative adversarial networks for MR-only liver radiotherapy
Authors:
Jie Fu,
Kamal Singhrao,
Minsong Cao,
Victoria Yu,
Anand P. Santhanam,
Yingli Yang,
Minghao Guo,
Ann C. Raldow,
Dan Ruan,
John H. Lewis
Abstract:
Electron density maps must be accurately estimated to achieve valid dose calculation in MR-only radiotherapy. The goal of this study is to assess whether two deep learning models, the conditional generative adversarial network (cGAN) and the cycle-consistent generative adversarial network (cycleGAN), can generate accurate abdominal synthetic CT (sCT) images from 0.35T MR images for MR-only liver r…
▽ More
Electron density maps must be accurately estimated to achieve valid dose calculation in MR-only radiotherapy. The goal of this study is to assess whether two deep learning models, the conditional generative adversarial network (cGAN) and the cycle-consistent generative adversarial network (cycleGAN), can generate accurate abdominal synthetic CT (sCT) images from 0.35T MR images for MR-only liver radiotherapy. A retrospective study was performed using CT images and 0.35T MR images of 12 patients with liver (n=8) and non-liver abdominal (n=4) cancer. CT images were deformably registered to the corresponding MR images to generate deformed CT (dCT) images for treatment planning. Both cGAN and cycleGAN were trained using MR and dCT transverse slices. Four-fold cross-validation testing was conducted to generate sCT images for all patients. The HU prediction accuracy was evaluated by voxel-wise similarity metric between each dCT and sCT image for all 12 patients. dCT-based and sCT-based dose distributions were compared using gamma and dose-volume histogram (DVH) metric analysis for 8 liver patients. sCTcycleGAN achieved the average mean absolute error (MAE) of 94.1 HU, while sCTcGAN achieved 89.8 HU. In both models, the average gamma passing rates within all volumes of interest were higher than 95% using a 2%, 2 mm criterion, and 99% using a 3%, 3 mm criterion. The average differences in the mean dose and DVH metrics were within +/-0.6% for the planning target volume and within +/-0.15% for evaluated organs in both models. Results demonstrated that abdominal sCT images generated by both cGAN and cycleGAN achieved accurate dose calculation for 8 liver radiotherapy plans. sCTcGAN images had smaller average MAE and achieved better dose calculation accuracy than sCTcyleGAN images. More abdominal patients will be enrolled in the future to further evaluate two models.
△ Less
Submitted 13 August, 2019;
originally announced August 2019.
