-
MProtoNet: A Case-Based Interpretable Model for Brain Tumor Classification with 3D Multi-parametric Magnetic Resonance Imaging
Authors:
Yuanyuan Wei,
Roger Tam,
Xiaoying Tang
Abstract:
Recent applications of deep convolutional neural networks in medical imaging raise concerns about their interpretability. While most explainable deep learning applications use post hoc methods (such as GradCAM) to generate feature attribution maps, there is a new type of case-based reasoning models, namely ProtoPNet and its variants, which identify prototypes during training and compare input imag…
▽ More
Recent applications of deep convolutional neural networks in medical imaging raise concerns about their interpretability. While most explainable deep learning applications use post hoc methods (such as GradCAM) to generate feature attribution maps, there is a new type of case-based reasoning models, namely ProtoPNet and its variants, which identify prototypes during training and compare input image patches with those prototypes. We propose the first medical prototype network (MProtoNet) to extend ProtoPNet to brain tumor classification with 3D multi-parametric magnetic resonance imaging (mpMRI) data. To address different requirements between 2D natural images and 3D mpMRIs especially in terms of localizing attention regions, a new attention module with soft masking and online-CAM loss is introduced. Soft masking helps sharpen attention maps, while online-CAM loss directly utilizes image-level labels when training the attention module. MProtoNet achieves statistically significant improvements in interpretability metrics of both correctness and localization coherence (with a best activation precision of $0.713\pm0.058$) without human-annotated labels during training, when compared with GradCAM and several ProtoPNet variants. The source code is available at https://github.com/aywi/mprotonet.
△ Less
Submitted 14 April, 2023; v1 submitted 13 April, 2023;
originally announced April 2023.
-
Identifying the key components in ResNet-50 for diabetic retinopathy grading from fundus images: a systematic investigation
Authors:
Yi** Huang,
Li Lin,
Pu** Cheng,
Junyan Lyu,
Roger Tam,
Xiaoying Tang
Abstract:
Although deep learning based diabetic retinopathy (DR) classification methods typically benefit from well-designed architectures of convolutional neural networks, the training setting also has a non-negligible impact on the prediction performance. The training setting includes various interdependent components, such as objective function, data sampling strategy and data augmentation approach. To i…
▽ More
Although deep learning based diabetic retinopathy (DR) classification methods typically benefit from well-designed architectures of convolutional neural networks, the training setting also has a non-negligible impact on the prediction performance. The training setting includes various interdependent components, such as objective function, data sampling strategy and data augmentation approach. To identify the key components in a standard deep learning framework (ResNet-50) for DR grading, we systematically analyze the impact of several major components. Extensive experiments are conducted on a publicly-available dataset EyePACS. We demonstrate that (1) the DR grading framework is sensitive to input resolution, objective function, and composition of data augmentation, (2) using mean square error as the loss function can effectively improve the performance with respect to a task-specific evaluation metric, namely the quadratically-weighted Kappa, (3) utilizing eye pairs boosts the performance of DR grading and (4) using data resampling to address the problem of imbalanced data distribution in EyePACS hurts the performance. Based on these observations and an optimal combination of the investigated components, our framework, without any specialized network design, achieves the state-of-the-art result (0.8631 for Kappa) on the EyePACS test set (a total of 42670 fundus images) with only image-level labels. We also examine the proposed training practices on other fundus datasets and other network architectures to evaluate their generalizability. Our codes and pre-trained model are available at https://github.com/Yi**Huang/pytorch-classification.
△ Less
Submitted 17 October, 2022; v1 submitted 27 October, 2021;
originally announced October 2021.
-
Introduction to a novel T2 relaxation analysis method SAME-ECOS: Spectrum Analysis for Multiple Exponentials via Experimental Condition Oriented Simulation
Authors:
Hanwen Liu,
Qing-San Xiang,
Roger Tam,
Piotr Kozlowski,
David K. B. Li,
Alex L. Mackay,
John K. Kramer,
Cornelia Laule
Abstract:
We propose a novel T2 relaxation data analysis method which we have named spectrum analysis for multiple exponentials via experimental condition oriented simulation (SAME-ECOS). SAME-ECOS, which was developed based on a combination of information theory and machine learning neural network algorithms, is tailored for different MR experimental conditions, decomposing multi-exponential decay data int…
▽ More
We propose a novel T2 relaxation data analysis method which we have named spectrum analysis for multiple exponentials via experimental condition oriented simulation (SAME-ECOS). SAME-ECOS, which was developed based on a combination of information theory and machine learning neural network algorithms, is tailored for different MR experimental conditions, decomposing multi-exponential decay data into T2 spectra, which had been considered an ill-posed problem using conventional fitting algorithms, including the commonly used non-negative least squares (NNLS) method. Our results demonstrated that, compared with NNLS, the simulation-derived SAME-ECOS model yields much more reliable T2 spectra in a dramatically shorter time, increasing the feasibility of multi-component T2 decay analysis in clinical settings.
△ Less
Submitted 14 September, 2020;
originally announced September 2020.
-
Scanner Invariant Multiple Sclerosis Lesion Segmentation from MRI
Authors:
Shahab Aslani,
Vittorio Murino,
Michael Dayan,
Roger Tam,
Diego Sona,
Ghassan Hamarneh
Abstract:
This paper presents a simple and effective generalization method for magnetic resonance imaging (MRI) segmentation when data is collected from multiple MRI scanning sites and as a consequence is affected by (site-)domain shifts. We propose to integrate a traditional encoder-decoder network with a regularization network. This added network includes an auxiliary loss term which is responsible for th…
▽ More
This paper presents a simple and effective generalization method for magnetic resonance imaging (MRI) segmentation when data is collected from multiple MRI scanning sites and as a consequence is affected by (site-)domain shifts. We propose to integrate a traditional encoder-decoder network with a regularization network. This added network includes an auxiliary loss term which is responsible for the reduction of the domain shift problem and for the resulting improved generalization. The proposed method was evaluated on multiple sclerosis lesion segmentation from MRI data. We tested the proposed model on an in-house clinical dataset including 117 patients from 56 different scanning sites. In the experiments, our method showed better generalization performance than other baseline networks.
△ Less
Submitted 22 October, 2019;
originally announced October 2019.
