-
Applications of interpretable deep learning in neuroimaging: a comprehensive review
Authors:
Lindsay Munroe,
Mariana da Silva,
Faezeh Heidari,
Irina Grigorescu,
Simon Dahan,
Emma C. Robinson,
Maria Deprez,
Po-Wah So
Abstract:
Clinical adoption of deep learning models has been hindered, in part, because the black-box nature of neural networks leads to concerns regarding their trustworthiness and reliability. These concerns are particularly relevant in the field of neuroimaging due to the complex brain phenotypes and inter-subject heterogeneity often encountered. The challenge can be addressed by interpretable deep learn…
▽ More
Clinical adoption of deep learning models has been hindered, in part, because the black-box nature of neural networks leads to concerns regarding their trustworthiness and reliability. These concerns are particularly relevant in the field of neuroimaging due to the complex brain phenotypes and inter-subject heterogeneity often encountered. The challenge can be addressed by interpretable deep learning (iDL) methods that enable the visualisation and interpretation of the inner workings of deep learning models. This study systematically reviewed the literature on neuroimaging applications of iDL methods and critically analysed how iDL explanation properties were evaluated. Seventy-five studies were included, and ten categories of iDL methods were identified. We also reviewed five properties of iDL explanations that were analysed in the included studies: biological validity, robustness, continuity, selectivity, and downstream task performance. We found that the most popular iDL approaches used in the literature may be sub-optimal for neuroimaging data, and we discussed possible future directions for the field.
△ Less
Submitted 30 May, 2024;
originally announced June 2024.
-
Multi-Center Fetal Brain Tissue Annotation (FeTA) Challenge 2022 Results
Authors:
Kelly Payette,
Céline Steger,
Roxane Licandro,
Priscille de Dumast,
Hongwei Bran Li,
Matthew Barkovich,
Liu Li,
Maik Dannecker,
Chen Chen,
Cheng Ouyang,
Niccolò McConnell,
Alina Miron,
Yongmin Li,
Alena Uus,
Irina Grigorescu,
Paula Ramirez Gilliland,
Md Mahfuzur Rahman Siddiquee,
Daguang Xu,
Andriy Myronenko,
Haoyu Wang,
Ziyan Huang,
** Ye,
Mireia Alenyà,
Valentin Comte,
Oscar Camara
, et al. (42 additional authors not shown)
Abstract:
Segmentation is a critical step in analyzing the develo** human fetal brain. There have been vast improvements in automatic segmentation methods in the past several years, and the Fetal Brain Tissue Annotation (FeTA) Challenge 2021 helped to establish an excellent standard of fetal brain segmentation. However, FeTA 2021 was a single center study, and the generalizability of algorithms across dif…
▽ More
Segmentation is a critical step in analyzing the develo** human fetal brain. There have been vast improvements in automatic segmentation methods in the past several years, and the Fetal Brain Tissue Annotation (FeTA) Challenge 2021 helped to establish an excellent standard of fetal brain segmentation. However, FeTA 2021 was a single center study, and the generalizability of algorithms across different imaging centers remains unsolved, limiting real-world clinical applicability. The multi-center FeTA Challenge 2022 focuses on advancing the generalizability of fetal brain segmentation algorithms for magnetic resonance imaging (MRI). In FeTA 2022, the training dataset contained images and corresponding manually annotated multi-class labels from two imaging centers, and the testing data contained images from these two imaging centers as well as two additional unseen centers. The data from different centers varied in many aspects, including scanners used, imaging parameters, and fetal brain super-resolution algorithms applied. 16 teams participated in the challenge, and 17 algorithms were evaluated. Here, a detailed overview and analysis of the challenge results are provided, focusing on the generalizability of the submissions. Both in- and out of domain, the white matter and ventricles were segmented with the highest accuracy, while the most challenging structure remains the cerebral cortex due to anatomical complexity. The FeTA Challenge 2022 was able to successfully evaluate and advance generalizability of multi-class fetal brain tissue segmentation algorithms for MRI and it continues to benchmark new algorithms. The resulting new methods contribute to improving the analysis of brain development in utero.
△ Less
Submitted 8 February, 2024;
originally announced February 2024.
-
Multi-task learning for joint weakly-supervised segmentation and aortic arch anomaly classification in fetal cardiac MRI
Authors:
Paula Ramirez,
Alena Uus,
Milou P. M. van Poppel,
Irina Grigorescu,
Johannes K. Steinweg,
David F. A. Lloyd,
Kuberan Pushparajah,
Andrew P. King,
Maria Deprez
Abstract:
Congenital Heart Disease (CHD) is a group of cardiac malformations present already during fetal life, representing the prevailing category of birth defects globally. Our aim in this study is to aid 3D fetal vessel topology visualisation in aortic arch anomalies, a group which encompasses a range of conditions with significant anatomical heterogeneity. We present a multi-task framework for automate…
▽ More
Congenital Heart Disease (CHD) is a group of cardiac malformations present already during fetal life, representing the prevailing category of birth defects globally. Our aim in this study is to aid 3D fetal vessel topology visualisation in aortic arch anomalies, a group which encompasses a range of conditions with significant anatomical heterogeneity. We present a multi-task framework for automated multi-class fetal vessel segmentation from 3D black blood T2w MRI and anomaly classification. Our training data consists of binary manual segmentation masks of the cardiac vessels' region in individual subjects and fully-labelled anomaly-specific population atlases. Our framework combines deep learning label propagation using VoxelMorph with 3D Attention U-Net segmentation and DenseNet121 anomaly classification. We target 11 cardiac vessels and three distinct aortic arch anomalies, including double aortic arch, right aortic arch, and suspected coarctation of the aorta. We incorporate an anomaly classifier into our segmentation pipeline, delivering a multi-task framework with the primary motivation of correcting topological inaccuracies of the segmentation. The hypothesis is that the multi-task approach will encourage the segmenter network to learn anomaly-specific features. As a secondary motivation, an automated diagnosis tool may have the potential to enhance diagnostic confidence in a decision support setting. Our results showcase that our proposed training strategy significantly outperforms label propagation and a network trained exclusively on propagated labels. Our classifier outperforms a classifier trained exclusively on T2w volume images, with an average balanced accuracy of 0.99 (0.01) after joint training. Adding a classifier improves the anatomical and topological accuracy of all correctly classified double aortic arch subjects.
△ Less
Submitted 13 November, 2023;
originally announced November 2023.
-
Automatic Myocardial Disease Prediction From Delayed-Enhancement Cardiac MRI and Clinical Information
Authors:
Ana Lourenço,
Eric Kerfoot,
Irina Grigorescu,
Cian M Scannell,
Marta Varela,
Teresa M Correia
Abstract:
Delayed-enhancement cardiac magnetic resonance (DE-CMR)provides important diagnostic and prognostic information on myocardial viability. The presence and extent of late gadolinium enhancement (LGE)in DE-CMR is negatively associated with the probability of improvement in left ventricular function after revascularization. Moreover, LGE findings can support the diagnosis of several other cardiomyopat…
▽ More
Delayed-enhancement cardiac magnetic resonance (DE-CMR)provides important diagnostic and prognostic information on myocardial viability. The presence and extent of late gadolinium enhancement (LGE)in DE-CMR is negatively associated with the probability of improvement in left ventricular function after revascularization. Moreover, LGE findings can support the diagnosis of several other cardiomyopathies, but their absence does not rule them out, making disease classification by visual assessment difficult. In this work, we propose deep learning neural networks that can automatically predict myocardial disease from patient clinical information and DE-CMR. All the proposed networks achieve very good classification accuracy (>85%). Including information from DE-CMR (directly as images or as metadata following DE-CMR segmentation) is valuable in this classification task, improving the accuracy to 95-100%.
△ Less
Submitted 16 October, 2020;
originally announced October 2020.
-
Diffusion tensor driven image registration: a deep learning approach
Authors:
Irina Grigorescu,
Alena Uus,
Daan Christiaens,
Lucilio Cordero-Grande,
Jana Hutter,
A. David Edwards,
Joseph V. Hajnal,
Marc Modat,
Maria Deprez
Abstract:
Tracking microsctructural changes in the develo** brain relies on accurate inter-subject image registration. However, most methods rely on either structural or diffusion data to learn the spatial correspondences between two or more images, without taking into account the complementary information provided by using both. Here we propose a deep learning registration framework which combines the st…
▽ More
Tracking microsctructural changes in the develo** brain relies on accurate inter-subject image registration. However, most methods rely on either structural or diffusion data to learn the spatial correspondences between two or more images, without taking into account the complementary information provided by using both. Here we propose a deep learning registration framework which combines the structural information provided by T2-weighted (T2w) images with the rich microstructural information offered by diffusion tensor imaging (DTI) scans. We perform a leave-one-out cross-validation study where we compare the performance of our multi-modality registration model with a baseline model trained on structural data only, in terms of Dice scores and differences in fractional anisotropy (FA) maps. Our results show that in terms of average Dice scores our model performs better in subcortical regions when compared to using structural data only. Moreover, average sum-of-squared differences between warped and fixed FA maps show that our proposed model performs better at aligning the diffusion data.
△ Less
Submitted 14 May, 2020;
originally announced May 2020.
-
Interpretable Convolutional Neural Networks for Preterm Birth Classification
Authors:
Irina Grigorescu,
Lucilio Cordero-Grande,
A David Edwards,
Jo Hajnal,
Marc Modat,
Maria Deprez
Abstract:
The use of convolutional neural networks (CNNs) for classification tasks has become dominant in various medical imaging applications. At the same time, recent advances in interpretable machine learning techniques have shown great potential in explaining classifiers' decisions. Layer-wise relevance propagation (LRP) has been introduced as one of these novel methods that aim to provide visual interp…
▽ More
The use of convolutional neural networks (CNNs) for classification tasks has become dominant in various medical imaging applications. At the same time, recent advances in interpretable machine learning techniques have shown great potential in explaining classifiers' decisions. Layer-wise relevance propagation (LRP) has been introduced as one of these novel methods that aim to provide visual interpretation for the network's decisions. In this work we propose the application of 3D CNNs with LRP for the first time for neonatal T2-weighted magnetic resonance imaging (MRI) data analysis. Through LRP, the decisions of our trained classifier are transformed into heatmaps indicating each voxel's relevance for the outcome of the decision. Our resulting LRP heatmaps reveal anatomically plausible features in distinguishing preterm neonates from term ones.
△ Less
Submitted 30 September, 2019;
originally announced October 2019.
