-
Spatio-temporal motion correction and iterative reconstruction of in-utero fetal fMRI
Authors:
Athena Taymourtash,
Hamza Kebiri,
Ernst Schwartz,
Karl-Heinz Nenning,
Sebastien Tourbier,
Gregor Kasprian,
Daniela Prayer,
Meritxell Bach Cuadra,
Georg Langs
Abstract:
Resting-state functional Magnetic Resonance Imaging (fMRI) is a powerful imaging technique for studying functional development of the brain in utero. However, unpredictable and excessive movement of fetuses have limited its clinical applicability. Previous studies have focused primarily on the accurate estimation of the motion parameters employing a single step 3D interpolation at each individual…
▽ More
Resting-state functional Magnetic Resonance Imaging (fMRI) is a powerful imaging technique for studying functional development of the brain in utero. However, unpredictable and excessive movement of fetuses have limited its clinical applicability. Previous studies have focused primarily on the accurate estimation of the motion parameters employing a single step 3D interpolation at each individual time frame to recover a motion-free 4D fMRI image. Using only information from a 3D spatial neighborhood neglects the temporal structure of fMRI and useful information from neighboring timepoints. Here, we propose a novel technique based on four dimensional iterative reconstruction of the motion scattered fMRI slices. Quantitative evaluation of the proposed method on a cohort of real clinical fetal fMRI data indicates improvement of reconstruction quality compared to the conventional 3D interpolation approaches.
△ Less
Submitted 17 September, 2022;
originally announced September 2022.
-
A Dempster-Shafer approach to trustworthy AI with application to fetal brain MRI segmentation
Authors:
Lucas Fidon,
Michael Aertsen,
Florian Kofler,
Andrea Bink,
Anna L. David,
Thomas Deprest,
Doaa Emam,
Frédéric Guffens,
András Jakab,
Gregor Kasprian,
Patric Kienast,
Andrew Melbourne,
Bjoern Menze,
Nada Mufti,
Ivana Pogledic,
Daniela Prayer,
Marlene Stuempflen,
Esther Van Elslander,
Sébastien Ourselin,
Jan Deprest,
Tom Vercauteren
Abstract:
Deep learning models for medical image segmentation can fail unexpectedly and spectacularly for pathological cases and images acquired at different centers than training images, with labeling errors that violate expert knowledge. Such errors undermine the trustworthiness of deep learning models for medical image segmentation. Mechanisms for detecting and correcting such failures are essential for…
▽ More
Deep learning models for medical image segmentation can fail unexpectedly and spectacularly for pathological cases and images acquired at different centers than training images, with labeling errors that violate expert knowledge. Such errors undermine the trustworthiness of deep learning models for medical image segmentation. Mechanisms for detecting and correcting such failures are essential for safely translating this technology into clinics and are likely to be a requirement of future regulations on artificial intelligence (AI). In this work, we propose a trustworthy AI theoretical framework and a practical system that can augment any backbone AI system using a fallback method and a fail-safe mechanism based on Dempster-Shafer theory. Our approach relies on an actionable definition of trustworthy AI. Our method automatically discards the voxel-level labeling predicted by the backbone AI that violate expert knowledge and relies on a fallback for those voxels. We demonstrate the effectiveness of the proposed trustworthy AI approach on the largest reported annotated dataset of fetal MRI consisting of 540 manually annotated fetal brain 3D T2w MRIs from 13 centers. Our trustworthy AI method improves the robustness of a state-of-the-art backbone AI for fetal brain MRIs acquired across various centers and for fetuses with various brain abnormalities.
△ Less
Submitted 17 January, 2024; v1 submitted 5 April, 2022;
originally announced April 2022.
-
Distributionally Robust Segmentation of Abnormal Fetal Brain 3D MRI
Authors:
Lucas Fidon,
Michael Aertsen,
Nada Mufti,
Thomas Deprest,
Doaa Emam,
Frédéric Guffens,
Ernst Schwartz,
Michael Ebner,
Daniela Prayer,
Gregor Kasprian,
Anna L. David,
Andrew Melbourne,
Sébastien Ourselin,
Jan Deprest,
Georg Langs,
Tom Vercauteren
Abstract:
The performance of deep neural networks typically increases with the number of training images. However, not all images have the same importance towards improved performance and robustness. In fetal brain MRI, abnormalities exacerbate the variability of the develo** brain anatomy compared to non-pathological cases. A small number of abnormal cases, as is typically available in clinical datasets…
▽ More
The performance of deep neural networks typically increases with the number of training images. However, not all images have the same importance towards improved performance and robustness. In fetal brain MRI, abnormalities exacerbate the variability of the develo** brain anatomy compared to non-pathological cases. A small number of abnormal cases, as is typically available in clinical datasets used for training, are unlikely to fairly represent the rich variability of abnormal develo** brains. This leads machine learning systems trained by maximizing the average performance to be biased toward non-pathological cases. This problem was recently referred to as hidden stratification. To be suited for clinical use, automatic segmentation methods need to reliably achieve high-quality segmentation outcomes also for pathological cases. In this paper, we show that the state-of-the-art deep learning pipeline nnU-Net has difficulties to generalize to unseen abnormal cases. To mitigate this problem, we propose to train a deep neural network to minimize a percentile of the distribution of per-volume loss over the dataset. We show that this can be achieved by using Distributionally Robust Optimization (DRO). DRO automatically reweights the training samples with lower performance, encouraging nnU-Net to perform more consistently on all cases. We validated our approach using a dataset of 368 fetal brain T2w MRIs, including 124 MRIs of open spina bifida cases and 51 MRIs of cases with other severe abnormalities of brain development.
△ Less
Submitted 9 August, 2021;
originally announced August 2021.
