-
Multi-Center Fetal Brain Tissue Annotation (FeTA) Challenge 2022 Results
Authors:
Kelly Payette,
Céline Steger,
Roxane Licandro,
Priscille de Dumast,
Hongwei Bran Li,
Matthew Barkovich,
Liu Li,
Maik Dannecker,
Chen Chen,
Cheng Ouyang,
Niccolò McConnell,
Alina Miron,
Yongmin Li,
Alena Uus,
Irina Grigorescu,
Paula Ramirez Gilliland,
Md Mahfuzur Rahman Siddiquee,
Daguang Xu,
Andriy Myronenko,
Haoyu Wang,
Ziyan Huang,
** Ye,
Mireia Alenyà,
Valentin Comte,
Oscar Camara
, et al. (42 additional authors not shown)
Abstract:
Segmentation is a critical step in analyzing the develo** human fetal brain. There have been vast improvements in automatic segmentation methods in the past several years, and the Fetal Brain Tissue Annotation (FeTA) Challenge 2021 helped to establish an excellent standard of fetal brain segmentation. However, FeTA 2021 was a single center study, and the generalizability of algorithms across dif…
▽ More
Segmentation is a critical step in analyzing the develo** human fetal brain. There have been vast improvements in automatic segmentation methods in the past several years, and the Fetal Brain Tissue Annotation (FeTA) Challenge 2021 helped to establish an excellent standard of fetal brain segmentation. However, FeTA 2021 was a single center study, and the generalizability of algorithms across different imaging centers remains unsolved, limiting real-world clinical applicability. The multi-center FeTA Challenge 2022 focuses on advancing the generalizability of fetal brain segmentation algorithms for magnetic resonance imaging (MRI). In FeTA 2022, the training dataset contained images and corresponding manually annotated multi-class labels from two imaging centers, and the testing data contained images from these two imaging centers as well as two additional unseen centers. The data from different centers varied in many aspects, including scanners used, imaging parameters, and fetal brain super-resolution algorithms applied. 16 teams participated in the challenge, and 17 algorithms were evaluated. Here, a detailed overview and analysis of the challenge results are provided, focusing on the generalizability of the submissions. Both in- and out of domain, the white matter and ventricles were segmented with the highest accuracy, while the most challenging structure remains the cerebral cortex due to anatomical complexity. The FeTA Challenge 2022 was able to successfully evaluate and advance generalizability of multi-class fetal brain tissue segmentation algorithms for MRI and it continues to benchmark new algorithms. The resulting new methods contribute to improving the analysis of brain development in utero.
△ Less
Submitted 8 February, 2024;
originally announced February 2024.
-
An automated pipeline for quantitative T2* fetal body MRI and segmentation at low field
Authors:
Kelly Payette,
Alena Uus,
Jordina Aviles Verdera,
Carla Avena Zampieri,
Megan Hall,
Lisa Story,
Maria Deprez,
Mary A. Rutherford,
Joseph V. Hajnal,
Sebastien Ourselin,
Raphael Tomi-Tricot,
Jana Hutter
Abstract:
Fetal Magnetic Resonance Imaging at low field strengths is emerging as an exciting direction in perinatal health. Clinical low field (0.55T) scanners are beneficial for fetal imaging due to their reduced susceptibility-induced artefacts, increased T2* values, and wider bore (widening access for the increasingly obese pregnant population). However, the lack of standard automated image processing to…
▽ More
Fetal Magnetic Resonance Imaging at low field strengths is emerging as an exciting direction in perinatal health. Clinical low field (0.55T) scanners are beneficial for fetal imaging due to their reduced susceptibility-induced artefacts, increased T2* values, and wider bore (widening access for the increasingly obese pregnant population). However, the lack of standard automated image processing tools such as segmentation and reconstruction hampers wider clinical use. In this study, we introduce a semi-automatic pipeline using quantitative MRI for the fetal body at low field strength resulting in fast and detailed quantitative T2* relaxometry analysis of all major fetal body organs. Multi-echo dynamic sequences of the fetal body were acquired and reconstructed into a single high-resolution volume using deformable slice-to-volume reconstruction, generating both structural and quantitative T2* 3D volumes. A neural network trained using a semi-supervised approach was created to automatically segment these fetal body 3D volumes into ten different organs (resulting in dice values > 0.74 for 8 out of 10 organs). The T2* values revealed a strong relationship with GA in the lungs, liver, and kidney parenchyma (R^2>0.5). This pipeline was used successfully for a wide range of GAs (17-40 weeks), and is robust to motion artefacts. Low field fetal MRI can be used to perform advanced MRI analysis, and is a viable option for clinical scanning.
△ Less
Submitted 9 August, 2023;
originally announced August 2023.
-
Synthesis of realistic fetal MRI with conditional Generative Adversarial Networks
Authors:
Marina Fernandez Garcia,
Rodrigo Gonzalez Laiz,
Hui Ji,
Kelly Payette,
Andras Jakab
Abstract:
Fetal brain magnetic resonance imaging serves as an emerging modality for prenatal counseling and diagnosis in disorders affecting the brain. Machine learning based segmentation plays an important role in the quantification of brain development. However, a limiting factor is the lack of sufficiently large, labeled training data. Our study explored the application of SPADE, a conditional general ad…
▽ More
Fetal brain magnetic resonance imaging serves as an emerging modality for prenatal counseling and diagnosis in disorders affecting the brain. Machine learning based segmentation plays an important role in the quantification of brain development. However, a limiting factor is the lack of sufficiently large, labeled training data. Our study explored the application of SPADE, a conditional general adversarial network (cGAN), which learns the map** from the label to the image space. The input to the network was super-resolution T2-weighted cerebral MRI data of 120 fetuses (gestational age range: 20-35 weeks, normal and pathological), which were annotated for 7 different tissue categories. SPADE networks were trained on 256*256 2D slices of the reconstructed volumes (image and label pairs) in each orthogonal orientation. To combine the generated volumes from each orientation into one image, a simple mean of the outputs of the three networks was taken. Based on the label maps only, we synthesized highly realistic images. However, some finer details, like small vessels were not synthesized. A structural similarity index (SSIM) of 0.972+-0.016 and correlation coefficient of 0.974+-0.008 were achieved. To demonstrate the capacity of the cGAN to create new anatomical variants, we artificially dilated the ventricles in the segmentation map and created synthetic MRI of different degrees of fetal hydrocephalus. cGANs, such as the SPADE algorithm, allow the generation of hypothetically unseen scenarios and anatomical configurations in the label space, which data in turn can be utilized for training various machine learning algorithms. In the future, this algorithm would be used for generating large, synthetic datasets representing fetal brain development. These datasets would potentially improve the performance of currently available segmentation networks.
△ Less
Submitted 20 September, 2022;
originally announced September 2022.
-
Fetal Brain Tissue Annotation and Segmentation Challenge Results
Authors:
Kelly Payette,
Hongwei Li,
Priscille de Dumast,
Roxane Licandro,
Hui Ji,
Md Mahfuzur Rahman Siddiquee,
Daguang Xu,
Andriy Myronenko,
Hao Liu,
Yuchen Pei,
Lisheng Wang,
Ying Peng,
Juanying Xie,
Huiquan Zhang,
Guiming Dong,
Hao Fu,
Guotai Wang,
ZunHyan Rieu,
Donghyeon Kim,
Hyun Gi Kim,
Davood Karimi,
Ali Gholipour,
Helena R. Torres,
Bruno Oliveira,
João L. Vilaça
, et al. (33 additional authors not shown)
Abstract:
In-utero fetal MRI is emerging as an important tool in the diagnosis and analysis of the develo** human brain. Automatic segmentation of the develo** fetal brain is a vital step in the quantitative analysis of prenatal neurodevelopment both in the research and clinical context. However, manual segmentation of cerebral structures is time-consuming and prone to error and inter-observer variabili…
▽ More
In-utero fetal MRI is emerging as an important tool in the diagnosis and analysis of the develo** human brain. Automatic segmentation of the develo** fetal brain is a vital step in the quantitative analysis of prenatal neurodevelopment both in the research and clinical context. However, manual segmentation of cerebral structures is time-consuming and prone to error and inter-observer variability. Therefore, we organized the Fetal Tissue Annotation (FeTA) Challenge in 2021 in order to encourage the development of automatic segmentation algorithms on an international level. The challenge utilized FeTA Dataset, an open dataset of fetal brain MRI reconstructions segmented into seven different tissues (external cerebrospinal fluid, grey matter, white matter, ventricles, cerebellum, brainstem, deep grey matter). 20 international teams participated in this challenge, submitting a total of 21 algorithms for evaluation. In this paper, we provide a detailed analysis of the results from both a technical and clinical perspective. All participants relied on deep learning methods, mainly U-Nets, with some variability present in the network architecture, optimization, and image pre- and post-processing. The majority of teams used existing medical imaging deep learning frameworks. The main differences between the submissions were the fine tuning done during training, and the specific pre- and post-processing steps performed. The challenge results showed that almost all submissions performed similarly. Four of the top five teams used ensemble learning methods. However, one team's algorithm performed significantly superior to the other submissions, and consisted of an asymmetrical U-Net network architecture. This paper provides a first of its kind benchmark for future automatic multi-tissue segmentation algorithms for the develo** human brain in utero.
△ Less
Submitted 20 April, 2022;
originally announced April 2022.
-
Synthetic magnetic resonance images for domain adaptation: Application to fetal brain tissue segmentation
Authors:
Priscille de Dumast,
Hamza Kebiri,
Kelly Payette,
Andras Jakab,
Hélène Lajous,
Meritxell Bach Cuadra
Abstract:
The quantitative assessment of the develo** human brain in utero is crucial to fully understand neurodevelopment. Thus, automated multi-tissue fetal brain segmentation algorithms are being developed, which in turn require annotated data to be trained. However, the available annotated fetal brain datasets are limited in number and heterogeneity, hampering domain adaptation strategies for robust s…
▽ More
The quantitative assessment of the develo** human brain in utero is crucial to fully understand neurodevelopment. Thus, automated multi-tissue fetal brain segmentation algorithms are being developed, which in turn require annotated data to be trained. However, the available annotated fetal brain datasets are limited in number and heterogeneity, hampering domain adaptation strategies for robust segmentation. In this context, we use FaBiAN, a Fetal Brain magnetic resonance Acquisition Numerical phantom, to simulate various realistic magnetic resonance images of the fetal brain along with its class labels. We demonstrate that these multiple synthetic annotated data, generated at no cost and further reconstructed using the target super-resolution technique, can be successfully used for domain adaptation of a deep learning method that segments seven brain tissues. Overall, the accuracy of the segmentation is significantly enhanced, especially in the cortical gray matter, the white matter, the cerebellum, the deep gray matter and the brain stem.
△ Less
Submitted 8 November, 2021;
originally announced November 2021.
-
FaBiAN: A Fetal Brain magnetic resonance Acquisition Numerical phantom
Authors:
Hélène Lajous,
Christopher W. Roy,
Tom Hilbert,
Priscille de Dumast,
Sébastien Tourbier,
Yasser Alemán-Gómez,
Jérôme Yerly,
Thomas Yu,
Hamza Kebiri,
Kelly Payette,
Jean-Baptiste Ledoux,
Reto Meuli,
Patric Hagmann,
Andras Jakab,
Vincent Dunet,
Mériam Koob,
Tobias Kober,
Matthias Stuber,
Meritxell Bach Cuadra
Abstract:
Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. Magnetic resonance imaging is a powerful tool to investigate equivocal neurological patterns during fetal development. However, the number of acquisitions of satisfactory quality available in this cohort of s…
▽ More
Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. Magnetic resonance imaging is a powerful tool to investigate equivocal neurological patterns during fetal development. However, the number of acquisitions of satisfactory quality available in this cohort of sensitive subjects remains scarce, thus hindering the validation of advanced image processing techniques. Numerical phantoms can mitigate these limitations by providing a controlled environment with a known ground truth. In this work, we present FaBiAN, an open-source Fetal Brain magnetic resonance Acquisition Numerical phantom that simulates clinical T2-weighted fast spin echo sequences of the fetal brain. This unique tool is based on a general, flexible and realistic setup that includes stochastic fetal movements, thus providing images of the fetal brain throughout maturation comparable to clinical acquisitions. We demonstrate its value to evaluate the robustness and optimize the accuracy of an algorithm for super-resolution fetal brain magnetic resonance imaging from simulated motion-corrupted 2D low-resolution series as compared to a synthetic high-resolution reference volume. We also show that the images generated can complement clinical datasets to support data-intensive deep learning methods for fetal brain tissue segmentation.
△ Less
Submitted 6 September, 2021;
originally announced September 2021.
-
An automatic multi-tissue human fetal brain segmentation benchmark using the Fetal Tissue Annotation Dataset
Authors:
Kelly Payette,
Priscille de Dumast,
Hamza Kebiri,
Ivan Ezhov,
Johannes C. Paetzold,
Suprosanna Shit,
Asim Iqbal,
Romesa Khan,
Raimund Kottke,
Patrice Grehten,
Hui Ji,
Levente Lanczi,
Marianna Nagy,
Monika Beresova,
Thi Dao Nguyen,
Giancarlo Natalucci,
Theofanis Karayannis,
Bjoern Menze,
Meritxell Bach Cuadra,
Andras Jakab
Abstract:
It is critical to quantitatively analyse the develo** human fetal brain in order to fully understand neurodevelopment in both normal fetuses and those with congenital disorders. To facilitate this analysis, automatic multi-tissue fetal brain segmentation algorithms are needed, which in turn requires open databases of segmented fetal brains. Here we introduce a publicly available database of 50 m…
▽ More
It is critical to quantitatively analyse the develo** human fetal brain in order to fully understand neurodevelopment in both normal fetuses and those with congenital disorders. To facilitate this analysis, automatic multi-tissue fetal brain segmentation algorithms are needed, which in turn requires open databases of segmented fetal brains. Here we introduce a publicly available database of 50 manually segmented pathological and non-pathological fetal magnetic resonance brain volume reconstructions across a range of gestational ages (20 to 33 weeks) into 7 different tissue categories (external cerebrospinal fluid, grey matter, white matter, ventricles, cerebellum, deep grey matter, brainstem/spinal cord). In addition, we quantitatively evaluate the accuracy of several automatic multi-tissue segmentation algorithms of the develo** human fetal brain. Four research groups participated, submitting a total of 10 algorithms, demonstrating the benefits the database for the development of automatic algorithms.
△ Less
Submitted 7 July, 2021; v1 submitted 29 October, 2020;
originally announced October 2020.
-
Efficient multi-class fetal brain segmentation in high resolution MRI reconstructions with noisy labels
Authors:
Kelly Payette,
Raimund Kottke,
Andras Jakab
Abstract:
Segmentation of the develo** fetal brain is an important step in quantitative analyses. However, manual segmentation is a very time-consuming task which is prone to error and must be completed by highly specialized indi-viduals. Super-resolution reconstruction of fetal MRI has become standard for processing such data as it improves image quality and resolution. However, dif-ferent pipelines resu…
▽ More
Segmentation of the develo** fetal brain is an important step in quantitative analyses. However, manual segmentation is a very time-consuming task which is prone to error and must be completed by highly specialized indi-viduals. Super-resolution reconstruction of fetal MRI has become standard for processing such data as it improves image quality and resolution. However, dif-ferent pipelines result in slightly different outputs, further complicating the gen-eralization of segmentation methods aiming to segment super-resolution data. Therefore, we propose using transfer learning with noisy multi-class labels to automatically segment high resolution fetal brain MRIs using a single set of seg-mentations created with one reconstruction method and tested for generalizability across other reconstruction methods. Our results show that the network can auto-matically segment fetal brain reconstructions into 7 different tissue types, regard-less of reconstruction method used. Transfer learning offers some advantages when compared to training without pre-initialized weights, but the network trained on clean labels had more accurate segmentations overall. No additional manual segmentations were required. Therefore, the proposed network has the potential to eliminate the need for manual segmentations needed in quantitative analyses of the fetal brain independent of reconstruction method used, offering an unbiased way to quantify normal and pathological neurodevelopment.
△ Less
Submitted 14 September, 2020;
originally announced September 2020.
-
Longitudinal analysis of fetal MRI in patients with prenatal spina bifida repair
Authors:
Kelly Payette,
Ueli Moehrlen,
Luca Mazzone,
Nicole Ochsenbein-Koelble,
Ruth Tuura,
Raimund Kottke,
Martin Meuli,
Andras Jakab
Abstract:
Open spina bifida (SB) is one of the most common congenital defects and can lead to impaired brain development. Emerging fetal surgery methods have shown considerable success in the treatment of patients with this severe anomaly. Afterwards, alterations in the brain development of these fetuses have been observed. Currently no longitudinal studies exist to show the effect of fetal surgery on brain…
▽ More
Open spina bifida (SB) is one of the most common congenital defects and can lead to impaired brain development. Emerging fetal surgery methods have shown considerable success in the treatment of patients with this severe anomaly. Afterwards, alterations in the brain development of these fetuses have been observed. Currently no longitudinal studies exist to show the effect of fetal surgery on brain development. In this work, we present a fetal MRI neuro-imaging analysis pipeline for fetuses with SB, including automated fetal ventricle segmentation and deformation-based morphometry, and demonstrate its applicability with an analysis of ventricle enlargement in fetuses with SB. Using a robust super-resolution algorithm, we reconstructed fetal brains at both pre-operative and post-operative time points and trained a U-Net CNN in order to automatically segment the ventricles. We investigated the change of ventricle shape post-operatively, and the impacts of lesion size, type, and GA at operation on the change in ventricle shape. No impact was found, except for moderately larger ventriculomegaly progression in myeloschisis patients. Prenatal ventricle volume growth was also investigated. Our method allows for the quantification of longitudinal morphological changes to fully quantify the impact of prenatal SB repair and could be applied to predict postnatal outcomes.
△ Less
Submitted 15 November, 2019;
originally announced November 2019.
