TotalSegmentator MRI: Sequence-Independent Segmentation of 59 Anatomical Structures in MR images
Authors:
Tugba Akinci D'Antonoli,
Lucas K. Berger,
Ashraya K. Indrakanti,
Nathan Vishwanathan,
Jakob Weiß,
Matthias Jung,
Zeynep Berkarda,
Alexander Rau,
Marco Reisert,
Thomas Küstner,
Alexandra Walter,
Elmar M. Merkle,
Martin Segeroth,
Joshy Cyriac,
Shan Yang,
Jakob Wasserthal
Abstract:
Purpose: To develop an open-source and easy-to-use segmentation model that can automatically and robustly segment most major anatomical structures in MR images independently of the MR sequence.
Materials and Methods: In this study we extended the capabilities of TotalSegmentator to MR images. 298 MR scans and 227 CT scans were used to segment 59 anatomical structures (20 organs, 18 bones, 11 mus…
▽ More
Purpose: To develop an open-source and easy-to-use segmentation model that can automatically and robustly segment most major anatomical structures in MR images independently of the MR sequence.
Materials and Methods: In this study we extended the capabilities of TotalSegmentator to MR images. 298 MR scans and 227 CT scans were used to segment 59 anatomical structures (20 organs, 18 bones, 11 muscles, 7 vessels, 3 tissue types) relevant for use cases such as organ volumetry, disease characterization, and surgical planning. The MR and CT images were randomly sampled from routine clinical studies and thus represent a real-world dataset (different ages, pathologies, scanners, body parts, sequences, contrasts, echo times, repetition times, field strengths, slice thicknesses and sites). We trained an nnU-Net segmentation algorithm on this dataset and calculated Dice similarity coefficients (Dice) to evaluate the model's performance.
Results: The model showed a Dice score of 0.824 (CI: 0.801, 0.842) on the test set, which included a wide range of clinical data with major pathologies. The model significantly outperformed two other publicly available segmentation models (Dice score, 0.824 versus 0.762; p<0.001 and 0.762 versus 0.542; p<0.001). On the CT image test set of the original TotalSegmentator paper it almost matches the performance of the original TotalSegmentator (Dice score, 0.960 versus 0.970; p<0.001).
Conclusion: Our proposed model extends the capabilities of TotalSegmentator to MR images. The annotated dataset (https://zenodo.org/doi/10.5281/zenodo.11367004) and open-source toolkit (https://www.github.com/wasserth/TotalSegmentator) are publicly available.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
Predicting brain-age from raw T 1 -weighted Magnetic Resonance Imaging data using 3D Convolutional Neural Networks
Authors:
Lukas Fisch,
Jan Ernsting,
Nils R. Winter,
Vincent Holstein,
Ramona Leenings,
Marie Beisemann,
Kelvin Sarink,
Daniel Emden,
Nils Opel,
Ronny Redlich,
Jonathan Repple,
Dominik Grotegerd,
Susanne Meinert,
Niklas Wulms,
Heike Minnerup,
Jochen G. Hirsch,
Thoralf Niendorf,
Beate Endemann,
Fabian Bamberg,
Thomas Kröncke,
Annette Peters,
Robin Bülow,
Henry Völzke,
Oyunbileg von Stackelberg,
Ramona Felizitas Sowade
, et al. (11 additional authors not shown)
Abstract:
Age prediction based on Magnetic Resonance Imaging (MRI) data of the brain is a biomarker to quantify the progress of brain diseases and aging. Current approaches rely on preparing the data with multiple preprocessing steps, such as registering voxels to a standardized brain atlas, which yields a significant computational overhead, hampers widespread usage and results in the predicted brain-age to…
▽ More
Age prediction based on Magnetic Resonance Imaging (MRI) data of the brain is a biomarker to quantify the progress of brain diseases and aging. Current approaches rely on preparing the data with multiple preprocessing steps, such as registering voxels to a standardized brain atlas, which yields a significant computational overhead, hampers widespread usage and results in the predicted brain-age to be sensitive to preprocessing parameters. Here we describe a 3D Convolutional Neural Network (CNN) based on the ResNet architecture being trained on raw, non-registered T$_ 1$-weighted MRI data of N=10,691 samples from the German National Cohort and additionally applied and validated in N=2,173 samples from three independent studies using transfer learning. For comparison, state-of-the-art models using preprocessed neuroimaging data are trained and validated on the same samples. The 3D CNN using raw neuroimaging data predicts age with a mean average deviation of 2.84 years, outperforming the state-of-the-art brain-age models using preprocessed data. Since our approach is invariant to preprocessing software and parameter choices, it enables faster, more robust and more accurate brain-age modeling.
△ Less
Submitted 22 March, 2021;
originally announced March 2021.
