-
TotalVibeSegmentator: Full Torso Segmentation for the NAKO and UK Biobank in Volumetric Interpolated Breath-hold Examination Body Images
Authors:
Robert Graf,
Paul-Sören Platzek,
Evamaria Olga Riedel,
Constanze Ramschütz,
Sophie Starck,
Hendrik Kristian Möller,
Matan Atad,
Henry Völzke,
Robin Bülow,
Carsten Oliver Schmidt,
Julia Rüdebusch,
Matthias Jung,
Marco Reisert,
Jakob Weiss,
Maximilian Löffler,
Fabian Bamberg,
Bene Wiestler,
Johannes C. Paetzold,
Daniel Rueckert,
Jan Stefan Kirschke
Abstract:
Objectives: To present a publicly available torso segmentation network for large epidemiology datasets on volumetric interpolated breath-hold examination (VIBE) images. Materials & Methods: We extracted preliminary segmentations from TotalSegmentator, spine, and body composition networks for VIBE images, then improved them iteratively and retrained a nnUNet network. Using subsets of NAKO (85 subje…
▽ More
Objectives: To present a publicly available torso segmentation network for large epidemiology datasets on volumetric interpolated breath-hold examination (VIBE) images. Materials & Methods: We extracted preliminary segmentations from TotalSegmentator, spine, and body composition networks for VIBE images, then improved them iteratively and retrained a nnUNet network. Using subsets of NAKO (85 subjects) and UK Biobank (16 subjects), we evaluated with Dice-score on a holdout set (12 subjects) and existing organ segmentation approach (1000 subjects), generating 71 semantic segmentation types for VIBE images. We provide an additional network for the vertebra segments 22 individual vertebra types. Results: We achieved an average Dice score of 0.89 +- 0.07 overall 71 segmentation labels. We scored > 0.90 Dice-score on the abdominal organs except for the pancreas with a Dice of 0.70. Conclusion: Our work offers a detailed and refined publicly available full torso segmentation on VIBE images.
△ Less
Submitted 31 May, 2024;
originally announced June 2024.
-
SPINEPS -- Automatic Whole Spine Segmentation of T2-weighted MR images using a Two-Phase Approach to Multi-class Semantic and Instance Segmentation
Authors:
Hendrik Möller,
Robert Graf,
Joachim Schmitt,
Benjamin Keinert,
Matan Atad,
Anjany Sekuboyina,
Felix Streckenbach,
Hanna Schön,
Florian Kofler,
Thomas Kroencke,
Stefanie Bette,
Stefan Willich,
Thomas Keil,
Thoralf Niendorf,
Tobias Pischon,
Beate Endemann,
Bjoern Menze,
Daniel Rueckert,
Jan S. Kirschke
Abstract:
Purpose. To present SPINEPS, an open-source deep learning approach for semantic and instance segmentation of 14 spinal structures (ten vertebra substructures, intervertebral discs, spinal cord, spinal canal, and sacrum) in whole body T2w MRI.
Methods. During this HIPPA-compliant, retrospective study, we utilized the public SPIDER dataset (218 subjects, 63% female) and a subset of the German Nati…
▽ More
Purpose. To present SPINEPS, an open-source deep learning approach for semantic and instance segmentation of 14 spinal structures (ten vertebra substructures, intervertebral discs, spinal cord, spinal canal, and sacrum) in whole body T2w MRI.
Methods. During this HIPPA-compliant, retrospective study, we utilized the public SPIDER dataset (218 subjects, 63% female) and a subset of the German National Cohort (1423 subjects, mean age 53, 49% female) for training and evaluation. We combined CT and T2w segmentations to train models that segment 14 spinal structures in T2w sagittal scans both semantically and instance-wise. Performance evaluation metrics included Dice similarity coefficient, average symmetrical surface distance, panoptic quality, segmentation quality, and recognition quality. Statistical significance was assessed using the Wilcoxon signed-rank test. An in-house dataset was used to qualitatively evaluate out-of-distribution samples.
Results. On the public dataset, our approach outperformed the baseline (instance-wise vertebra dice score 0.929 vs. 0.907, p-value<0.001). Training on auto-generated annotations and evaluating on manually corrected test data from the GNC yielded global dice scores of 0.900 for vertebrae, 0.960 for intervertebral discs, and 0.947 for the spinal canal. Incorporating the SPIDER dataset during training increased these scores to 0.920, 0.967, 0.958, respectively.
Conclusions. The proposed segmentation approach offers robust segmentation of 14 spinal structures in T2w sagittal images, including the spinal cord, spinal canal, intervertebral discs, endplate, sacrum, and vertebrae. The approach yields both a semantic and instance mask as output, thus being easy to utilize. This marks the first publicly available algorithm for whole spine segmentation in sagittal T2w MR imaging.
△ Less
Submitted 22 April, 2024; v1 submitted 26 February, 2024;
originally announced February 2024.
-
Panoptica -- instance-wise evaluation of 3D semantic and instance segmentation maps
Authors:
Florian Kofler,
Hendrik Möller,
Josef A. Buchner,
Ezequiel de la Rosa,
Ivan Ezhov,
Marcel Rosier,
Isra Mekki,
Suprosanna Shit,
Moritz Negwer,
Rami Al-Maskari,
Ali Ertürk,
Shankeeth Vinayahalingam,
Fabian Isensee,
Sarthak Pati,
Daniel Rueckert,
Jan S. Kirschke,
Stefan K. Ehrlich,
Annika Reinke,
Bjoern Menze,
Benedikt Wiestler,
Marie Piraud
Abstract:
This paper introduces panoptica, a versatile and performance-optimized package designed for computing instance-wise segmentation quality metrics from 2D and 3D segmentation maps. panoptica addresses the limitations of existing metrics and provides a modular framework that complements the original intersection over union-based panoptic quality with other metrics, such as the distance metric Average…
▽ More
This paper introduces panoptica, a versatile and performance-optimized package designed for computing instance-wise segmentation quality metrics from 2D and 3D segmentation maps. panoptica addresses the limitations of existing metrics and provides a modular framework that complements the original intersection over union-based panoptic quality with other metrics, such as the distance metric Average Symmetric Surface Distance. The package is open-source, implemented in Python, and accompanied by comprehensive documentation and tutorials. panoptica employs a three-step metrics computation process to cover diverse use cases. The efficacy of panoptica is demonstrated on various real-world biomedical datasets, where an instance-wise evaluation is instrumental for an accurate representation of the underlying clinical task. Overall, we envision panoptica as a valuable tool facilitating in-depth evaluation of segmentation methods.
△ Less
Submitted 5 December, 2023;
originally announced December 2023.
-
Denoising diffusion-based MRI to CT image translation enables automated spinal segmentation
Authors:
Robert Graf,
Joachim Schmitt,
Sarah Schlaeger,
Hendrik Kristian Möller,
Vasiliki Sideri-Lampretsa,
Anjany Sekuboyina,
Sandro Manuel Krieg,
Benedikt Wiestler,
Bjoern Menze,
Daniel Rueckert,
Jan Stefan Kirschke
Abstract:
Background: Automated segmentation of spinal MR images plays a vital role both scientifically and clinically. However, accurately delineating posterior spine structures presents challenges.
Methods: This retrospective study, approved by the ethical committee, involved translating T1w and T2w MR image series into CT images in a total of n=263 pairs of CT/MR series. Landmark-based registration was…
▽ More
Background: Automated segmentation of spinal MR images plays a vital role both scientifically and clinically. However, accurately delineating posterior spine structures presents challenges.
Methods: This retrospective study, approved by the ethical committee, involved translating T1w and T2w MR image series into CT images in a total of n=263 pairs of CT/MR series. Landmark-based registration was performed to align image pairs. We compared 2D paired (Pix2Pix, denoising diffusion implicit models (DDIM) image mode, DDIM noise mode) and unpaired (contrastive unpaired translation, SynDiff) image-to-image translation using "peak signal to noise ratio" (PSNR) as quality measure. A publicly available segmentation network segmented the synthesized CT datasets, and Dice scores were evaluated on in-house test sets and the "MRSpineSeg Challenge" volumes. The 2D findings were extended to 3D Pix2Pix and DDIM.
Results: 2D paired methods and SynDiff exhibited similar translation performance and Dice scores on paired data. DDIM image mode achieved the highest image quality. SynDiff, Pix2Pix, and DDIM image mode demonstrated similar Dice scores (0.77). For craniocaudal axis rotations, at least two landmarks per vertebra were required for registration. The 3D translation outperformed the 2D approach, resulting in improved Dice scores (0.80) and anatomically accurate segmentations in a higher resolution than the original MR image.
Conclusion: Two landmarks per vertebra registration enabled paired image-to-image translation from MR to CT and outperformed all unpaired approaches. The 3D techniques provided anatomically correct segmentations, avoiding underprediction of small structures like the spinous process.
△ Less
Submitted 14 November, 2023; v1 submitted 18 August, 2023;
originally announced August 2023.
-
The generalized Hierarchical Gaussian Filter
Authors:
Lilian Aline Weber,
Peter Thestrup Waade,
Nicolas Legrand,
Anna Hedvig Møller,
Klaas Enno Stephan,
Christoph Mathys
Abstract:
Hierarchical Bayesian models of perception and learning feature prominently in contemporary cognitive neuroscience where, for example, they inform computational concepts of mental disorders. This includes predictive coding and hierarchical Gaussian filtering (HGF), which differ in the nature of hierarchical representations. Predictive coding assumes that higher levels in a given hierarchy influenc…
▽ More
Hierarchical Bayesian models of perception and learning feature prominently in contemporary cognitive neuroscience where, for example, they inform computational concepts of mental disorders. This includes predictive coding and hierarchical Gaussian filtering (HGF), which differ in the nature of hierarchical representations. Predictive coding assumes that higher levels in a given hierarchy influence the state (value) of lower levels. In HGF, however, higher levels determine the rate of change at lower levels. Here, we extend the space of generative models underlying HGF to include a form of nonlinear hierarchical coupling between state values akin to predictive coding and artificial neural networks in general. We derive the update equations corresponding to this generalization of HGF and conceptualize them as connecting a network of (belief) nodes where parent nodes either predict the state of child nodes or their rate of change. This enables us to (1) create modular architectures with generic computational steps in each node of the network, and (2) disclose the hierarchical message passing implied by generalized HGF models and to compare this to comparable schemes under predictive coding. We find that the algorithmic architecture instantiated by the generalized HGF is largely compatible with that of predictive coding but extends it with some unique predictions which arise from precision and volatility related computations. Our developments enable highly flexible implementations of hierarchical Bayesian models for empirical data analysis and are available as open source software.
△ Less
Submitted 18 May, 2023;
originally announced May 2023.
-
5G NB-IoT via low density LEO Constellations
Authors:
René Brandborg Sørensen,
Henrik Krogh Møller,
Per Koch
Abstract:
5G NB-IoT is seen as a key technology for providing truly ubiquitous, global 5G coverage (1.000.000 devices/km2) for machine type communications in the internet of things. A non-terrestrial network (NTN) variant of NB-IoT is being standardized in the 3GPP, which along with inexpensive and non-complex chip-sets enables the production of competitively priced IoT devices with truly global coverage. N…
▽ More
5G NB-IoT is seen as a key technology for providing truly ubiquitous, global 5G coverage (1.000.000 devices/km2) for machine type communications in the internet of things. A non-terrestrial network (NTN) variant of NB-IoT is being standardized in the 3GPP, which along with inexpensive and non-complex chip-sets enables the production of competitively priced IoT devices with truly global coverage. NB-IoT allows for narrowband single carrier transmissions in the uplink, which improves the uplink link-budget by as much as 16.8 dB over the 180 [kHz] downlink. This allows for a long range sufficient for ground to low earth orbit (LEO) communication without the need for complex and expensive antennas in the IoT devices. In this paper the feasibility of 5G NB-IoT in the context of low-density constellations of small-satellites carrying base-stations in LEO is analyzed and required adaptations to NB-IoT are discussed.
△ Less
Submitted 13 August, 2021;
originally announced August 2021.
