-
QUBIQ: Uncertainty Quantification for Biomedical Image Segmentation Challenge
Authors:
Hongwei Bran Li,
Fernando Navarro,
Ivan Ezhov,
Amirhossein Bayat,
Dhritiman Das,
Florian Kofler,
Suprosanna Shit,
Diana Waldmannstetter,
Johannes C. Paetzold,
Xiaobin Hu,
Benedikt Wiestler,
Lucas Zimmer,
Tamaz Amiranashvili,
Chinmay Prabhakar,
Christoph Berger,
Jonas Weidner,
Michelle Alonso-Basant,
Arif Rashid,
Ujjwal Baid,
Wesam Adel,
Deniz Ali,
Bhakti Baheti,
Yingbin Bai,
Ishaan Bhatt,
Sabri Can Cetindag
, et al. (55 additional authors not shown)
Abstract:
Uncertainty in medical image segmentation tasks, especially inter-rater variability, arising from differences in interpretations and annotations by various experts, presents a significant challenge in achieving consistent and reliable image segmentation. This variability not only reflects the inherent complexity and subjective nature of medical image interpretation but also directly impacts the de…
▽ More
Uncertainty in medical image segmentation tasks, especially inter-rater variability, arising from differences in interpretations and annotations by various experts, presents a significant challenge in achieving consistent and reliable image segmentation. This variability not only reflects the inherent complexity and subjective nature of medical image interpretation but also directly impacts the development and evaluation of automated segmentation algorithms. Accurately modeling and quantifying this variability is essential for enhancing the robustness and clinical applicability of these algorithms. We report the set-up and summarize the benchmark results of the Quantification of Uncertainties in Biomedical Image Quantification Challenge (QUBIQ), which was organized in conjunction with International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2020 and 2021. The challenge focuses on the uncertainty quantification of medical image segmentation which considers the omnipresence of inter-rater variability in imaging datasets. The large collection of images with multi-rater annotations features various modalities such as MRI and CT; various organs such as the brain, prostate, kidney, and pancreas; and different image dimensions 2D-vs-3D. A total of 24 teams submitted different solutions to the problem, combining various baseline models, Bayesian neural networks, and ensemble model techniques. The obtained results indicate the importance of the ensemble models, as well as the need for further research to develop efficient 3D methods for uncertainty quantification methods in 3D segmentation tasks.
△ Less
Submitted 24 June, 2024; v1 submitted 19 March, 2024;
originally announced May 2024.
-
Modality agnostic intracranial aneurysm detection through supervised vascular surface classification
Authors:
Žiga Bizjak,
Boštjan Likar,
Franjo Pernuš,
Žiga Špiclin
Abstract:
Intracranial aneurysms (IAs) are generally asymptomatic and thus often discovered incidentally on angiographic scans like 3D DSA, CTA and MRA. Skilled radiologists achieved a sensitivity of 88% by means of visual detection, which seems inadequate considering that prevalence of IAs in general population is 3-5%. Deep learning models trained and executed on angiographic scans seem best-suited for IA…
▽ More
Intracranial aneurysms (IAs) are generally asymptomatic and thus often discovered incidentally on angiographic scans like 3D DSA, CTA and MRA. Skilled radiologists achieved a sensitivity of 88% by means of visual detection, which seems inadequate considering that prevalence of IAs in general population is 3-5%. Deep learning models trained and executed on angiographic scans seem best-suited for IA detection, however, reported performances across different modalities is currently insufficient for clinical application. This paper presents a novel modality agnostic method for detection of IAs. First the triangulated surfaces of vascular structures were roughly extracted from the angiograms. For IA detection purpose, the extracted surfaces were randomly parcellated into local patches and then a translation, rotation and scale invariant classifier based on deep neural network (DNN) was trained. Test stage proceeded by mimicking the surface extraction and parcellation at several random locations, then the trained DNN model was applied for classification, and the results aggregated into IA detection heatmaps across entire vascular surface. For training and validation the extracted contours were presented to skilled neurosurgeon, who marked the locations of IAs. The DNN was trained and tested using three-fold cross-validation based on 57 DSAs, 5 CTAs and 5 MRAs and showed a 98.6% sensitivity at 0.2 false positive detections per image. Experimental results show that proposed approach not only significantly improved detection sensitivity and specificity compared to state-of-the-art intensity based methods, but is also modality agnostic and thus better suited for clinical application.
△ Less
Submitted 29 May, 2020;
originally announced May 2020.
-
Vascular surface segmentation for intracranial aneurysm isolation and quantification
Authors:
Žiga Bizjak,
Boštjan Likar,
Franjo Pernuš,
Žiga Špiclin
Abstract:
Predicting rupture risk and deciding on optimal treatment plan for intracranial aneurysms (IAs) is possible by quantification of their size and shape. For this purpose the IA has to be isolated from 3D angiogram. State-of-the-art methods perform IA isolation by encoding neurosurgeon's intuition about former non-dilated vessel anatomy through principled approaches like fitting a cutting plane to va…
▽ More
Predicting rupture risk and deciding on optimal treatment plan for intracranial aneurysms (IAs) is possible by quantification of their size and shape. For this purpose the IA has to be isolated from 3D angiogram. State-of-the-art methods perform IA isolation by encoding neurosurgeon's intuition about former non-dilated vessel anatomy through principled approaches like fitting a cutting plane to vasculature surface, using Gaussian curvature and vessel centerline distance constraints, by deformable contours or graph cuts guided by the curvature or restricted by Voronoi surface decomposition and similar. However, the large variability of IAs and their parent vasculature configurations often leads to failure or non-intuitive isolation. Manual corrections are thus required, but suffer from poor reproducibility. In this paper, we aim to increase the accuracy, robustness and reproducibility of IA isolation through two stage deep learning based segmentation of vascular surface. The surface was represented by local patches in form of point clouds, which were fed into first stage multilayer neural network (MNN) to obtain descriptors invariant to point ordering, rotation and scale. Binary classifier as second stage MNN was used to isolate surface belonging to the IA. Method validation was based on 57 DSA, 28 CTA and 5 MRA images, where cross-validation showed high segmentation sensitivity of 0.985, a substantial improvement over 0.830 obtained for the state-of-the-art method on the same datasets. Visual analysis of IA isolation and its high accuracy and reliability consistent across CTA and DSA scans confirmed the clinical applicability of proposed method.
△ Less
Submitted 29 May, 2020;
originally announced May 2020.
-
Spatio-temporal Learning from Longitudinal Data for Multiple Sclerosis Lesion Segmentation
Authors:
Stefan Denner,
Ashkan Khakzar,
Moiz Sajid,
Mahdi Saleh,
Ziga Spiclin,
Seong Tae Kim,
Nassir Navab
Abstract:
Segmentation of Multiple Sclerosis (MS) lesions in longitudinal brain MR scans is performed for monitoring the progression of MS lesions. We hypothesize that the spatio-temporal cues in longitudinal data can aid the segmentation algorithm. Therefore, we propose a multi-task learning approach by defining an auxiliary self-supervised task of deformable registration between two time-points to guide t…
▽ More
Segmentation of Multiple Sclerosis (MS) lesions in longitudinal brain MR scans is performed for monitoring the progression of MS lesions. We hypothesize that the spatio-temporal cues in longitudinal data can aid the segmentation algorithm. Therefore, we propose a multi-task learning approach by defining an auxiliary self-supervised task of deformable registration between two time-points to guide the neural network toward learning from spatio-temporal changes. We show the efficacy of our method on a clinical dataset comprised of 70 patients with one follow-up study for each patient. Our results show that spatio-temporal information in longitudinal data is a beneficial cue for improving segmentation. We improve the result of current state-of-the-art by 2.6% in terms of overall score (p<0.05). Code is publicly available.
△ Less
Submitted 26 September, 2020; v1 submitted 7 April, 2020;
originally announced April 2020.
