-
Minimally Interactive Segmentation of Soft-Tissue Tumors on CT and MRI using Deep Learning
Authors:
Douwe J. Spaanderman,
Martijn P. A. Starmans,
Gonnie C. M. van Erp,
David F. Hanff,
Judith H. Sluijter,
Anne-Rose W. Schut,
Geert J. L. H. van Leenders,
Cornelis Verhoef,
Dirk J. Grunhagen,
Wiro J. Niessen,
Jacob J. Visser,
Stefan Klein
Abstract:
Segmentations are crucial in medical imaging to obtain morphological, volumetric, and radiomics biomarkers. Manual segmentation is accurate but not feasible in the radiologist's clinical workflow, while automatic segmentation generally obtains sub-par performance. We therefore developed a minimally interactive deep learning-based segmentation method for soft-tissue tumors (STTs) on CT and MRI. The…
▽ More
Segmentations are crucial in medical imaging to obtain morphological, volumetric, and radiomics biomarkers. Manual segmentation is accurate but not feasible in the radiologist's clinical workflow, while automatic segmentation generally obtains sub-par performance. We therefore developed a minimally interactive deep learning-based segmentation method for soft-tissue tumors (STTs) on CT and MRI. The method requires the user to click six points near the tumor's extreme boundaries. These six points are transformed into a distance map and serve, with the image, as input for a Convolutional Neural Network. For training and validation, a multicenter dataset containing 514 patients and nine STT types in seven anatomical locations was used, resulting in a Dice Similarity Coefficient (DSC) of 0.85$\pm$0.11 (mean $\pm$ standard deviation (SD)) for CT and 0.84$\pm$0.12 for T1-weighted MRI, when compared to manual segmentations made by expert radiologists. Next, the method was externally validated on a dataset including five unseen STT phenotypes in extremities, achieving 0.81$\pm$0.08 for CT, 0.84$\pm$0.09 for T1-weighted MRI, and 0.88\pm0.08 for previously unseen T2-weighted fat-saturated (FS) MRI. In conclusion, our minimally interactive segmentation method effectively segments different types of STTs on CT and MRI, with robust generalization to previously unseen phenotypes and imaging modalities.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Reproducible radiomics through automated machine learning validated on twelve clinical applications
Authors:
Martijn P. A. Starmans,
Sebastian R. van der Voort,
Thomas Phil,
Milea J. M. Timbergen,
Melissa Vos,
Guillaume A. Padmos,
Wouter Kessels,
David Hanff,
Dirk J. Grunhagen,
Cornelis Verhoef,
Stefan Sleijfer,
Martin J. van den Bent,
Marion Smits,
Roy S. Dwarkasing,
Christopher J. Els,
Federico Fiduzi,
Geert J. L. H. van Leenders,
Anela Blazevic,
Johannes Hofland,
Tessa Brabander,
Renza A. H. van Gils,
Gaston J. H. Franssen,
Richard A. Feelders,
Wouter W. de Herder,
Florian E. Buisman
, et al. (21 additional authors not shown)
Abstract:
Radiomics uses quantitative medical imaging features to predict clinical outcomes. Currently, in a new clinical application, finding the optimal radiomics method out of the wide range of available options has to be done manually through a heuristic trial-and-error process. In this study we propose a framework for automatically optimizing the construction of radiomics workflows per application. To…
▽ More
Radiomics uses quantitative medical imaging features to predict clinical outcomes. Currently, in a new clinical application, finding the optimal radiomics method out of the wide range of available options has to be done manually through a heuristic trial-and-error process. In this study we propose a framework for automatically optimizing the construction of radiomics workflows per application. To this end, we formulate radiomics as a modular workflow and include a large collection of common algorithms for each component. To optimize the workflow per application, we employ automated machine learning using a random search and ensembling. We evaluate our method in twelve different clinical applications, resulting in the following area under the curves: 1) liposarcoma (0.83); 2) desmoid-type fibromatosis (0.82); 3) primary liver tumors (0.80); 4) gastrointestinal stromal tumors (0.77); 5) colorectal liver metastases (0.61); 6) melanoma metastases (0.45); 7) hepatocellular carcinoma (0.75); 8) mesenteric fibrosis (0.80); 9) prostate cancer (0.72); 10) glioma (0.71); 11) Alzheimer's disease (0.87); and 12) head and neck cancer (0.84). We show that our framework has a competitive performance compared human experts, outperforms a radiomics baseline, and performs similar or superior to Bayesian optimization and more advanced ensemble approaches. Concluding, our method fully automatically optimizes the construction of radiomics workflows, thereby streamlining the search for radiomics biomarkers in new applications. To facilitate reproducibility and future research, we publicly release six datasets, the software implementation of our framework, and the code to reproduce this study.
△ Less
Submitted 29 July, 2022; v1 submitted 19 August, 2021;
originally announced August 2021.
-
Differential diagnosis and molecular stratification of gastrointestinal stromal tumors on CT images using a radiomics approach
Authors:
Martijn P. A. Starmans,
Milea J. M. Timbergen,
Melissa Vos,
Michel Renckens,
Dirk J. Grünhagen,
Geert J. L. H. van Leenders,
Roy S. Dwarkasing,
François E. J. A. Willemssen,
Wiro J. Niessen,
Cornelis Verhoef,
Stefan Sleijfer,
Jacob J. Visser,
Stefan Klein
Abstract:
Distinguishing gastrointestinal stromal tumors (GISTs) from other intra-abdominal tumors and GISTs molecular analysis is necessary for treatment planning, but challenging due to its rarity. The aim of this study was to evaluate radiomics for distinguishing GISTs from other intra-abdominal tumors, and in GISTs, predict the c-KIT, PDGFRA,BRAF mutational status and mitotic index (MI). All 247 include…
▽ More
Distinguishing gastrointestinal stromal tumors (GISTs) from other intra-abdominal tumors and GISTs molecular analysis is necessary for treatment planning, but challenging due to its rarity. The aim of this study was to evaluate radiomics for distinguishing GISTs from other intra-abdominal tumors, and in GISTs, predict the c-KIT, PDGFRA,BRAF mutational status and mitotic index (MI). All 247 included patients (125 GISTS, 122 non-GISTs) underwent a contrast-enhanced venous phase CT. The GIST vs. non-GIST radiomics model, including imaging, age, sex and location, had a mean area under the curve (AUC) of 0.82. Three radiologists had an AUC of 0.69, 0.76, and 0.84, respectively. The radiomics model had an AUC of 0.52 for c-KIT, 0.56 for c-KIT exon 11, and 0.52 for the MI. Hence, our radiomics model was able to distinguish GIST from non-GISTS with a performance similar to three radiologists, but was not able to predict the c-KIT mutation or MI.
△ Less
Submitted 15 October, 2020; v1 submitted 14 October, 2020;
originally announced October 2020.