Segment anything model for head and neck tumor segmentation with CT, PET and MRI multi-modality images
Authors:
**tao Ren,
Mathis Rasmussen,
Jasper Nijkamp,
Jesper Grau Eriksen,
Stine Korreman
Abstract:
Deep learning presents novel opportunities for the auto-segmentation of gross tumor volume (GTV) in head and neck cancer (HNC), yet fully automatic methods usually necessitate significant manual refinement. This study investigates the Segment Anything Model (SAM), recognized for requiring minimal human prompting and its zero-shot generalization ability across natural images. We specifically examin…
▽ More
Deep learning presents novel opportunities for the auto-segmentation of gross tumor volume (GTV) in head and neck cancer (HNC), yet fully automatic methods usually necessitate significant manual refinement. This study investigates the Segment Anything Model (SAM), recognized for requiring minimal human prompting and its zero-shot generalization ability across natural images. We specifically examine MedSAM, a version of SAM fine-tuned with large-scale public medical images. Despite its progress, the integration of multi-modality images (CT, PET, MRI) for effective GTV delineation remains a challenge. Focusing on SAM's application in HNC GTV segmentation, we assess its performance in both zero-shot and fine-tuned scenarios using single (CT-only) and fused multi-modality images. Our study demonstrates that fine-tuning SAM significantly enhances its segmentation accuracy, building upon the already effective zero-shot results achieved with bounding box prompts. These findings open a promising avenue for semi-automatic HNC GTV segmentation.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
Hepatic vessel segmentation using a reduced filter 3D U-Net in ultrasound imaging
Authors:
Bart R. Thomson,
Jasper Nijkamp,
Oleksandra Ivashchenko,
Ferdinand van der Heijden,
Jasper N. Smit,
Niels F. M. Kok,
Koert F. D. Kuhlmann,
Theo J. M. Ruers,
Matteo Fusaglia
Abstract:
Accurate hepatic vessel segmentation on ultrasound (US) images can be an important tool in the planning and execution of surgery, however proves to be a challenging task due to noise and speckle. Our method comprises a reduced filter 3D U-Net implementation to automatically detect hepatic vasculature in 3D US volumes. A comparison is made between volumes acquired with a 3D probe and stacked 2D US…
▽ More
Accurate hepatic vessel segmentation on ultrasound (US) images can be an important tool in the planning and execution of surgery, however proves to be a challenging task due to noise and speckle. Our method comprises a reduced filter 3D U-Net implementation to automatically detect hepatic vasculature in 3D US volumes. A comparison is made between volumes acquired with a 3D probe and stacked 2D US images based on electromagnetic tracking. Experiments are conducted on 67 scans, where 45 are used in training, 12 in validation and 10 in testing. This network architecture yields Dice scores of 0.740 and 0.781 for 3D and stacked 2D volumes respectively, comparing promising to literature and inter-observer performance (Dice = 0.879).
△ Less
Submitted 28 July, 2019;
originally announced July 2019.
