-
Label Dropout: Improved Deep Learning Echocardiography Segmentation Using Multiple Datasets With Domain Shift and Partial Labelling
Authors:
Iman Islam,
Esther Puyol-Antón,
Bram Ruijsink,
Andrew J. Reader,
Andrew P. King
Abstract:
Echocardiography (echo) is the first imaging modality used when assessing cardiac function. The measurement of functional biomarkers from echo relies upon the segmentation of cardiac structures and deep learning models have been proposed to automate the segmentation process. However, in order to translate these tools to widespread clinical use it is important that the segmentation models are robus…
▽ More
Echocardiography (echo) is the first imaging modality used when assessing cardiac function. The measurement of functional biomarkers from echo relies upon the segmentation of cardiac structures and deep learning models have been proposed to automate the segmentation process. However, in order to translate these tools to widespread clinical use it is important that the segmentation models are robust to a wide variety of images (e.g. acquired from different scanners, by operators with different levels of expertise etc.). To achieve this level of robustness it is necessary that the models are trained with multiple diverse datasets. A significant challenge faced when training with multiple diverse datasets is the variation in label presence, i.e. the combined data are often partially-labelled. Adaptations of the cross entropy loss function have been proposed to deal with partially labelled data. In this paper we show that training naively with such a loss function and multiple diverse datasets can lead to a form of shortcut learning, where the model associates label presence with domain characteristics, leading to a drop in performance. To address this problem, we propose a novel label dropout scheme to break the link between domain characteristics and the presence or absence of labels. We demonstrate that label dropout improves echo segmentation Dice score by 62% and 25% on two cardiac structures when training using multiple diverse partially labelled datasets.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
Self-Supervised and Supervised Deep Learning for PET Image Reconstruction
Authors:
Andrew J. Reader
Abstract:
A unified self-supervised and supervised deep learning framework for PET image reconstruction is presented, including deep-learned filtered backprojection (DL-FBP) for sinograms, deep-learned backproject then filter (DL-BPF) for backprojected images, and a more general map** using a deep network in both the sinogram and image domains (DL-FBP-F). The framework allows varying amounts and types of…
▽ More
A unified self-supervised and supervised deep learning framework for PET image reconstruction is presented, including deep-learned filtered backprojection (DL-FBP) for sinograms, deep-learned backproject then filter (DL-BPF) for backprojected images, and a more general map** using a deep network in both the sinogram and image domains (DL-FBP-F). The framework allows varying amounts and types of training data, from the case of having only one single dataset to reconstruct through to the case of having numerous measured datasets, which may or may not be paired with high-quality references. For purely self-supervised map**s, no reference or ground truth data are needed. The self-supervised deep-learned reconstruction operators all use a conventional image reconstruction objective within the loss function (e.g. maximum Poisson likelihood, maximum a posteriori). If it is desired for the reconstruction networks to generalise (i.e. to need either no or minimal retraining for a new measured dataset, but to be fast, ready to reuse), then these self-supervised networks show potential even when previously trained from just one single dataset. For any given new measured dataset, finetuning is however often necessary, and of course the initial training set should ideally go beyond just one dataset if a generalisable network is sought. Example results for the purely self-supervised single-dataset case are shown, but the networks can be i) trained uniquely for any measured dataset to reconstruct from, ii) pretrained on multiple datasets and then used with no retraining for new measured data, iii) pretrained and then finetuned for new measured data, iv) optionally trained with high-quality references. The framework, with its optional inclusion of supervised learning, provides a spectrum of reconstruction approaches by making use of whatever (if any) training data quantities and types are available.
△ Less
Submitted 25 February, 2023;
originally announced February 2023.
-
Motion-corrected and high-resolution anatomically-assisted (MOCHA) reconstruction of arterial spin labelling MRI
Authors:
Abolfazl Mehranian,
Colm J. McGinnity,
Radhouene Neji,
Claudia Prieto,
Alexander Hammers,
Enrico De Vita,
Andrew J. Reader
Abstract:
A model-based reconstruction framework is proposed for MOtion-Corrected and High-resolution anatomically-Assisted (MOCHA) reconstruction of ASL data. In this framework, all low-resolution ASL control-label pairs are used to reconstruct a single high-resolution cerebral blood flow (CBF) map, corrected for rigid motion, point-spread-function (PSF) blurring and partial-volume effect (PVE).Six volunte…
▽ More
A model-based reconstruction framework is proposed for MOtion-Corrected and High-resolution anatomically-Assisted (MOCHA) reconstruction of ASL data. In this framework, all low-resolution ASL control-label pairs are used to reconstruct a single high-resolution cerebral blood flow (CBF) map, corrected for rigid motion, point-spread-function (PSF) blurring and partial-volume effect (PVE).Six volunteers were recruited for CBF imaging using PCASL labelling, 2-shot 3D-GRASE sequences and high-resolution T1-weighted MRI. For two volunteers, high-resolution scans with double and triple resolution in the partition direction were additionally collected. Simulations were designed for evaluations against a high-resolution ground-truth CBF map, including a simulated hyper-perfused lesion and hyper/hypo-perfusion abnormalities. MOCHA was compared to standard reconstruction and a 3D linear regression (3DLR) PVE correction method and was further evaluated for acquisitions with reduced control-label pairs and k-space undersampling. MOCHA reconstructions of low-resolution ASL data showed enhanced image quality particularly in the partition direction. In simulations, both MOCHA and 3DLR provided more accurate CBF maps than the standard reconstruction, however MOCHA resulted in the lowest errors and well delineated the abnormalities. MOCHA reconstruction of standard-resolution in-vivo data showed good agreement with higher-resolution scans requiring 4x and 9x longer acquisitions. MOCHA was found to be robust for 4x-accelerated ASL acquisitions, achieved by reduced control-label pairs or k-space undersampling. Conclusion: MOCHA reconstruction reduces PVE by direct reconstruction of CBF maps in the high-resolution space of the corresponding anatomical image, incorporating motion correction and PSF modelling. Following further evaluation, MOCHA should promote the clinical application of ASL.
△ Less
Submitted 28 September, 2019;
originally announced September 2019.
