-
Observer study-based evaluation of TGAN architecture used to generate oncological PET images
Authors:
Roberto Fedrigo,
Fereshteh Yousefirizi,
Zi** Liu,
Abhinav K. Jha,
Robert V. Bergen,
Jean-Francois Rajotte,
Raymond T. Ng,
Ingrid Bloise,
Sara Harsini,
Dan J. Kadrmas,
Carlos Uribe,
Arman Rahmim
Abstract:
The application of computer-vision algorithms in medical imaging has increased rapidly in recent years. However, algorithm training is challenging due to limited sample sizes, lack of labeled samples, as well as privacy concerns regarding data sharing. To address these issues, we previously developed (Bergen et al. 2022) a synthetic PET dataset for Head and Neck (H and N) cancer using the temporal…
▽ More
The application of computer-vision algorithms in medical imaging has increased rapidly in recent years. However, algorithm training is challenging due to limited sample sizes, lack of labeled samples, as well as privacy concerns regarding data sharing. To address these issues, we previously developed (Bergen et al. 2022) a synthetic PET dataset for Head and Neck (H and N) cancer using the temporal generative adversarial network (TGAN) architecture and evaluated its performance segmenting lesions and identifying radiomics features in synthesized images. In this work, a two-alternative forced-choice (2AFC) observer study was performed to quantitatively evaluate the ability of human observers to distinguish between real and synthesized oncological PET images. In the study eight trained readers, including two board-certified nuclear medicine physicians, read 170 real/synthetic image pairs presented as 2D-transaxial using a dedicated web app. For each image pair, the observer was asked to identify the real image and input their confidence level with a 5-point Likert scale. P-values were computed using the binomial test and Wilcoxon signed-rank test. A heat map was used to compare the response accuracy distribution for the signed-rank test. Response accuracy for all observers ranged from 36.2% [27.9-44.4] to 63.1% [54.8-71.3]. Six out of eight observers did not identify the real image with statistical significance, indicating that the synthetic dataset was reasonably representative of oncological PET images. Overall, this study adds validity to the realism of our simulated H&N cancer dataset, which may be implemented in the future to train AI algorithms while favoring patient confidentiality and privacy protection.
△ Less
Submitted 27 November, 2023; v1 submitted 27 November, 2023;
originally announced November 2023.
-
PyTomography: A Python Library for Quantitative Medical Image Reconstruction
Authors:
Lucas Polson,
Roberto Fedrigo,
Chenguang Li,
Maziar Sabouri,
Obed Dzikunu,
Shadab Ahamed,
Nikolaos Karakatsanis,
Arman Rahmim,
Carlos Uribe
Abstract:
There is a need for open-source libraries in emission tomography that (i) use modern and popular backend code to encourage community contributions and (ii) offer support for the multitude of reconstruction algorithms available in recent literature, such as those that employ artificial intelligence. The purpose of this research was to create and evaluate a GPU-accelerated, open-source, and user-fri…
▽ More
There is a need for open-source libraries in emission tomography that (i) use modern and popular backend code to encourage community contributions and (ii) offer support for the multitude of reconstruction algorithms available in recent literature, such as those that employ artificial intelligence. The purpose of this research was to create and evaluate a GPU-accelerated, open-source, and user-friendly image reconstruction library, designed to serve as a central platform for the development, validation, and deployment of various tomographic reconstruction algorithms. PyTomography was developed using Python and inherits the GPU-accelerated functionality of PyTorch and parallelproj for fast computations. Its flexible and modular design decouples system matrices, likelihoods, and reconstruction algorithms, simplifying the process of integrating new imaging modalities using various python tools. Example use cases demonstrate the software capabilities in parallel hole SPECT and listmode PET imaging. Overall, we have developed and publicly share PyTomography, a highly optimized and user-friendly software for medical image reconstruction, with a class hierarchy that fosters the development of novel imaging applications.
△ Less
Submitted 7 July, 2024; v1 submitted 5 September, 2023;
originally announced September 2023.
-
Neural blind deconvolution for deblurring and supersampling PSMA PET
Authors:
Caleb Sample,
Arman Rahmim,
Carlos Uribe,
François Bénard,
Jonn Wu,
Roberto Fedrigo,
Haley Clark
Abstract:
Objective: To simultaneously deblur and supersample prostate specific membrane antigen (PSMA) positron emission tomography (PET) images using neural blind deconvolution. Approach: Blind deconvolution is a method of estimating the hypothetical "deblurred" image along with the blur kernel (related to the point spread function) simultaneously. Traditional \textit{maximum a posteriori} blind deconvolu…
▽ More
Objective: To simultaneously deblur and supersample prostate specific membrane antigen (PSMA) positron emission tomography (PET) images using neural blind deconvolution. Approach: Blind deconvolution is a method of estimating the hypothetical "deblurred" image along with the blur kernel (related to the point spread function) simultaneously. Traditional \textit{maximum a posteriori} blind deconvolution methods require stringent assumptions and suffer from convergence to a trivial solution. A method of modelling the deblurred image and kernel with independent neural networks, called "neural blind deconvolution" had demonstrated success for deblurring 2D natural images in 2020. In this work, we adapt neural blind deconvolution for PVE correction of PSMA PET images with simultaneous supersampling. We compare this methodology with several interpolation methods, using blind image quality metrics, and test the model's ability to predict kernels by re-running the model after applying artificial "pseudokernels" to deblurred images. The methodology was tested on a retrospective set of 30 prostate patients as well as phantom images containing spherical lesions of various volumes. Results: Neural blind deconvolution led to improvements in image quality over other interpolation methods in terms of blind image quality metrics, recovery coefficients, and visual assessment. Predicted kernels were similar between patients, and the model accurately predicted several artificially-applied pseudokernels. Localization of activity in phantom spheres was improved after deblurring, allowing small lesions to be more accurately defined. Significance: The intrinsically low spatial resolution of PSMA PET leads to PVEs which negatively impact uptake quantification in small regions. The proposed method can be used to mitigate this issue, and can be straightforwardly adapted for other imaging modalities.
△ Less
Submitted 2 March, 2024; v1 submitted 1 September, 2023;
originally announced September 2023.
-
Development of the Lymphatic System in the 4D XCAT Phantom
Authors:
Roberto Fedrigo,
William P. Segars,
Patrick Martineau,
Claire Gowdy,
Ingrid Bloise,
Carlos F. Uribe,
Arman Rahmim
Abstract:
Purpose: The XCAT phantom allows for highly sophisticated multimodality imaging research. It includes a complete set of organs, muscle, bone, soft tissue, while also accounting for age, sex, and body mass index (BMI), which allows phantom studies to be performed at a population scale. At the same time, the XCAT phantom does not currently include the lymphatic system, critical for evaluating bulky…
▽ More
Purpose: The XCAT phantom allows for highly sophisticated multimodality imaging research. It includes a complete set of organs, muscle, bone, soft tissue, while also accounting for age, sex, and body mass index (BMI), which allows phantom studies to be performed at a population scale. At the same time, the XCAT phantom does not currently include the lymphatic system, critical for evaluating bulky nodal malignancies in lymphoma. We aimed to incorporate a full lymphatic system into the XCAT phantom and to generate realistic simulated images via guidance from lymphoma patient studies.
Methods: A template lymphatic system was extended based on known anatomy was used to define 276 lymph nodes and corresponding vessels using non-uniform rational basis spline (NURBS) surfaces. Lymph node properties were modified using the Rhinoceros 3D viewing software. The XCAT general parameter script was used to input organ concentrations and generate binary files with uptake and attenuation information.
Results: Lymph nodes can be scaled, stretched, and translated within the intuitive Rhinoceros interface, to allow for realistic simulation of different lymph node pathologies. Bulky, heterogeneous PMBCL tumours were generated in the mediastinum using expanded lymph nodes. Our results suggest that optimized thresholding provides better accuracy for determining total metabolic tumour volume (TMTV) of PMBCL tumours, while the gradient method was most accurate for total lesion glycolysis (TLG).
Conclusions: An upgraded XCAT phantom with a fully simulated lymphatic system was created. Distributed to the research community, the XCAT phantom with the new lymphatic system has the potential of enabling studies to optimize image quality and quantitation, towards improved assessment of lymphoma including predictive modeling (e.g. improved TMTV and radiomics research).
△ Less
Submitted 2 August, 2021; v1 submitted 23 July, 2021;
originally announced July 2021.
