Showing 1–29 of 29 results for author: Rahmim, A

Nuclear Medicine Artificial Intelligence in Action: The Bethesda Report (AI Summit 2024)

Authors: Arman Rahmim, Tyler J. Bradshaw, Guido Davidzon, Joyita Dutta, Georges El Fakhri, Munir Ghesani, Nicolas A. Karakatsanis, Quanzheng Li, Chi Liu, Emilie Roncali, Babak Saboury, Tahir Yusufaly, Abhinav K. Jha

Abstract: The 2nd SNMMI Artificial Intelligence (AI) Summit, organized by the SNMMI AI Task Force, took place in Bethesda, MD, on February 29 - March 1, 2024. Bringing together various community members and stakeholders, and following up on a prior successful 2022 AI Summit, the summit theme was: AI in Action. Six key topics included (i) an overview of prior and ongoing efforts by the AI task force, (ii) em… ▽ More The 2nd SNMMI Artificial Intelligence (AI) Summit, organized by the SNMMI AI Task Force, took place in Bethesda, MD, on February 29 - March 1, 2024. Bringing together various community members and stakeholders, and following up on a prior successful 2022 AI Summit, the summit theme was: AI in Action. Six key topics included (i) an overview of prior and ongoing efforts by the AI task force, (ii) emerging needs and tools for computational nuclear oncology, (iii) new frontiers in large language and generative models, (iv) defining the value proposition for the use of AI in nuclear medicine, (v) open science including efforts for data and model repositories, and (vi) issues of reimbursement and funding. The primary efforts, findings, challenges, and next steps are summarized in this manuscript. △ Less

Submitted 3 June, 2024; originally announced June 2024.

RT-utils: A Minimal Python Library for RT-struct Manipulation

Authors: Asim Shrestha, Adam Watkins, Fereshteh Yousefirizi, Arman Rahmim, Carlos F. Uribe

Abstract: Towards the need for automated and precise AI-based analysis of medical images, we present RT-utils, a specialized Python library tuned for the manipulation of radiotherapy (RT) structures stored in DICOM format. RT-utils excels in converting the polygon contours into binary masks, ensuring accuracy and efficiency. By converting DICOM RT structures into standardized formats such as NumPy arrays an… ▽ More Towards the need for automated and precise AI-based analysis of medical images, we present RT-utils, a specialized Python library tuned for the manipulation of radiotherapy (RT) structures stored in DICOM format. RT-utils excels in converting the polygon contours into binary masks, ensuring accuracy and efficiency. By converting DICOM RT structures into standardized formats such as NumPy arrays and SimpleITK Images, RT-utils optimizes inputs for computational solutions such as AI-based automated segmentation techniques or radiomics analysis. Since its inception in 2020, RT-utils has been used extensively with a focus on simplifying complex data processing tasks. RT-utils offers researchers a powerful solution to enhance workflows and drive significant advancements in medical imaging. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Mathematical Modeling of $^{18}$F-Fluoromisonidazole ($^{18}$F-FMISO) Radiopharmaceutical Transport in Vascularized Solid Tumors

Authors: Mohammad Amin Abazari, M. Soltani, Faezeh Eydi, Arman Rahmim, Farshad Moradi Kashkooli

Abstract: $^{18}$F-Fluoromisonidazole ($^{18}… ▽ More $^{18}$F-Fluoromisonidazole ($^{18}$F-FMISO) is a highly promising positron emission tomography radiopharmaceutical for identifying hypoxic regions in solid tumors. This research employs spatiotemporal multi-scale mathematical modeling to explore how different levels of angiogenesis influence the transport of radiopharmaceuticals within tumors. In this study, two tumor geometries with heterogeneous and uniform distributions of capillary networks were employed to incorporate varying degrees of microvascular density. The synthetic image of the heterogeneous and vascularized tumor was generated by simulating the angiogenesis process. The proposed multi-scale spatiotemporal model accounts for intricate physiological and biochemical factors within the tumor microenvironment, such as the transvascular transport of the radiopharmaceutical agent, its movement into the interstitial space by diffusion and convection mechanisms, and ultimately its uptake by tumor cells. Results showed that both quantitative and semi-quantitative metrics of $^{18}$F-FMISO uptake differ spatially and temporally at different stages during tumor growth. The presence of a high microvascular density in uniformly vascularized tumor increases cellular uptake, as it allows for more efficient release and rapid distribution of radiopharmaceutical molecules. This results in enhanced uptake compared to the heterogeneous vascularized tumor. In both heterogeneous and uniform distribution of microvessels in tumors, the diffusion transport mechanism has a more pronounced than convection. The findings of this study shed light on the transport phenomena behind $^{18}$F-FMISO radiopharmaceutical distribution and its delivery in the tumor microenvironment, aiding oncologists in their routine decision-making processes. △ Less

Submitted 7 May, 2024; originally announced May 2024.

Segmentation-Free Outcome Prediction in Head and Neck Cancer: Deep Learning-based Feature Extraction from Multi-Angle Maximum Intensity Projections (MA-MIPs) of PET Images

Authors: Amirhosein Toosi, Isaac Shiri, Habib Zaidi, Arman Rahmim

Abstract: We introduce an innovative, simple, effective segmentation-free approach for outcome prediction in head \& neck cancer (HNC) patients. By harnessing deep learning-based feature extraction techniques and multi-angle maximum intensity projections (MA-MIPs) applied to Fluorodeoxyglucose Positron Emission Tomography (FDG-PET) volumes, our proposed method eliminates the need for manual segmentations of… ▽ More We introduce an innovative, simple, effective segmentation-free approach for outcome prediction in head \& neck cancer (HNC) patients. By harnessing deep learning-based feature extraction techniques and multi-angle maximum intensity projections (MA-MIPs) applied to Fluorodeoxyglucose Positron Emission Tomography (FDG-PET) volumes, our proposed method eliminates the need for manual segmentations of regions-of-interest (ROIs) such as primary tumors and involved lymph nodes. Instead, a state-of-the-art object detection model is trained to perform automatic crop** of the head and neck region on the PET volumes. A pre-trained deep convolutional neural network backbone is then utilized to extract deep features from MA-MIPs obtained from 72 multi-angel axial rotations of the cropped PET volumes. These deep features extracted from multiple projection views of the PET volumes are then aggregated and fused, and employed to perform recurrence-free survival analysis on a cohort of 489 HNC patients. The proposed approach outperforms the best performing method on the target dataset for the task of recurrence-free survival analysis. By circumventing the manual delineation of the malignancies on the FDG PET-CT images, our approach eliminates the dependency on subjective interpretations and highly enhances the reproducibility of the proposed survival analysis method. △ Less

Submitted 2 May, 2024; originally announced May 2024.

Comments: 15 pages, 4 tables, 4 figures. Submitted for European Journal of Nuclear Medicine and Medical Imaging

MSC Class: 62Nxx ACM Class: I.2.m

Novel Method to Estimate Kinetic Microparameters from Dynamic Whole-Body Imaging in Regular-Axial Field-of-View PET Scanners

Authors: Kyung-Nam Lee, Arman Rahmim, Carlos Uribe

Abstract: For whole-body (WB) kinetic modeling based on a typical PET scanner, a multi-pass multi-bed scanning protocol is necessary given the limited axial field-of-view. Such a protocol introduces loss of early-dynamics in time-activity curves (TACs) and sparsity in TAC measurements, inducing uncertainty in parameter estimation when using least-squares estimation (LSE) (i.e., common standard) especially f… ▽ More For whole-body (WB) kinetic modeling based on a typical PET scanner, a multi-pass multi-bed scanning protocol is necessary given the limited axial field-of-view. Such a protocol introduces loss of early-dynamics in time-activity curves (TACs) and sparsity in TAC measurements, inducing uncertainty in parameter estimation when using least-squares estimation (LSE) (i.e., common standard) especially for kinetic microparameters. We present a method to reliably estimate microparameters, enabling accurate parametric imaging, on regular-axial field-of-view PET scanners. Our method, denoted parameter combination-driven estimation (PCDE), relies on generation of reference truth TAC database, and subsequently selecting, the best parameter combination as the one arriving at TAC with highest total similarity score (TSS), focusing on general image quality, overall visibility, and tumor detectability metrics. Our technique has two distinctive characteristics: 1) improved probability of having one-on-one map** between early and late dynamics in TACs (the former missing from typical protocols), and 2) use of multiple aspects of TACs in selection of best fits. To evaluate our method against conventional LSE, we plotted tradeoff curves for noise and bias. In addition, the overall SNR and spatial noise were calculated and compared. Furthermore, CNR and TBR were also calculated. We also tested our proposed method on patient data (18F-DCFPyL PET scans) to further verify clinical applicability. Significantly improved general image quality performance was verified in microparametric images (e.g. noise-bias performance). The overall visibility and tumor detectability were also improved. Finally, for our patient studies, improved overall visibility and tumor detectability were demonstrated in micoparametric images, compared to use of conventional parameter estimation. △ Less

Submitted 13 May, 2024; v1 submitted 15 April, 2024; originally announced April 2024.

A slice classification neural network for automated classification of axial PET/CT slices from a multi-centric lymphoma dataset

Authors: Shadab Ahamed, Yixi Xu, Ingrid Bloise, Joo H. O, Carlos F. Uribe, Rahul Dodhia, Juan L. Ferres, Arman Rahmim

Abstract: Automated slice classification is clinically relevant since it can be incorporated into medical image segmentation workflows as a preprocessing step that would flag slices with a higher probability of containing tumors, thereby directing physicians attention to the important slices. In this work, we train a ResNet-18 network to classify axial slices of lymphoma PET/CT images (collected from two in… ▽ More Automated slice classification is clinically relevant since it can be incorporated into medical image segmentation workflows as a preprocessing step that would flag slices with a higher probability of containing tumors, thereby directing physicians attention to the important slices. In this work, we train a ResNet-18 network to classify axial slices of lymphoma PET/CT images (collected from two institutions) depending on whether the slice intercepted a tumor (positive slice) in the 3D image or if the slice did not (negative slice). Various instances of the network were trained on 2D axial datasets created in different ways: (i) slice-level split and (ii) patient-level split; inputs of different types were used: (i) only PET slices and (ii) concatenated PET and CT slices; and different training strategies were employed: (i) center-aware (CAW) and (ii) center-agnostic (CAG). Model performances were compared using the area under the receiver operating characteristic curve (AUROC) and the area under the precision-recall curve (AUPRC), and various binary classification metrics. We observe and describe a performance overestimation in the case of slice-level split as compared to the patient-level split training. The model trained using patient-level split data with the network input containing only PET slices in the CAG training regime was the best performing/generalizing model on a majority of metrics. Our models were additionally more closely compared using the sensitivity metric on the positive slices from their respective test sets. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: 10 pages, 6 figures, 2 tables

Journal ref: Proc. SPIE 12464, Medical Imaging 2023: Image Processing, 124641Q (3 April 2023)

A cascaded deep network for automated tumor detection and segmentation in clinical PET imaging of diffuse large B-cell lymphoma

Authors: Shadab Ahamed, Natalia Dubljevic, Ingrid Bloise, Claire Gowdy, Patrick Martineau, Don Wilson, Carlos F. Uribe, Arman Rahmim, Fereshteh Yousefirizi

Abstract: Accurate detection and segmentation of diffuse large B-cell lymphoma (DLBCL) from PET images has important implications for estimation of total metabolic tumor volume, radiomics analysis, surgical intervention and radiotherapy. Manual segmentation of tumors in whole-body PET images is time-consuming, labor-intensive and operator-dependent. In this work, we develop and validate a fast and efficient… ▽ More Accurate detection and segmentation of diffuse large B-cell lymphoma (DLBCL) from PET images has important implications for estimation of total metabolic tumor volume, radiomics analysis, surgical intervention and radiotherapy. Manual segmentation of tumors in whole-body PET images is time-consuming, labor-intensive and operator-dependent. In this work, we develop and validate a fast and efficient three-step cascaded deep learning model for automated detection and segmentation of DLBCL tumors from PET images. As compared to a single end-to-end network for segmentation of tumors in whole-body PET images, our three-step model is more effective (improves 3D Dice score from 58.9% to 78.1%) since each of its specialized modules, namely the slice classifier, the tumor detector and the tumor segmentor, can be trained independently to a high degree of skill to carry out a specific task, rather than a single network with suboptimal performance on overall segmentation. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: 8 pages, 3 figures, 3 tables

Journal ref: Proc. SPIE 12032, Medical Imaging 2022: Image Processing, 120323M (4 April 2022)

Investigating heterogeneous PSMA ligand uptake inside parotid glands

Authors: Caleb Sample, Carlos Uribe, Arman Rahmim, François Bénard, Jonn Wu, Haley Clark

Abstract: The purpose was to investigate the spatial heterogeneity of prostate-specific membrane antigen (PSMA) positron emission tomography (PET) uptake within parotid glands. We aim to quantify patterns in well-defined regions to facilitate further investigations. Furthermore, we investigate whether uptake is correlated with computed tomography (CT) texture features. Parotid glands from [18F]DCFPyL PSMA P… ▽ More The purpose was to investigate the spatial heterogeneity of prostate-specific membrane antigen (PSMA) positron emission tomography (PET) uptake within parotid glands. We aim to quantify patterns in well-defined regions to facilitate further investigations. Furthermore, we investigate whether uptake is correlated with computed tomography (CT) texture features. Parotid glands from [18F]DCFPyL PSMA PET/CT images of 30 prostate cancer patients were analyzed. Thresholding was used to define high-uptake regions, and uptake statistics were computed within various divisions. Spearman's rank correlation coefficient was calculated between PSMA PET uptake and the Grey Level Run Length Matrix (GLRLM) using a long and short run length emphasis (GLRLML and GLRLMS) in subregions of parotid glands. PSMA PET uptake was significantly higher (p < 0.001) in lateral/posterior regions of the glands than anterior/medial regions. Maximum uptake was found in the lateral half of parotid glands in 50 out of 60 glands. The difference in SUV between parotid halves is greatest when parotids are divided by a plane separating the anterior/medial and posterior/lateral halves symmetrically. PSMA PET uptake was significantly correlated with CT GLRLML (p < 0.001), and anti-correlated with CT GLRLMS (p < 0.001). Uptake of PSMA PET is heterogeneous within parotid glands, with uptake biased towards lateral and posterior regions. Uptake patterns within parotid glands were found to be strongly correlated with CT texture features, suggesting the possible future use of CT texture features as a proxy for inferring PSMA PET uptake in salivary glands. △ Less

Submitted 4 January, 2024; originally announced January 2024.

Journal ref: Physica Medica: European Journal of Medical Physics, 2024

Observer study-based evaluation of TGAN architecture used to generate oncological PET images

Authors: Roberto Fedrigo, Fereshteh Yousefirizi, Zi** Liu, Abhinav K. Jha, Robert V. Bergen, Jean-Francois Rajotte, Raymond T. Ng, Ingrid Bloise, Sara Harsini, Dan J. Kadrmas, Carlos Uribe, Arman Rahmim

Abstract: The application of computer-vision algorithms in medical imaging has increased rapidly in recent years. However, algorithm training is challenging due to limited sample sizes, lack of labeled samples, as well as privacy concerns regarding data sharing. To address these issues, we previously developed (Bergen et al. 2022) a synthetic PET dataset for Head and Neck (H and N) cancer using the temporal… ▽ More The application of computer-vision algorithms in medical imaging has increased rapidly in recent years. However, algorithm training is challenging due to limited sample sizes, lack of labeled samples, as well as privacy concerns regarding data sharing. To address these issues, we previously developed (Bergen et al. 2022) a synthetic PET dataset for Head and Neck (H and N) cancer using the temporal generative adversarial network (TGAN) architecture and evaluated its performance segmenting lesions and identifying radiomics features in synthesized images. In this work, a two-alternative forced-choice (2AFC) observer study was performed to quantitatively evaluate the ability of human observers to distinguish between real and synthesized oncological PET images. In the study eight trained readers, including two board-certified nuclear medicine physicians, read 170 real/synthetic image pairs presented as 2D-transaxial using a dedicated web app. For each image pair, the observer was asked to identify the real image and input their confidence level with a 5-point Likert scale. P-values were computed using the binomial test and Wilcoxon signed-rank test. A heat map was used to compare the response accuracy distribution for the signed-rank test. Response accuracy for all observers ranged from 36.2% [27.9-44.4] to 63.1% [54.8-71.3]. Six out of eight observers did not identify the real image with statistical significance, indicating that the synthetic dataset was reasonably representative of oncological PET images. Overall, this study adds validity to the realism of our simulated H&N cancer dataset, which may be implemented in the future to train AI algorithms while favoring patient confidentiality and privacy protection. △ Less

Submitted 27 November, 2023; v1 submitted 27 November, 2023; originally announced November 2023.

PSMA PET/CT as a predictive tool for sub-regional importance estimates in the parotid gland

Authors: Caleb Sample, Arman Rahmim, François Bénard, Jonn Wu, Haley Clark

Abstract: Xerostomia and radiation-induced salivary gland dysfunction remain a common side effect for head-and-neck radiotherapy patients, and attempts have been made to quantify the heterogeneous dose response within parotid glands. Here several models of parotid gland subregional importance are compared with prostate specific membrane antigen (PSMA) positron emission tomography (PET) uptake. PSMA ligands… ▽ More Xerostomia and radiation-induced salivary gland dysfunction remain a common side effect for head-and-neck radiotherapy patients, and attempts have been made to quantify the heterogeneous dose response within parotid glands. Here several models of parotid gland subregional importance are compared with prostate specific membrane antigen (PSMA) positron emission tomography (PET) uptake. PSMA ligands show high concentrations in salivary glands, whose uptake has been previously found to relate to gland functionality. We develop a predictive model for relative importance estimates using PSMA PET and CT radiomic features, and demonstrate a methodology for predicting patient-specific importance deviations from the population. Intra-parotid gland uptake was compared with four regional importance models using 30 [18F]DCFPyL PSMA PET images. A radiomics-based predictive model of population importance was developed using a double cross-validation methodology. Population importance estimates were supplemented using patient-specific radiomic features. Anticorrelative relationships were found to exist between PSMA PET uptake and four independent models of subregional parotid gland importance from the literature. Kernel Ridge Regression with principal component analysis feature selection performed best over test sets (MAE = 0.08), with GLCM features being particularly important. Deblurring PSMA PET images strengthened correlations and improved model performance. This study suggests that regions of relatively low PSMA PET concentration in parotid glands may exhibit relatively high dose-sensitivity. We've demonstrated the utility of PSMA PET radiomic features for predicting relative importance within the parotid glands. PSMA PET appears promising for analyzing salivary gland functionality. △ Less

Submitted 4 January, 2024; v1 submitted 17 September, 2023; originally announced September 2023.

Comments: 9 Figures, 7 Tables

PyTomography: A Python Library for Quantitative Medical Image Reconstruction

Authors: Lucas Polson, Roberto Fedrigo, Chenguang Li, Maziar Sabouri, Obed Dzikunu, Shadab Ahamed, Nikolaos Karakatsanis, Arman Rahmim, Carlos Uribe

Abstract: There is a need for open-source libraries in emission tomography that (i) use modern and popular backend code to encourage community contributions and (ii) offer support for the multitude of reconstruction algorithms available in recent literature, such as those that employ artificial intelligence. The purpose of this research was to create and evaluate a GPU-accelerated, open-source, and user-fri… ▽ More There is a need for open-source libraries in emission tomography that (i) use modern and popular backend code to encourage community contributions and (ii) offer support for the multitude of reconstruction algorithms available in recent literature, such as those that employ artificial intelligence. The purpose of this research was to create and evaluate a GPU-accelerated, open-source, and user-friendly image reconstruction library, designed to serve as a central platform for the development, validation, and deployment of various tomographic reconstruction algorithms. PyTomography was developed using Python and inherits the GPU-accelerated functionality of PyTorch and parallelproj for fast computations. Its flexible and modular design decouples system matrices, likelihoods, and reconstruction algorithms, simplifying the process of integrating new imaging modalities using various python tools. Example use cases demonstrate the software capabilities in parallel hole SPECT and listmode PET imaging. Overall, we have developed and publicly share PyTomography, a highly optimized and user-friendly software for medical image reconstruction, with a class hierarchy that fosters the development of novel imaging applications. △ Less

Submitted 7 July, 2024; v1 submitted 5 September, 2023; originally announced September 2023.

Comments: 27 pages, 7 figures

Neural blind deconvolution for deblurring and supersampling PSMA PET

Authors: Caleb Sample, Arman Rahmim, Carlos Uribe, François Bénard, Jonn Wu, Roberto Fedrigo, Haley Clark

Abstract: Objective: To simultaneously deblur and supersample prostate specific membrane antigen (PSMA) positron emission tomography (PET) images using neural blind deconvolution. Approach: Blind deconvolution is a method of estimating the hypothetical "deblurred" image along with the blur kernel (related to the point spread function) simultaneously. Traditional \textit{maximum a posteriori} blind deconvolu… ▽ More Objective: To simultaneously deblur and supersample prostate specific membrane antigen (PSMA) positron emission tomography (PET) images using neural blind deconvolution. Approach: Blind deconvolution is a method of estimating the hypothetical "deblurred" image along with the blur kernel (related to the point spread function) simultaneously. Traditional \textit{maximum a posteriori} blind deconvolution methods require stringent assumptions and suffer from convergence to a trivial solution. A method of modelling the deblurred image and kernel with independent neural networks, called "neural blind deconvolution" had demonstrated success for deblurring 2D natural images in 2020. In this work, we adapt neural blind deconvolution for PVE correction of PSMA PET images with simultaneous supersampling. We compare this methodology with several interpolation methods, using blind image quality metrics, and test the model's ability to predict kernels by re-running the model after applying artificial "pseudokernels" to deblurred images. The methodology was tested on a retrospective set of 30 prostate patients as well as phantom images containing spherical lesions of various volumes. Results: Neural blind deconvolution led to improvements in image quality over other interpolation methods in terms of blind image quality metrics, recovery coefficients, and visual assessment. Predicted kernels were similar between patients, and the model accurately predicted several artificially-applied pseudokernels. Localization of activity in phantom spheres was improved after deblurring, allowing small lesions to be more accurately defined. Significance: The intrinsically low spatial resolution of PSMA PET leads to PVEs which negatively impact uptake quantification in small regions. The proposed method can be used to mitigate this issue, and can be straightforwardly adapted for other imaging modalities. △ Less

Submitted 2 March, 2024; v1 submitted 1 September, 2023; originally announced September 2023.

Comments: 10 Figures, 4 Tables, 19 pages

$^{177}$Lu SPECT Imaging in the Presence of $^{90}$Y: Does $^{90}$Y Degrade Image Quantification? A Simulation Study

Authors: Cassandra Miller, Carlos Uribe, Xinchi Hou, Arman Rahmim, Anna Celler

Abstract: This work aims to investigate the accuracy of quantitative SPECT imaging of $^{177}$Lu in the presence of $^{90}$Y, which occurs in dual-isotope radiopharmaceutical therapy (RPT) involving both isotopes. We used the GATE Monte Carlo simulation toolkit to conduct a phantom study, simulating spheres filled with $^{177}$Lu and $^{90}$Y placed in a cylindrical water phantom that was also filled with a… ▽ More This work aims to investigate the accuracy of quantitative SPECT imaging of $^{177}$Lu in the presence of $^{90}$Y, which occurs in dual-isotope radiopharmaceutical therapy (RPT) involving both isotopes. We used the GATE Monte Carlo simulation toolkit to conduct a phantom study, simulating spheres filled with $^{177}$Lu and $^{90}$Y placed in a cylindrical water phantom that was also filled with activity of both radionuclides. We simulated multiple phantom configurations and activity combinations by varying the location of the spheres, the concentrations of $^{177}$Lu and $^{90}$Y in the spheres, and the amount of background activity. We investigated two different scatter window widths to be used with triple energy window (TEW) scatter correction. We also created multiple realizations of each configuration to improve our assessment, leading to a total of 540 simulations. Each configuration was imaged using a simulated Siemens SPECT camera. The projections were reconstructed using the standard 3D OSEM algorithm, and errors associated with $^{177}$Lu activity quantification and contrast-to-noise ratios (CNRs) were determined. In all configurations, the quantification error was within $\pm$6% of the no-$^{90}$Y case, and we found that quantitative accuracy may slightly improve when $^{90}$Y is present because of reduction of errors associated with TEW scatter correction. The CNRs were not significantly impacted by the presence of $^{90}$Y, but they were increased when a wider scatter window width was used for TEW scatter correction. The width of the scatter windows made a small but statistically significant difference of 1-2% on the recovered $^{177}$Lu activity. Based on these results, we can conclude that activity quantification of $^{177}$Lu and lesion detectability is not degraded by the presence of $^{90}$Y. △ Less

Submitted 25 January, 2023; originally announced January 2023.

Comments: 16 pages, 7 figures, submitted to Biomedical Physics and Engineering Express

Semi-supervised learning towards automated segmentation of PET images with limited annotations: Application to lymphoma patients

Authors: Fereshteh Yousefirizi, Isaac Shiri, Joo Hyun O, Ingrid Bloise, Patrick Martineau, Don Wilson, François Bénard, Laurie H. Sehn, Kerry J. Savage, Habib Zaidi, Carlos F. Uribe, Arman Rahmim

Abstract: The time-consuming task of manual segmentation challenges routine systematic quantification of disease burden. Convolutional neural networks (CNNs) hold significant promise to reliably identify locations and boundaries of tumors from PET scans. We aimed to leverage the need for annotated data via semi-supervised approaches, with application to PET images of diffuse large B-cell lymphoma (DLBCL) an… ▽ More The time-consuming task of manual segmentation challenges routine systematic quantification of disease burden. Convolutional neural networks (CNNs) hold significant promise to reliably identify locations and boundaries of tumors from PET scans. We aimed to leverage the need for annotated data via semi-supervised approaches, with application to PET images of diffuse large B-cell lymphoma (DLBCL) and primary mediastinal large B-cell lymphoma (PMBCL). We analyzed 18F-FDG PET images of 292 patients with PMBCL (n=104) and DLBCL (n=188) (n=232 for training and validation, and n=60 for external testing). We employed FCM and MS losses for training a 3D U-Net with different levels of supervision: i) fully supervised methods with labeled FCM (LFCM) as well as Unified focal and Dice loss functions, ii) unsupervised methods with Robust FCM (RFCM) and Mumford-Shah (MS) loss functions, and iii) Semi-supervised methods based on FCM (RFCM+LFCM), as well as MS loss in combination with supervised Dice loss (MS+Dice). Unified loss function yielded higher Dice score (mean +/- standard deviation (SD)) (0.73 +/- 0.03; 95% CI, 0.67-0.8) compared to Dice loss (p-value<0.01). Semi-supervised (RFCM+alpha*LFCM) with alpha=0.3 showed the best performance, with a Dice score of 0.69 +/- 0.03 (95% CI, 0.45-0.77) outperforming (MS+alpha*Dice) for any supervision level (any alpha) (p<0.01). The best performer among (MS+alpha*Dice) semi-supervised approaches with alpha=0.2 showed a Dice score of 0.60 +/- 0.08 (95% CI, 0.44-0.76) compared to another supervision level in this semi-supervised approach (p<0.01). Semi-supervised learning via FCM loss (RFCM+alpha*LFCM) showed improved performance compared to supervised approaches. Considering the time-consuming nature of expert manual delineations and intra-observer variabilities, semi-supervised approaches have significant potential for automated segmentation workflows. △ Less

Submitted 25 March, 2024; v1 submitted 19 December, 2022; originally announced December 2022.

Issues and Challenges in Applications of Artificial Intelligence to Nuclear Medicine -- The Bethesda Report (AI Summit 2022)

Authors: Arman Rahmim, Tyler J. Bradshaw, Irène Buvat, Joyita Dutta, Abhinav K. Jha, Paul E. Kinahan, Quanzheng Li, Chi Liu, Melissa D. McCradden, Babak Saboury, Eliot Siegel, John J. Sunderland, Richard L. Wahl

Abstract: The SNMMI Artificial Intelligence (SNMMI-AI) Summit, organized by the SNMMI AI Task Force, took place in Bethesda, MD on March 21-22, 2022. It brought together various community members and stakeholders from academia, healthcare, industry, patient representatives, and government (NIH, FDA), and considered various key themes to envision and facilitate a bright future for routine, trustworthy use of… ▽ More The SNMMI Artificial Intelligence (SNMMI-AI) Summit, organized by the SNMMI AI Task Force, took place in Bethesda, MD on March 21-22, 2022. It brought together various community members and stakeholders from academia, healthcare, industry, patient representatives, and government (NIH, FDA), and considered various key themes to envision and facilitate a bright future for routine, trustworthy use of AI in nuclear medicine. In what follows, essential issues, challenges, controversies and findings emphasized in the meeting are summarized. △ Less

Submitted 7 November, 2022; originally announced November 2022.

Convolutional neural network with a hybrid loss function for fully automated segmentation of lymphoma lesions in FDG PET images

Authors: Fereshteh Yousefirizi, Natalia Dubljevic, Shadab Ahamed, Ingrid Bloise, Claire Gowdy, Joo Hyun O, Youssef Farag, Rodrigue de Schaetzen, Patrick Martineau, Don Wilson, Carlos F. Uribe, Arman Rahmim

Abstract: Segmentation of lymphoma lesions is challenging due to their varied sizes and locations in whole-body PET scans. This work presents a fully-automated segmentation technique using a multi-center dataset of diffuse large B-cell lymphoma (DLBCL) with heterogeneous characteristics. We utilized a dataset of [18F]FDG-PET scans (n=194) from two different imaging centers, including cases with primary medi… ▽ More Segmentation of lymphoma lesions is challenging due to their varied sizes and locations in whole-body PET scans. This work presents a fully-automated segmentation technique using a multi-center dataset of diffuse large B-cell lymphoma (DLBCL) with heterogeneous characteristics. We utilized a dataset of [18F]FDG-PET scans (n=194) from two different imaging centers, including cases with primary mediastinal large B-cell lymphoma (PMBCL) (n=104). Automated brain and bladder removal approaches were utilized as preprocessing steps to tackle false positives caused by normal hypermetabolic uptake in these organs. Our segmentation model is a convolutional neural network (CNN) based on a 3D U-Net architecture that includes squeeze and excitation (SE) modules. Hybrid distribution, region, and boundary-based losses (Unified Focal and Mumford-Shah (MS)) were utilized that showed the best performance compared to other combinations (p<0.05). Cross-validation between different centers, DLBCL and PMBCL cases, and three random splits were applied on train/validation data. The ensemble of these six models achieved a Dice similarity coefficient (DSC) of 0.77 +- 0.08 and Hausdorff distance (HD) of 16.5 +-12.5. Our 3D U-net model with SE modules for segmentation with hybrid loss performed significantly better (p<0.05) as compared to the 3D U-Net (without SE modules) using the same loss function (Unified Focal and MS loss) (DSC= 0.64 +-0.21 and HD= 26.3 +- 18.7). Our model can facilitate a fully automated quantification pipeline in a multi-center context that opens the possibility for routine reporting of total metabolic tumor volume (TMTV) and other metrics shown useful for the management of lymphoma. △ Less

Submitted 10 August, 2022; v1 submitted 30 July, 2022; originally announced August 2022.

Tensor Radiomics: Paradigm for Systematic Incorporation of Multi-Flavoured Radiomics Features

Authors: Arman Rahmim, Amirhosein Toosi, Mohammad R. Salmanpour, Natalia Dubljevic, Ian Janzen, Isaac Shiri, Ren Yuan, Cheryl Ho, Habib Zaidi, Calum MacAulay, Carlos Uribe, Fereshteh Yousefirizi

Abstract: Radiomics features extract quantitative information from medical images, towards the derivation of biomarkers for clinical tasks, such as diagnosis, prognosis, or treatment response assessment. Different image discretization parameters (e.g. bin number or size), convolutional filters, segmentation perturbation, or multi-modality fusion levels can be used to generate radiomics features and ultimate… ▽ More Radiomics features extract quantitative information from medical images, towards the derivation of biomarkers for clinical tasks, such as diagnosis, prognosis, or treatment response assessment. Different image discretization parameters (e.g. bin number or size), convolutional filters, segmentation perturbation, or multi-modality fusion levels can be used to generate radiomics features and ultimately signatures. Commonly, only one set of parameters is used; resulting in only one value or flavour for a given RF. We propose tensor radiomics (TR) where tensors of features calculated with multiple combinations of parameters (i.e. flavours) are utilized to optimize the construction of radiomics signatures. We present examples of TR as applied to PET/CT, MRI, and CT imaging invoking machine learning or deep learning solutions, and reproducibility analyses: (1) TR via varying bin sizes on CT images of lung cancer and PET-CT images of head & neck cancer (HNC) for overall survival prediction. A hybrid deep neural network, referred to as TR-Net, along with two ML-based flavour fusion methods showed improved accuracy compared to regular rediomics features. (2) TR built from different segmentation perturbations and different bin sizes for classification of late-stage lung cancer response to first-line immunotherapy using CT images. TR improved predicted patient responses. (3) TR via multi-flavour generated radiomics features in MR imaging showed improved reproducibility when compared to many single-flavour features. (4) TR via multiple PET/CT fusions in HNC. Flavours were built from different fusions using methods, such as Laplacian pyramids and wavelet transforms. TR improved overall survival prediction. Our results suggest that the proposed TR paradigm has the potential to improve performance capabilities in different medical imaging tasks. △ Less

Submitted 24 October, 2022; v1 submitted 11 March, 2022; originally announced March 2022.

Segmentation and Risk Score Prediction of Head and Neck Cancers in PET/CT Volumes with 3D U-Net and Cox Proportional Hazard Neural Networks

Authors: Fereshteh Yousefirizi, Ian Janzen, Natalia Dubljevic, Yueh-En Liu, Chloe Hill, Calum MacAulay, Arman Rahmim

Abstract: We utilized a 3D nnU-Net model with residual layers supplemented by squeeze and excitation (SE) normalization for tumor segmentation from PET/CT images provided by the Head and Neck Tumor segmentation chal-lenge (HECKTOR). Our proposed loss function incorporates the Unified Fo-cal and Mumford-Shah losses to take the advantage of distribution, region, and boundary-based loss functions. The results… ▽ More We utilized a 3D nnU-Net model with residual layers supplemented by squeeze and excitation (SE) normalization for tumor segmentation from PET/CT images provided by the Head and Neck Tumor segmentation chal-lenge (HECKTOR). Our proposed loss function incorporates the Unified Fo-cal and Mumford-Shah losses to take the advantage of distribution, region, and boundary-based loss functions. The results of leave-one-out-center-cross-validation performed on different centers showed a segmentation performance of 0.82 average Dice score (DSC) and 3.16 median Hausdorff Distance (HD), and our results on the test set achieved 0.77 DSC and 3.01 HD. Following lesion segmentation, we proposed training a case-control proportional hazard Cox model with an MLP neural net backbone to predict the hazard risk score for each discrete lesion. This hazard risk prediction model (CoxCC) was to be trained on a number of PET/CT radiomic features extracted from the segmented lesions, patient and lesion demographics, and encoder features provided from the penultimate layer of a multi-input 2D PET/CT convolutional neural network tasked with predicting time-to-event for each lesion. A 10-fold cross-validated CoxCC model resulted in a c-index validation score of 0.89, and a c-index score of 0.61 on the HECKTOR challenge test dataset. △ Less

Submitted 15 February, 2022; originally announced February 2022.

3-D PET Image Generation with tumour masks using TGAN

Authors: Robert V Bergen, Jean-Francois Rajotte, Fereshteh Yousefirizi, Ivan S Klyuzhin, Arman Rahmim, Raymond T. Ng

Abstract: Training computer-vision related algorithms on medical images for disease diagnosis or image segmentation is difficult due to the lack of training data, labeled samples, and privacy concerns. For this reason, a robust generative method to create synthetic data is highly sought after. However, most three-dimensional image generators require additional image input or are extremely memory intensive.… ▽ More Training computer-vision related algorithms on medical images for disease diagnosis or image segmentation is difficult due to the lack of training data, labeled samples, and privacy concerns. For this reason, a robust generative method to create synthetic data is highly sought after. However, most three-dimensional image generators require additional image input or are extremely memory intensive. To address these issues we propose adapting video generation techniques for 3-D image generation. Using the temporal GAN (TGAN) architecture, we show we are able to generate realistic head and neck PET images. We also show that by conditioning the generator on tumour masks, we are able to control the geometry and location of the tumour in the generated images. To test the utility of the synthetic images, we train a segmentation model using the synthetic images. Synthetic images conditioned on real tumour masks are automatically segmented, and the corresponding real images are also segmented. We evaluate the segmentations using the Dice score and find the segmentation algorithm performs similarly on both datasets (0.65 synthetic data, 0.70 real data). Various radionomic features are then calculated over the segmented tumour volumes for each data set. A comparison of the real and synthetic feature distributions show that seven of eight feature distributions had statistically insignificant differences (p>0.05). Correlation coefficients were also calculated between all radionomic features and it is shown that all of the strong statistical correlations in the real data set are preserved in the synthetic data set. △ Less

Submitted 2 November, 2021; originally announced November 2021.

AI-Based Detection, Classification and Prediction/Prognosis in Medical Imaging: Towards Radiophenomics

Authors: Fereshteh Yousefirizi, Pierre Decazes, Amine Amyar, Su Ruan, Babak Saboury, Arman Rahmim

Abstract: Artificial intelligence (AI) techniques have significant potential to enable effective, robust and automated image phenoty** including identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification appr… ▽ More Artificial intelligence (AI) techniques have significant potential to enable effective, robust and automated image phenoty** including identification of subtle patterns. AI-based detection searches the image space to find the regions of interest based on patterns and features. There is a spectrum of tumor histologies from benign to malignant that can be identified by AI-based classification approaches using image features. The extraction of minable information from images gives way to the field of radiomics and can be explored via explicit (handcrafted/engineered) and deep radiomics frameworks. Radiomics analysis has the potential to be utilized as a noninvasive technique for the accurate characterization of tumors to improve diagnosis and treatment monitoring. This work reviews AI-based techniques, with a special focus on oncological PET and PET/CT imaging, for different detection, classification, and prediction/prognosis tasks. We also discuss needed efforts to enable the translation of AI techniques to routine clinical workflows, and potential improvements and complementary techniques such as the use of natural language processing on electronic health records and neuro-symbolic AI techniques. △ Less

Submitted 13 January, 2022; v1 submitted 19 October, 2021; originally announced October 2021.

Role of AI in Theranostics: Towards Routine Personalized Radiopharmaceutical Therapies

Authors: Julia Brosch-Lenz, Fereshteh Yousefirizi, Katherine Zukotynski, Jean-Mathieu Beauregard, Vincent Gaudet, Babak Saboury, Arman Rahmim, Carlos Uribe

Abstract: We highlight emerging uses of artificial intelligence (AI) in the field of theranostics, focusing on its significant potential to enable routine and reliable personalization of radiopharmaceutical therapies (RPTs). Personalized RPTs require patient-individual dosimetry calculations accompanying therapy. Image-based dosimetry needs: 1) quantitative imaging; 2) co-registration and organ/tumor identi… ▽ More We highlight emerging uses of artificial intelligence (AI) in the field of theranostics, focusing on its significant potential to enable routine and reliable personalization of radiopharmaceutical therapies (RPTs). Personalized RPTs require patient-individual dosimetry calculations accompanying therapy. Image-based dosimetry needs: 1) quantitative imaging; 2) co-registration and organ/tumor identification on serial and multimodality images; 3) determination of the time-integrated activity; and 4) absorbed dose determination. AI models that facilitate these steps are reviewed. Additionally we discuss the potential to exploit biological information from diagnostic and therapeutic molecular images to derive biomarkers for absorbed dose and outcome prediction, towards personalization of therapies. We try to motivate the nuclear medicine community to expand and align efforts into making routine and reliable personalization of RPTs a reality. △ Less

Submitted 31 July, 2021; v1 submitted 29 July, 2021; originally announced July 2021.

Comments: 30 pages, 6 figures, 1 table

Toward High-Throughput Artificial Intelligence-Based Segmentation in Oncological PET Imaging

Authors: Fereshteh Yousefirizi, Abhinav K. Jha, Julia Brosch-Lenz, Babak Saboury, Arman Rahmim

Abstract: Artificial intelligence (AI) techniques for image-based segmentation have garnered much attention in recent years. Convolutional neural networks (CNNs) have shown impressive results and potential towards fully automated segmentation in medical imaging, and particularly PET imaging. To cope with the limited access to annotated data needed in supervised AI methods, given tedious and prone-to-error m… ▽ More Artificial intelligence (AI) techniques for image-based segmentation have garnered much attention in recent years. Convolutional neural networks (CNNs) have shown impressive results and potential towards fully automated segmentation in medical imaging, and particularly PET imaging. To cope with the limited access to annotated data needed in supervised AI methods, given tedious and prone-to-error manual delineations, semi-supervised and unsupervised AI techniques have also been explored for segmentation of tumors or normal organs in single and bi-modality scans. This work provides a review of existing AI techniques for segmentation tasks and the evaluation criteria for translational AI-based segmentation efforts towards routine adoption in clinical workflows. △ Less

Submitted 15 November, 2021; v1 submitted 28 July, 2021; originally announced July 2021.

Comments: This manuscript has been accepted for publication in PET Clinics, Volume 16, Issue 4, 2021

Journal ref: PET Clinics, Volume 16, Issue 4, 2021

Development of the Lymphatic System in the 4D XCAT Phantom

Authors: Roberto Fedrigo, William P. Segars, Patrick Martineau, Claire Gowdy, Ingrid Bloise, Carlos F. Uribe, Arman Rahmim

Abstract: Purpose: The XCAT phantom allows for highly sophisticated multimodality imaging research. It includes a complete set of organs, muscle, bone, soft tissue, while also accounting for age, sex, and body mass index (BMI), which allows phantom studies to be performed at a population scale. At the same time, the XCAT phantom does not currently include the lymphatic system, critical for evaluating bulky… ▽ More Purpose: The XCAT phantom allows for highly sophisticated multimodality imaging research. It includes a complete set of organs, muscle, bone, soft tissue, while also accounting for age, sex, and body mass index (BMI), which allows phantom studies to be performed at a population scale. At the same time, the XCAT phantom does not currently include the lymphatic system, critical for evaluating bulky nodal malignancies in lymphoma. We aimed to incorporate a full lymphatic system into the XCAT phantom and to generate realistic simulated images via guidance from lymphoma patient studies. Methods: A template lymphatic system was extended based on known anatomy was used to define 276 lymph nodes and corresponding vessels using non-uniform rational basis spline (NURBS) surfaces. Lymph node properties were modified using the Rhinoceros 3D viewing software. The XCAT general parameter script was used to input organ concentrations and generate binary files with uptake and attenuation information. Results: Lymph nodes can be scaled, stretched, and translated within the intuitive Rhinoceros interface, to allow for realistic simulation of different lymph node pathologies. Bulky, heterogeneous PMBCL tumours were generated in the mediastinum using expanded lymph nodes. Our results suggest that optimized thresholding provides better accuracy for determining total metabolic tumour volume (TMTV) of PMBCL tumours, while the gradient method was most accurate for total lesion glycolysis (TLG). Conclusions: An upgraded XCAT phantom with a fully simulated lymphatic system was created. Distributed to the research community, the XCAT phantom with the new lymphatic system has the potential of enabling studies to optimize image quality and quantitation, towards improved assessment of lymphoma including predictive modeling (e.g. improved TMTV and radiomics research). △ Less

Submitted 2 August, 2021; v1 submitted 23 July, 2021; originally announced July 2021.

Comments: 27 pages, 9 figures, 2 tables, 4 supplemental figures

Objective task-based evaluation of artificial intelligence-based medical imaging methods: Framework, strategies and role of the physician

Authors: Abhinav K. Jha, Kyle J. Myers, Nancy A. Obuchowski, Zi** Liu, Md Ashequr Rahman, Babak Saboury, Arman Rahmim, Barry A. Siegel

Abstract: Artificial intelligence (AI)-based methods are showing promise in multiple medical-imaging applications. Thus, there is substantial interest in clinical translation of these methods, requiring in turn, that they be evaluated rigorously. In this paper, our goal is to lay out a framework for objective task-based evaluation of AI methods. We will also provide a list of tools available in the literatu… ▽ More Artificial intelligence (AI)-based methods are showing promise in multiple medical-imaging applications. Thus, there is substantial interest in clinical translation of these methods, requiring in turn, that they be evaluated rigorously. In this paper, our goal is to lay out a framework for objective task-based evaluation of AI methods. We will also provide a list of tools available in the literature to conduct this evaluation. Further, we outline the important role of physicians in conducting these evaluation studies. The examples in this paper will be proposed in the context of PET with a focus on neural-network-based methods. However, the framework is also applicable to evaluate other medical-imaging modalities and other types of AI methods. △ Less

Submitted 20 July, 2021; v1 submitted 9 July, 2021; originally announced July 2021.

A Physics-Guided Modular Deep-Learning Based Automated Framework for Tumor Segmentation in PET Images

Authors: Kevin H. Leung, Wael Marashdeh, Rick Wray, Saeed Ashrafinia, Martin G. Pomper, Arman Rahmim, Abhinav K. Jha

Abstract: The objective of this study was to develop a PET tumor-segmentation framework that addresses the challenges of limited spatial resolution, high image noise, and lack of clinical training data with ground-truth tumor boundaries in PET imaging. We propose a three-module PET-segmentation framework in the context of segmenting primary tumors in 3D FDG-PET images of patients with lung cancer on a per-s… ▽ More The objective of this study was to develop a PET tumor-segmentation framework that addresses the challenges of limited spatial resolution, high image noise, and lack of clinical training data with ground-truth tumor boundaries in PET imaging. We propose a three-module PET-segmentation framework in the context of segmenting primary tumors in 3D FDG-PET images of patients with lung cancer on a per-slice basis. The first module generates PET images containing highly realistic tumors with known ground-truth using a new stochastic and physics-based approach, addressing lack of training data. The second module trains a modified U-net using these images, hel** it learn the tumor-segmentation task. The third module fine-tunes this network using a small-sized clinical dataset with radiologist-defined delineations as surrogate ground-truth, hel** the framework learn features potentially missed in simulated tumors. The framework's accuracy, generalizability to different scanners, sensitivity to partial volume effects (PVEs) and efficacy in reducing the number of training images were quantitatively evaluated using Dice similarity coefficient (DSC) and several other metrics. The framework yielded reliable performance in both simulated (DSC: 0.87 (95% CI: 0.86, 0.88)) and patient images (DSC: 0.73 (95% CI: 0.71, 0.76)), outperformed several widely used semi-automated approaches, accurately segmented relatively small tumors (smallest segmented cross-section was 1.83 cm2), generalized across five PET scanners (DSC: 0.74), was relatively unaffected by PVEs, and required low training data (training with data from even 30 patients yielded DSC of 0.70). In conclusion, the proposed framework demonstrated the ability for reliable automated tumor delineation in FDG-PET images of patients with lung cancer. △ Less

Submitted 18 February, 2020; originally announced February 2020.

Next Generation Radiogenomics Sequencing for Prediction of EGFR and KRAS Mutation Status in NSCLC Patients Using Multimodal Imaging and Machine Learning Approaches

Authors: Isaac Shiri, Hassan Maleki, Ghasem Hajianfar, Hamid Abdollahi, Saeed Ashrafinia, Mathieu Hatt, Mehrdad Oveisi, Arman Rahmim

Abstract: Aim: In the present work, we aimed to evaluate a comprehensive radiomics framework that enabled prediction of EGFR and KRAS mutation status in NSCLC cancer patients based on PET and CT multi-modalities radiomic features and machine learning (ML) algorithms. Methods: Our study involved 211 NSCLC cancer patient with PET and CTD images. More than twenty thousand radiomic features from different image… ▽ More Aim: In the present work, we aimed to evaluate a comprehensive radiomics framework that enabled prediction of EGFR and KRAS mutation status in NSCLC cancer patients based on PET and CT multi-modalities radiomic features and machine learning (ML) algorithms. Methods: Our study involved 211 NSCLC cancer patient with PET and CTD images. More than twenty thousand radiomic features from different image-feature sets were extracted Feature value was normalized to obtain Z-scores, followed by student t-test students for comparison, high correlated features were eliminated and the False discovery rate (FDR) correction were performed Six feature selection methods and twelve classifiers were used to predict gene status in patient and model evaluation was reported on independent validation sets (68 patients). Results: The best predictive power of conventional PET parameters was achieved by SUVpeak (AUC: 0.69, P-value = 0.0002) and MTV (AUC: 0.55, P-value = 0.0011) for EGFR and KRAS, respectively. Univariate analysis of radiomics features improved prediction power up to AUC: 75 (q-value: 0.003, Short Run Emphasis feature of GLRLM from LOG preprocessed image of PET with sigma value 1.5) and AUC: 0.71 (q-value 0.00005, The Large Dependence Low Gray Level Emphasis from GLDM in LOG preprocessed image of CTD sigma value 5) for EGFR and KRAS, respectively. Furthermore, the machine learning algorithm improved the perdition power up to AUC: 0.82 for EGFR (LOG preprocessed of PET image set with sigma 3 with VT feature selector and SGD classifier) and AUC: 0.83 for KRAS (CT image set with sigma 3.5 with SM feature selector and SGD classifier). Conclusion: We demonstrated that radiomic features extracted from different image-feature sets could be used for EGFR and KRAS mutation status prediction in NSCLC patients, and showed that they have more predictive power than conventional imaging parameters. △ Less

Submitted 3 July, 2019; originally announced July 2019.

Comments: 42 pages,3 Figures,4 Tables, 13 Supplemental Figures, 11 Supplemental Tables

PET/CT Radiomic Sequencer for Prediction of EGFR and KRAS Mutation Status in NSCLC Patients

Authors: Isaac Shiri, Hassan Maleki, Ghasem Hajianfar, Hamid Abdollahi, Saeed Ashrafinia, Mathieu Hatt, Mehrdad Oveisi, Arman Rahmim

Abstract: The aim of this study was to develop radiomic models using PET/CT radiomic features with different machine learning approaches for finding best predictive epidermal growth factor receptor (EGFR) and Kirsten rat sarcoma viral oncogene (KRAS) mutation status. Patients images including PET and CT [diagnostic (CTD) and low dose CT (CTA)] were pre-processed using wavelet (WAV), Laplacian of Gaussian (L… ▽ More The aim of this study was to develop radiomic models using PET/CT radiomic features with different machine learning approaches for finding best predictive epidermal growth factor receptor (EGFR) and Kirsten rat sarcoma viral oncogene (KRAS) mutation status. Patients images including PET and CT [diagnostic (CTD) and low dose CT (CTA)] were pre-processed using wavelet (WAV), Laplacian of Gaussian (LOG) and 64 bin discretization (BIN) (alone or in combinations) and several features from images were extracted. The prediction performance of model was checked using the area under the receiver operator characteristic (ROC) curve (AUC). Results showed a wide range of radiomic model AUC performances up to 0.75 in prediction of EGFR and KRAS mutation status. Combination of K-Best and variance threshold feature selector with logistic regression (LREG) classifier in diagnostic CT scan led to the best performance in EGFR (CTD-BIN+B-KB+LREG, AUC: mean 0.75 sd 0.10) and KRAS (CTD-BIN-LOG-WAV+B-VT+LREG, AUC: mean 0.75 sd 0.07) respectively. Additionally, incorporating PET, kept AUC values at ~0.74. When considering conventional features only, highest predictive performance was achieved by PET SUVpeak (AUC: 0.69) for EGFR and by PET MTV (AUC: 0.55) for KRAS. In comparison with conventional PET parameters such as standard uptake value, radiomic models were found as more predictive. Our findings demonstrated that non-invasive and reliable radiomics analysis can be successfully used to predict EGFR and KRAS mutation status in NSCLC patients. △ Less

Submitted 15 June, 2019; originally announced June 2019.

Application of computational breast phantoms to evaluate reconstruction methods for fluorescence molecular tomography

Authors: Yansong Zhu, Abhinav K. Jha, Arman Rahmim

Abstract: Fluorescence molecular tomography (FMT) has potential of providing high contrast images for breast tumor detection. Computational phantom provides a convenient way to a wide variety of fluorophore distribution configurations in patients and perform comprehensive evaluation of the imaging systems and methods for FMT. In this study, a digital breast phantom was used to compare the performance of a n… ▽ More Fluorescence molecular tomography (FMT) has potential of providing high contrast images for breast tumor detection. Computational phantom provides a convenient way to a wide variety of fluorophore distribution configurations in patients and perform comprehensive evaluation of the imaging systems and methods for FMT. In this study, a digital breast phantom was used to compare the performance of a novel sparsity-based reconstruction method and Tikhonov regularization method for resolving tumors with different amount of separation. The results showed that the proposed sparse reconstruction method yielded better performance. This simulation-based approach with computational phantoms enabled an evaluation of the reconstruction methods for FMT for breast-cancer detection. △ Less

Submitted 29 March, 2018; originally announced March 2018.

Image reconstruction in fluorescence molecular tomography with sparsity-initialized maximum-likelihood expectation maximization

Authors: Yansong Zhu, Abhinav K. Jha, Dean F. Wong, Arman Rahmim

Abstract: We present a reconstruction method involving maximum-likelihood expectation maximization (MLEM) to model Poisson noise as applied to fluorescence molecular tomography (FMT). MLEM is initialized with the output from a sparse reconstruction-based approach, which performs truncated singular value decomposition-based preconditioning followed by fast iterative shrinkage-thresholding algorithm (FISTA) t… ▽ More We present a reconstruction method involving maximum-likelihood expectation maximization (MLEM) to model Poisson noise as applied to fluorescence molecular tomography (FMT). MLEM is initialized with the output from a sparse reconstruction-based approach, which performs truncated singular value decomposition-based preconditioning followed by fast iterative shrinkage-thresholding algorithm (FISTA) to enforce sparsity. The motivation for this approach is that sparsity information could be accounted for within the initialization, while MLEM would accurately model Poisson noise in the FMT system. Simulation experiments show the proposed method significantly improves images qualitatively and quantitatively. The method results in over 20 times faster convergence compared to uniformly initialized MLEM and improves robustness to noise compared to pure sparse reconstruction. We also theoretically justify the ability of the proposed approach to reduce noise in the background region compared to pure sparse reconstruction. Overall, these results provide strong evidence to model Poisson noise in FMT reconstruction and for application of the proposed reconstruction framework to FMT imaging. △ Less

Submitted 30 March, 2018; v1 submitted 29 March, 2018; originally announced March 2018.