Showing 1–4 of 4 results for author: Scholey, J E

Paired Conditional Generative Adversarial Network for Highly Accelerated Liver 4D MRI

Authors: Di Xu, Xin Miao, Hengjie Liu, Jessica E. Scholey, Wensha Yang, Mary Feng, Michael Ohliger, Hui Lin, Yi Lao, Yang Yang, Ke Sheng

Abstract: Purpose: 4D MRI with high spatiotemporal resolution is desired for image-guided liver radiotherapy. Acquiring densely sampling k-space data is time-consuming. Accelerated acquisition with sparse samples is desirable but often causes degraded image quality or long reconstruction time. We propose the Reconstruct Paired Conditional Generative Adversarial Network (Re-Con-GAN) to shorten the 4D MRI rec… ▽ More Purpose: 4D MRI with high spatiotemporal resolution is desired for image-guided liver radiotherapy. Acquiring densely sampling k-space data is time-consuming. Accelerated acquisition with sparse samples is desirable but often causes degraded image quality or long reconstruction time. We propose the Reconstruct Paired Conditional Generative Adversarial Network (Re-Con-GAN) to shorten the 4D MRI reconstruction time while maintaining the reconstruction quality. Methods: Patients who underwent free-breathing liver 4D MRI were included in the study. Fully- and retrospectively under-sampled data at 3, 6 and 10 times (3x, 6x and 10x) were first reconstructed using the nuFFT algorithm. Re-Con-GAN then trained input and output in pairs. Three types of networks, ResNet9, UNet and reconstruction swin transformer, were explored as generators. PatchGAN was selected as the discriminator. Re-Con-GAN processed the data (3D+t) as temporal slices (2D+t). A total of 48 patients with 12332 temporal slices were split into training (37 patients with 10721 slices) and test (11 patients with 1611 slices). Results: Re-Con-GAN consistently achieved comparable/better PSNR, SSIM, and RMSE scores compared to CS/UNet models. The inference time of Re-Con-GAN, UNet and CS are 0.15s, 0.16s, and 120s. The GTV detection task showed that Re-Con-GAN and CS, compared to UNet, better improved the dice score (3x Re-Con-GAN 80.98%; 3x CS 80.74%; 3x UNet 79.88%) of unprocessed under-sampled images (3x 69.61%). Conclusion: A generative network with adversarial training is proposed with promising and efficient reconstruction results demonstrated on an in-house dataset. The rapid and qualitative reconstruction of 4D liver MR has the potential to facilitate online adaptive MR-guided radiotherapy for liver cancer. △ Less

Submitted 20 May, 2024; originally announced May 2024.

MRI-based Material Mass Density and Relative Stop** Power Estimation via Deep Learning for Proton Therapy

Authors: Yuan Gao, Chih-Wei Chang, Sagar Mandava, Raanan Marants, Jessica E. Scholey, Matthew Goette, Yang Lei, Hui Mao, Jeffrey D. Bradley, Tian Liu, Jun Zhou, Atchar Sudhyadhom, Xiaofeng Yang

Abstract: Magnetic Resonance Imaging (MRI) is increasingly incorporated into treatment planning, because of its superior soft tissue contrast used for tumor and soft tissue delineation versus computed tomography (CT). However, MRI cannot directly provide mass density or relative stop** power (RSP) maps required for proton radiotherapy dose calculation. To demonstrate the feasibility of MRI-only based mass… ▽ More Magnetic Resonance Imaging (MRI) is increasingly incorporated into treatment planning, because of its superior soft tissue contrast used for tumor and soft tissue delineation versus computed tomography (CT). However, MRI cannot directly provide mass density or relative stop** power (RSP) maps required for proton radiotherapy dose calculation. To demonstrate the feasibility of MRI-only based mass density and RSP estimation using deep learning (DL) for proton radiotherapy. A DL-based framework was developed to discover underlying voxel-wise correlation between MR images and mass density and RSP. Five tissue substitute phantoms including skin, muscle, adipose, 45% hydroxyapatite (HA), and spongiosa bone were customized for MRI scanning based on material composition information from ICRP reports. Two animal tissue phantoms made of pig brain and liver were prepared for DL training. In the phantom study, two DL models were trained: one containing clinical T1 and T2 MRIs and another incorporating zero echo time (ZTE) MRIs as input. In the patient application study, two DL models were trained: one including T1 and T2 MRIs as input, and one incorporating synthetic dual-energy computed tomography (sDECT) images to provide bone tissue information. In the phantom study, DL model based on T1 and T2 MRI demonstrated higher accuracy mass density and RSP estimation in skin, muscle, adipose, brain, and liver with mean absolute percentage errors (MAPE) of 0.42%, 0.14%, 0.19%, 0.78% and 0.26% for mass density and 0.30%, 0.11%, 0.16%, 0.61% and 0.23% for RSP, respectively. DL model incorporating ZTE MRI improved the accuracy of mass density and RSP estimation in 45% HA and spongiosa bone with MAPE at 0.23% and 0.09% for mass density and 0.19% and 0.07% for RSP, respectively. Results show feasibility of MRI-only based mass density and RSP estimation for proton therapy treatment planning using DL method. △ Less

Submitted 11 October, 2022; originally announced October 2022.

Multimodal Imaging-based Material Mass Density Estimation for Proton Therapy Using Physics-Constrained Deep Learning

Authors: Chih-Wei Chang, Raanan Marants, Yuan Gao, Matthew Goette, Jessica E. Scholey, Jeffrey D. Bradley, Tian Liu, Jun Zhou, Atchar Sudhyadhom, Xiaofeng Yang

Abstract: Map** computed tomography (CT) number to material property dominates the proton range uncertainty. This work aims to develop a physics-constrained deep learning-based multimodal imaging (PDMI) framework to integrate physics, deep learning, magnetic resonance imaging (MRI), and advanced dual-energy CT (DECT) to derive accurate patient mass density maps. Seven tissue substitute MRI phantoms were u… ▽ More Map** computed tomography (CT) number to material property dominates the proton range uncertainty. This work aims to develop a physics-constrained deep learning-based multimodal imaging (PDMI) framework to integrate physics, deep learning, magnetic resonance imaging (MRI), and advanced dual-energy CT (DECT) to derive accurate patient mass density maps. Seven tissue substitute MRI phantoms were used for PDMI-based material calibration. The training inputs are from MRI and twin-beam dual-energy images acquired at 120 kVp with gold and tin filters. The feasibility investigation included an empirical DECT correlation and four residual networks (ResNet) derived from different training inputs and strategies by the PDMI framework. PRN-MR-DE and RN-MR-DE denote ResNet trained with and without a physics constraint using MRI and DECT images. PRN-DE and RN-DE represent ResNet trained with and without a physics constraint using DECT-only images. For the tissue surrogate study, PRN-MR-DE, PRN-DE, and RN-MR-DE result in mean mass density errors: -0.72%, 2.62%, -3.58% for adipose; -0.03%, -0.61%, and -0.18% for muscle; -0.58%, -1.36%, and -4.86% for 45% HA bone. The retrospective patient study indicated that PRN-MR-DE predicted the densities of soft tissue and bone within expected intervals based on the literature survey, while PRN-DE generated large density deviations. The proposed PDMI framework can generate accurate mass density maps using MRI and DECT images. The physics-constrained training can further enhance model efficacy, making PRN-MR-DE outperform RN-MR-DE. The patient investigation also shows that the PDMI framework has the potential to improve proton range uncertainty with accurate patient mass density maps. △ Less

Submitted 28 July, 2022; v1 submitted 26 July, 2022; originally announced July 2022.

Physics-driven Deep Learning for PET/MRI

Authors: Abhejit Rajagopal, Andrew P. Leynes, Nicholas Dwork, Jessica E. Scholey, Thomas A. Hope, Peder E. Z. Larson

Abstract: In this paper, we review physics- and data-driven reconstruction techniques for simultaneous positron emission tomography (PET) / magnetic resonance imaging (MRI) systems, which have significant advantages for clinical imaging of cancer, neurological disorders, and heart disease. These reconstruction approaches utilize priors, either structural or statistical, together with a physics-based descrip… ▽ More In this paper, we review physics- and data-driven reconstruction techniques for simultaneous positron emission tomography (PET) / magnetic resonance imaging (MRI) systems, which have significant advantages for clinical imaging of cancer, neurological disorders, and heart disease. These reconstruction approaches utilize priors, either structural or statistical, together with a physics-based description of the PET system response. However, due to the nested representation of the forward problem, direct PET/MRI reconstruction is a nonlinear problem. We elucidate how a multi-faceted approach accommodates hybrid data- and physics-driven machine learning for reconstruction of 3D PET/MRI, summarizing important deep learning developments made in the last 5 years to address attenuation correction, scattering, low photon counts, and data consistency. We also describe how applications of these multi-modality approaches extend beyond PET/MRI to improving accuracy in radiation therapy planning. We conclude by discussing opportunities for extending the current state-of-the-art following the latest trends in physics- and deep learning-based computational imaging and next-generation detector hardware. △ Less

Submitted 11 June, 2022; originally announced June 2022.

Comments: under review