-
Image Reconstruction with B0 Inhomogeneity using an Interpretable Deep Unrolled Network on an Open-bore MRI-Linac
Authors:
Shanshan Shan,
Yang Gao,
David E. J. Waddington,
Hongli Chen,
Brendan Whelan,
Paul Z. Y. Liu,
Yaohui Wang,
Chunyi Liu,
Hong** Gan,
Mingyuan Gao,
Feng Liu
Abstract:
MRI-Linac systems require fast image reconstruction with high geometric fidelity to localize and track tumours for radiotherapy treatments. However, B0 field inhomogeneity distortions and slow MR acquisition potentially limit the quality of the image guidance and tumour treatments. In this study, we develop an interpretable unrolled network, referred to as RebinNet, to reconstruct distortion-free…
▽ More
MRI-Linac systems require fast image reconstruction with high geometric fidelity to localize and track tumours for radiotherapy treatments. However, B0 field inhomogeneity distortions and slow MR acquisition potentially limit the quality of the image guidance and tumour treatments. In this study, we develop an interpretable unrolled network, referred to as RebinNet, to reconstruct distortion-free images from B0 inhomogeneity-corrupted k-space for fast MRI-guided radiotherapy applications. RebinNet includes convolutional neural network (CNN) blocks to perform image regularizations and nonuniform fast Fourier Transform (NUFFT) modules to incorporate B0 inhomogeneity information. The RebinNet was trained on a publicly available MR dataset from eleven healthy volunteers for both fully sampled and subsampled acquisitions. Grid phantom and human brain images acquired from an open-bore 1T MRI-Linac scanner were used to evaluate the performance of the proposed network. The RebinNet was compared with the conventional regularization algorithm and our recently developed UnUNet method in terms of root mean squared error (RMSE), structural similarity (SSIM), residual distortions, and computation time. Imaging results demonstrated that the RebinNet reconstructed images with lowest RMSE (<0.05) and highest SSIM (>0.92) at four-time acceleration for simulated brain images. The RebinNet could better preserve structural details and substantially improve the computational efficiency (ten-fold faster) compared to the conventional regularization methods, and had better generalization ability than the UnUNet method. The proposed RebinNet can achieve rapid image reconstruction and overcome the B0 inhomogeneity distortions simultaneously, which would facilitate accurate and fast image guidance in radiotherapy treatments.
△ Less
Submitted 14 April, 2024;
originally announced April 2024.
-
Distortion-Corrected Image Reconstruction with Deep Learning on an MRI-Linac
Authors:
Shanshan Shan,
Yang Gao,
Paul Z. Y. Liu,
Brendan Whelan,
Hongfu Sun,
Bin Dong,
Feng Liu,
David E. J. Waddington
Abstract:
Magnetic resonance imaging (MRI) is increasingly utilized for image-guided radiotherapy due to its outstanding soft-tissue contrast and lack of ionizing radiation. However, geometric distortions caused by gradient nonlinearity (GNL) limit anatomical accuracy, potentially compromising the quality of tumour treatments. In addition, slow MR acquisition and reconstruction limit the potential for real-…
▽ More
Magnetic resonance imaging (MRI) is increasingly utilized for image-guided radiotherapy due to its outstanding soft-tissue contrast and lack of ionizing radiation. However, geometric distortions caused by gradient nonlinearity (GNL) limit anatomical accuracy, potentially compromising the quality of tumour treatments. In addition, slow MR acquisition and reconstruction limit the potential for real-time image guidance. Here, we demonstrate a deep learning-based method that rapidly reconstructs distortion-corrected images from raw k-space data for real-time MR-guided radiotherapy applications. We leverage recent advances in interpretable unrolling networks to develop a Distortion-Corrected Reconstruction Network (DCReconNet) that applies convolutional neural networks (CNNs) to learn effective regularizations and nonuniform fast Fourier transforms for GNL-encoding. DCReconNet was trained on a public MR brain dataset from eleven healthy volunteers for fully sampled and accelerated techniques including parallel imaging (PI) and compressed sensing (CS). The performance of DCReconNet was tested on phantom and volunteer brain data acquired on a 1.0T MRI-Linac. The DCReconNet, CS- and PI-based reconstructed image quality was measured by structural similarity (SSIM) and root-mean-squared error (RMSE) for numerical comparisons. The computation time for each method was also reported. Phantom and volunteer results demonstrated that DCReconNet better preserves image structure when compared to CS- and PI-based reconstruction methods. DCReconNet resulted in highest SSIM (0.95 median value) and lowest RMSE (<0.04) on simulated brain images with four times acceleration. DCReconNet is over 100-times faster than iterative, regularized reconstruction methods. DCReconNet provides fast and geometrically accurate image reconstruction and has potential for real-time MRI-guided radiotherapy applications.
△ Less
Submitted 20 March, 2023; v1 submitted 22 May, 2022;
originally announced May 2022.
-
On Real-time Image Reconstruction with Neural Networks for MRI-guided Radiotherapy
Authors:
David E. J. Waddington,
Nicholas Hindley,
Neha Koonjoo,
Christopher Chiu,
Tess Reynolds,
Paul Z. Y. Liu,
Bo Zhu,
Danyal Bhutto,
Chiara Paganelli,
Paul J. Keall,
Matthew S. Rosen
Abstract:
MRI-guidance techniques that dynamically adapt radiation beams to follow tumor motion in real-time will lead to more accurate cancer treatments and reduced collateral healthy tissue damage. The gold-standard for reconstruction of undersampled MR data is compressed sensing (CS) which is computationally slow and limits the rate that images can be available for real-time adaptation. Here, we demonstr…
▽ More
MRI-guidance techniques that dynamically adapt radiation beams to follow tumor motion in real-time will lead to more accurate cancer treatments and reduced collateral healthy tissue damage. The gold-standard for reconstruction of undersampled MR data is compressed sensing (CS) which is computationally slow and limits the rate that images can be available for real-time adaptation. Here, we demonstrate the use of automated transform by manifold approximation (AUTOMAP), a generalized framework that maps raw MR signal to the target image domain, to rapidly reconstruct images from undersampled radial k-space data. The AUTOMAP neural network was trained to reconstruct images from a golden-angle radial acquisition, a benchmark for motion-sensitive imaging, on lung cancer patient data and generic images from ImageNet. Model training was subsequently augmented with motion-encoded k-space data derived from videos in the YouTube-8M dataset to encourage motion robust reconstruction. We find that AUTOMAP-reconstructed radial k-space has equivalent accuracy to CS but with much shorter processing times after initial fine-tuning on retrospectively acquired lung cancer patient data. Validation of motion-trained models with a virtual dynamic lung tumor phantom showed that the generalized motion properties learned from YouTube lead to improved target tracking accuracy. Our work shows that AUTOMAP can achieve real-time, accurate reconstruction of radial data. These findings imply that neural-network-based reconstruction is potentially superior to existing approaches for real-time image guidance applications.
△ Less
Submitted 18 May, 2022; v1 submitted 9 February, 2022;
originally announced February 2022.
-
Tailored nanodiamonds for hyperpolarized 13C MRI
Authors:
T. Boele,
D. E. J. Waddington,
T. Gaebel,
E. Rej,
A. Hasija,
L. J. Brown,
D. R. McCamey,
D. J. Reilly
Abstract:
Nanodiamond is poised to become an attractive material for hyperpolarized 13C MRI if large nuclear polarizations can be achieved without the accompanying rapid spin-relaxation driven by paramagnetic species. Here we report enhanced and long-lived 13C polarization in synthetic nanodiamonds tailored by acid-cleaning and air-oxidation protocols. Our results separate the contributions of different par…
▽ More
Nanodiamond is poised to become an attractive material for hyperpolarized 13C MRI if large nuclear polarizations can be achieved without the accompanying rapid spin-relaxation driven by paramagnetic species. Here we report enhanced and long-lived 13C polarization in synthetic nanodiamonds tailored by acid-cleaning and air-oxidation protocols. Our results separate the contributions of different paramagnetic species on the polarization behavior, identifying the importance of substitutional nitrogen defect centers in the nanodiamond core. These results are likely of use in the development of nanodiamond-based imaging agents with size distributions of relevance for examining biological processes.
△ Less
Submitted 11 September, 2019;
originally announced September 2019.
-
Phase-Encoded Hyperpolarized Nanodiamond for Magnetic Resonance Imaging
Authors:
David E. J. Waddington,
Thomas Boele,
Ewa Rej,
Dane R. McCamey,
Nicholas J. C. King,
Torsten Gaebel,
David J. Reilly
Abstract:
Surface-functionalized nanomaterials can act as theranostic agents that detect disease and track biological processes using hyperpolarized magnetic resonance imaging (MRI). Candidate materials are sparse however, requiring spinful nuclei with long spin-lattice relaxation (T1) and spin-dephasing times (T2), together with a reservoir of electrons to impart hyperpolarization. Here, we demonstrate the…
▽ More
Surface-functionalized nanomaterials can act as theranostic agents that detect disease and track biological processes using hyperpolarized magnetic resonance imaging (MRI). Candidate materials are sparse however, requiring spinful nuclei with long spin-lattice relaxation (T1) and spin-dephasing times (T2), together with a reservoir of electrons to impart hyperpolarization. Here, we demonstrate the versatility of the nanodiamond material system for hyperpolarized 13C MRI, making use of its intrinsic paramagnetic defect centers, hours-long nuclear T1 times, and T2 times suitable for spatially resolving millimeter-scale structures. Combining these properties, we enable a new imaging modality that exploits the phase-contrast between spins encoded with a hyperpolarization that is aligned, or anti-aligned with the external magnetic field. The use of phase-encoded hyperpolarization allows nanodiamonds to be tagged and distinguished in an MRI based on their spin-orientation alone, and could permit the action of specific bio-functionalized complexes to be directly compared and imaged.
△ Less
Submitted 30 August, 2017;
originally announced September 2017.
-
Nanodiamond-enhanced MRI
Authors:
David E. J. Waddington,
Mathieu Sarracanie,
Huiliang Zhang,
Najat Salameh,
David R. Glenn,
Ewa Rej,
Torsten Gaebel,
Thomas Boele,
Ronald L. Walsworth,
David J. Reilly,
Matthew S. Rosen
Abstract:
Nanodiamonds are of interest as nontoxic substrates for targeted drug delivery and as highly biostable fluorescent markers for cellular tracking. Beyond optical techniques however, options for noninvasive imaging of nanodiamonds in vivo are severely limited. Here, we demonstrate that the Overhauser effect, a proton-electron double resonance technique developed to detect free radicals in vivo, can…
▽ More
Nanodiamonds are of interest as nontoxic substrates for targeted drug delivery and as highly biostable fluorescent markers for cellular tracking. Beyond optical techniques however, options for noninvasive imaging of nanodiamonds in vivo are severely limited. Here, we demonstrate that the Overhauser effect, a proton-electron double resonance technique developed to detect free radicals in vivo, can enable high contrast magnetic resonance imaging (MRI) of nanodiamonds in water at room temperature and ultra-low magnetic field. The technique transfers spin polarization from paramagnetic impurities at nanodiamond surfaces to $^1$H spins in the surrounding water solution, creating MRI contrast on-demand. We further examine the conditions required for maximum enhancement as well as the ultimate sensitivity of the technique. The ability to perform continuous hyperpolarization via the Overhauser mechanism, in combination with excellent in vivo stability, raises the possibility of performing noninvasive tracking of nanodiamonds over indefinitely long periods of time.
△ Less
Submitted 16 November, 2016;
originally announced November 2016.
-
Hyperpolarized Nanodiamond Surfaces
Authors:
Ewa Rej,
Torsten Gaebel,
David E. J. Waddington,
David J. Reilly
Abstract:
The widespread use of nanodiamond as a biomedical platform for drug-delivery, imaging, and sub-cellular tracking applications stems from their non-toxicity and unique quantum mechanical properties. Here, we extend this functionality to the domain of magnetic resonance, by demonstrating that the intrinsic electron spins on the nanodiamond surface can be used to hyperpolarize adsorbed liquid compoun…
▽ More
The widespread use of nanodiamond as a biomedical platform for drug-delivery, imaging, and sub-cellular tracking applications stems from their non-toxicity and unique quantum mechanical properties. Here, we extend this functionality to the domain of magnetic resonance, by demonstrating that the intrinsic electron spins on the nanodiamond surface can be used to hyperpolarize adsorbed liquid compounds at room temperature. By combining relaxation measurements with hyperpolarization, spins on the surface of the nanodiamond can be distinguished from those in the bulk liquid. These results are likely of use in signaling the controlled release of pharmaceutical payloads.
△ Less
Submitted 22 June, 2016;
originally announced June 2016.
-
Hyperpolarized Nanodiamond with Long Spin Relaxation Times
Authors:
Ewa Rej,
Torsten Gaebel,
Thomas Boele,
David E. J. Waddington,
David J. Reilly
Abstract:
The use of hyperpolarized agents in magnetic resonance (MR), such as 13C-labeled compounds, enables powerful new imaging and detection modalities that stem from a 10,000-fold boost in signal. A major challenge for the future of the hyperpolarizaton technique is the inherently short spin relaxation times, typically < 60 seconds for 13C liquid-state compounds, which limit the time that the signal re…
▽ More
The use of hyperpolarized agents in magnetic resonance (MR), such as 13C-labeled compounds, enables powerful new imaging and detection modalities that stem from a 10,000-fold boost in signal. A major challenge for the future of the hyperpolarizaton technique is the inherently short spin relaxation times, typically < 60 seconds for 13C liquid-state compounds, which limit the time that the signal remains boosted. Here, we demonstrate that 1.1% natural abundance 13C spins in synthetic nanodiamond (ND) can be hyperpolarized at cryogenic and room temperature without the use of toxic free- radicals, and, owing to their solid-state environment, exhibit relaxation times exceeding 1 hour. Combined with the already established applications of NDs in the life-sciences as inexpensive fluorescent markers and non-cytotoxic substrates for gene and drug delivery, these results extend the theranostic capabilities of nanoscale diamonds into the domain of hyperpolarized MR.
△ Less
Submitted 22 February, 2015;
originally announced February 2015.
-
The effect of (NH4)2Sx passivation on the (311)A GaAs surface and its use in AlGaAs/GaAs heterostructure devices
Authors:
D. J. Carrad,
A. M. Burke,
P. J. Reece,
R. W. Lyttleton,
D. E. J. Waddington,
A. Rai,
D. Reuter,
A. D. Wieck,
A. P. Micolich
Abstract:
We have studied the efficacy of (NH4)2Sx surface passivation on the (311)A GaAs surface. We report XPS studies of simultaneously-grown (311)A and (100) heterostructures showing that the (NH4)2Sx solution removes surface oxide and sulfidizes both surfaces. Passivation is often characterized using photoluminescence measurements, we show that while (NH4)2Sx treatment gives a 40 - 60 x increase in pho…
▽ More
We have studied the efficacy of (NH4)2Sx surface passivation on the (311)A GaAs surface. We report XPS studies of simultaneously-grown (311)A and (100) heterostructures showing that the (NH4)2Sx solution removes surface oxide and sulfidizes both surfaces. Passivation is often characterized using photoluminescence measurements, we show that while (NH4)2Sx treatment gives a 40 - 60 x increase in photoluminescence intensity for the (100) surface, an increase of only 2 - 3 x is obtained for the (311)A surface. A corresponding lack of reproducible improvement in the gate hysteresis of (311)A heterostructure transistor devices made with the passivation treatment performed immediately prior to gate deposition is also found. We discuss possible reasons why sulfur passivation is ineffective for (311)A GaAs, and propose alternative strategies for passivation of this surface.
△ Less
Submitted 8 July, 2013; v1 submitted 4 December, 2012;
originally announced December 2012.