-
Rapid 2D 23Na MRI of the calf using a denoising convolutional neural network
Authors:
Rebecca R. Baker,
Vivek Muthurangu,
Marilena Rega,
Stephen B. Walsh,
Jennifer A. Steeden
Abstract:
23Na MRI can be used to quantify in-vivo tissue sodium concentration (TSC), but the low 23Na signal leads to long scan times and/or noisy or low-resolution images. Reconstruction algorithms such as CS have been proposed to mitigate low SNR; although, these can result in unnatural images, suboptimal denoising and long processing times. Recently, ML has been used to denoise 1H MRI acquisitions; howe…
▽ More
23Na MRI can be used to quantify in-vivo tissue sodium concentration (TSC), but the low 23Na signal leads to long scan times and/or noisy or low-resolution images. Reconstruction algorithms such as CS have been proposed to mitigate low SNR; although, these can result in unnatural images, suboptimal denoising and long processing times. Recently, ML has been used to denoise 1H MRI acquisitions; however, this approach typically requires large volumes of high-quality training data, which is not readily available for 23Na MRI. Here, we train a denoising CNN using 1H data, which we subsequently demonstrate on prospective 23Na images of the calf. 1893 1H transverse slices of the knee were used to train denoising CNNs for different levels of noise. Low SNR images were generated by adding gaussian noise to the high-quality 1H kspace data before reconstruction to create paired training data. For prospective testing, 23Na images of the calf were acquired in 10 volunteers with 150 averages, which were used as a reference throughout the study. From this data, lower-average images were reconstructed using a NUFFT as well as CS, with the NUFFT images subsequently denoised using the trained CNN. CNNs were successfully applied to 23Na images reconstructed with 50, 40 and 30 averages. SNR was significantly higher in CNN images compared to NUFFT, CS and reference images. Edge sharpness was equivalent for all images. For image quality ranking, CNN images ranked equally best with reference images and significantly better than NUFFT and CS images. Muscle and skin TSC quantification from CNN images were equivalent to those from CS images, with <0.9 mM bias compared to reference values. Denoising CNNs trained on 1H data can be successfully applied to 23Na images of the calf; thus, allowing scan time to be reduced from 10 minutes to 2 minutes with little impact on image quality or TSC quantification accuracy.
△ Less
Submitted 12 March, 2024;
originally announced June 2024.
-
CLADE: Cycle Loss Augmented Degradation Enhancement for Unpaired Super-Resolution of Anisotropic Medical Images
Authors:
Michele Pascale,
Vivek Muthurangu,
Javier Montalt Tordera,
Heather E Fitzke,
Gauraang Bhatnagar,
Stuart Taylor,
Jennifer Steeden
Abstract:
Three-dimensional (3D) imaging is popular in medical applications, however, anisotropic 3D volumes with thick, low-spatial-resolution slices are often acquired to reduce scan times. Deep learning (DL) offers a solution to recover high-resolution features through super-resolution reconstruction (SRR). Unfortunately, paired training data is unavailable in many 3D medical applications and therefore w…
▽ More
Three-dimensional (3D) imaging is popular in medical applications, however, anisotropic 3D volumes with thick, low-spatial-resolution slices are often acquired to reduce scan times. Deep learning (DL) offers a solution to recover high-resolution features through super-resolution reconstruction (SRR). Unfortunately, paired training data is unavailable in many 3D medical applications and therefore we propose a novel unpaired approach; CLADE (Cycle Loss Augmented Degradation Enhancement). CLADE uses a modified CycleGAN architecture with a cycle-consistent gradient map** loss, to learn SRR of the low-resolution dimension, from disjoint patches of the high-resolution plane within the anisotropic 3D volume data itself. We show the feasibility of CLADE in abdominal MRI and abdominal CT and demonstrate significant improvements in CLADE image quality over low-resolution volumes and state-of-the-art self-supervised SRR; SMORE (Synthetic Multi-Orientation Resolution Enhancement). Quantitative PIQUE (qualitative perception-based image quality evaluator) scores and quantitative edge sharpness (ES - calculated as the maximum gradient of pixel intensities over a border of interest), showed superior performance for CLADE in both MRI and CT. Qualitatively CLADE had the best overall image quality and highest perceptual ES over the low-resolution volumes and SMORE. This paper demonstrates the potential of using CLADE for super-resolution reconstruction of anisotropic 3D medical imaging data without the need for paired 3D training data.
△ Less
Submitted 5 February, 2024; v1 submitted 21 March, 2023;
originally announced March 2023.
-
Automatic Segmentation of the Great Arteries for Computational Hemodynamic Assessment
Authors:
Javier Montalt-Tordera,
Endrit Pajaziti,
Rod Jones,
Emilie Sauvage,
Rajesh Puranik,
Aakansha Ajay Vir Singh,
Claudio Capelli,
Jennifer Steeden,
Silvia Schievano,
Vivek Muthurangu
Abstract:
Background: Computational fluid dynamics (CFD) is increasingly used to assess blood flow conditions in patients with congenital heart disease (CHD). This requires patient-specific anatomy, usually obtained from segmented 3D cardiovascular magnetic resonance (CMR) images. However, segmentation is time-consuming and needs expert input. This study aims to develop and validate a machine learning (ML)…
▽ More
Background: Computational fluid dynamics (CFD) is increasingly used to assess blood flow conditions in patients with congenital heart disease (CHD). This requires patient-specific anatomy, usually obtained from segmented 3D cardiovascular magnetic resonance (CMR) images. However, segmentation is time-consuming and needs expert input. This study aims to develop and validate a machine learning (ML) method for segmentation of the aorta and pulmonary arteries (PAs) for CFD studies.
Methods: 90 CHD patients were retrospectively selected for this study. 3D CMR images were manually segmented to obtain ground-truth (GT) background, aorta and PA labels. These were used to train and optimize a U-Net model. Segmentation performance was primarily evaluated using Dice score. CFD simulations were set up from GT and ML segmentations using a semi-automatic meshing and simulation pipeline. Pressure and velocity fields were computed, and a mean average percentage error (MAPE) was calculated for each vessel pair. A secondary observer (SO) segmented the test dataset to assess inter-observer variability. Friedman tests were used to compare segmentation metrics and flow field errors.
Results: The model's Dice score (ML vs GT) was 0.945 for the aorta and 0.885 for the PAs. Differences with the inter-observer Dice score (SO vs GT) and ML vs SO Dice scores were not statistically significant for either aorta or PAs. The ML vs GT MAPEs for pressure and velocity in the aorta were 10.1% and 4.1% respectively, and for the PAs 14.6% and 6.3%, respectively. Inter-observer (SO vs GT) and ML vs SO pressure and velocity MAPEs were of a similar magnitude to ML vs GT.
Conclusions: The proposed method can successfully segment the great vessels for CFD, with errors similar to inter-observer variability. This reduces the time and effort needed for CFD analysis, making it more attractive for routine clinical use.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
-
Machine Learning aided k-t SENSE for fast reconstruction of highly accelerated PCMR data
Authors:
Grzegorz Tomasz Kowalik,
Javier Montalt-Tordera,
Jennifer Steeden,
Vivek Muthurangu
Abstract:
Purpose: We implemented the Machine Learning (ML) aided k-t SENSE reconstruction to enable high resolution quantitative real-time phase contrast MR (PCMR). Methods: A residual U-net and our U-net M were used to generate the high resolution x-f space estimate for k-t SENSE regularisation prior. The networks were judged on their ability to generalise to real undersampled data. The in-vivo validation…
▽ More
Purpose: We implemented the Machine Learning (ML) aided k-t SENSE reconstruction to enable high resolution quantitative real-time phase contrast MR (PCMR). Methods: A residual U-net and our U-net M were used to generate the high resolution x-f space estimate for k-t SENSE regularisation prior. The networks were judged on their ability to generalise to real undersampled data. The in-vivo validation was done on 20 real-time 18x prospectively undersmapled GASperturbed PCMR data. The ML aided k-t SENSE reconstruction results were compared against the free-breathing Cartesian retrospectively gated sequence and the compressed sensing (CS) reconstruction of the same data. Results: In general, the ML aided k-t SENSE generated flow curves that were visually sharper than those produced using CS. In two exceptional cases, U-net M predictions exhibited blurring which propagated to the extracted velocity curves. However, there were no statistical differences in the measured peak velocities and stroke volumes between the tested methods. The ML aided k-t SENSE was estimated to be ~3.6x faster in processing than CS. Conclusion: The ML aided k-t SENSE reconstruction enables artefact suppression on a par with CS with no significant differences in quantitative measures. The timing results suggest the on-line implementation could deliver a substantial increase in clinical throughput.
△ Less
Submitted 12 March, 2021;
originally announced March 2021.
-
Machine Learning in Magnetic Resonance Imaging: Image Reconstruction
Authors:
Javier Montalt-Tordera,
Vivek Muthurangu,
Andreas Hauptmann,
Jennifer Anne Steeden
Abstract:
Magnetic Resonance Imaging (MRI) plays a vital role in diagnosis, management and monitoring of many diseases. However, it is an inherently slow imaging technique. Over the last 20 years, parallel imaging, temporal encoding and compressed sensing have enabled substantial speed-ups in the acquisition of MRI data, by accurately recovering missing lines of k-space data. However, clinical uptake of vas…
▽ More
Magnetic Resonance Imaging (MRI) plays a vital role in diagnosis, management and monitoring of many diseases. However, it is an inherently slow imaging technique. Over the last 20 years, parallel imaging, temporal encoding and compressed sensing have enabled substantial speed-ups in the acquisition of MRI data, by accurately recovering missing lines of k-space data. However, clinical uptake of vastly accelerated acquisitions has been limited, in particular in compressed sensing, due to the time-consuming nature of the reconstructions and unnatural looking images. Following the success of machine learning in a wide range of imaging tasks, there has been a recent explosion in the use of machine learning in the field of MRI image reconstruction. A wide range of approaches have been proposed, which can be applied in k-space and/or image-space. Promising results have been demonstrated from a range of methods, enabling natural looking images and rapid computation. In this review article we summarize the current machine learning approaches used in MRI reconstruction, discuss their drawbacks, clinical applications, and current trends.
△ Less
Submitted 9 December, 2020;
originally announced December 2020.
-
Memory reduced non-Cartesian MRI encoding using the mixed-radix tensor product on CPU and GPU
Authors:
Jyh-Miin Lin,
Grzegorz Kowalik,
Jennifer A. Steeden,
Vivek Muthurangu
Abstract:
Multi-dimensional non-Cartesian MRI encoding using the precomputed interpolator can encounter the curse of dimensionality, in which the interpolator size exceeds the available memory on the parallel accelerators. Here we reformulate the multi-dimensional non-uniform fast Fourier transform (NUFFT) to a tensor form. The exponentially growing size of the fully precomputed interpolator can be reduced…
▽ More
Multi-dimensional non-Cartesian MRI encoding using the precomputed interpolator can encounter the curse of dimensionality, in which the interpolator size exceeds the available memory on the parallel accelerators. Here we reformulate the multi-dimensional non-uniform fast Fourier transform (NUFFT) to a tensor form. The exponentially growing size of the fully precomputed interpolator can be reduced by tensor analysis. We propose a tree-like, mixed-radix tensor method which flexibly reduces the storage of the NUFFT. A parallel tensor product algorithm is proposed and tested with in vivo cardiac MRI data. Cross-architecture comparisons show that up to 88.1% and 62.4% memory savings are seen in 3D and 2D CINE MRI, respectively, subject only to a negligible loss of accuracy compared to the double-precision CPU version.
△ Less
Submitted 30 May, 2020; v1 submitted 20 March, 2019;
originally announced March 2019.
-
Real-time Assessment of Right and Left Ventricular Volumes and Function in Children Using High Spatiotemporal Resolution Spiral bSSFP with Compressed Sensing
Authors:
Jennifer A. Steeden,
Grzegorz T. Kowalik,
Oliver Tann,
Marina Hughes,
Kristian H. Mortensen,
Vivek Muthurangu
Abstract:
Background: Real-time (RT) assessment of ventricular volumes and function enables data acquisition during free-breathing. However, in children the requirement for high spatiotemporal resolution requires accelerated imaging techniques. In this study, we implemented a novel RT bSSFP spiral sequence reconstructed using Compressed Sensing (CS) and validated it against the breath-hold (BH) reference st…
▽ More
Background: Real-time (RT) assessment of ventricular volumes and function enables data acquisition during free-breathing. However, in children the requirement for high spatiotemporal resolution requires accelerated imaging techniques. In this study, we implemented a novel RT bSSFP spiral sequence reconstructed using Compressed Sensing (CS) and validated it against the breath-hold (BH) reference standard for assessment of ventricular volumes in children with heart disease.
Methods: Data was acquired in 60 children. Qualitative image scoring and evaluation of ventricular volumes was performed by 3 clinical cardiac MR specialists. 30 cases were reassessed for intra-observer variability, and the other 30 cases for inter-observer variability.
Results: Spiral RT images were of good quality, however qualitative scores reflected more residual artefact than standard BH images and slightly lower edge definition. Quantification of Left Ventricular (LV) and Right Ventricular (RV) metrics showed excellent correlation between the techniques with narrow limits of agreement. However, we observed small but statistically significant overestimation of LV end-diastolic volume, underestimation of LV end-systolic volume, as well as a small overestimation of RV stroke volume and ejection fraction using the RT imaging technique. No difference in inter-observer or intra-observer variability were observed between the BH and RT sequences.
Conclusions: Real-time bSSFP imaging using spiral trajectories combined with a compressed sensing reconstruction is feasible. The main benefit is that it can be acquired during free breathing. However, another important secondary benefit is that a whole ventricular stack can be acquired in ~20 seconds, as opposed to ~6 minutes for standard BH imaging. Thus, this technique holds the potential to significantly shorten MR scan times in children.
△ Less
Submitted 25 April, 2018;
originally announced April 2018.