-
Rapid 2D 23Na MRI of the calf using a denoising convolutional neural network
Authors:
Rebecca R. Baker,
Vivek Muthurangu,
Marilena Rega,
Stephen B. Walsh,
Jennifer A. Steeden
Abstract:
23Na MRI can be used to quantify in-vivo tissue sodium concentration (TSC), but the low 23Na signal leads to long scan times and/or noisy or low-resolution images. Reconstruction algorithms such as CS have been proposed to mitigate low SNR; although, these can result in unnatural images, suboptimal denoising and long processing times. Recently, ML has been used to denoise 1H MRI acquisitions; howe…
▽ More
23Na MRI can be used to quantify in-vivo tissue sodium concentration (TSC), but the low 23Na signal leads to long scan times and/or noisy or low-resolution images. Reconstruction algorithms such as CS have been proposed to mitigate low SNR; although, these can result in unnatural images, suboptimal denoising and long processing times. Recently, ML has been used to denoise 1H MRI acquisitions; however, this approach typically requires large volumes of high-quality training data, which is not readily available for 23Na MRI. Here, we train a denoising CNN using 1H data, which we subsequently demonstrate on prospective 23Na images of the calf. 1893 1H transverse slices of the knee were used to train denoising CNNs for different levels of noise. Low SNR images were generated by adding gaussian noise to the high-quality 1H kspace data before reconstruction to create paired training data. For prospective testing, 23Na images of the calf were acquired in 10 volunteers with 150 averages, which were used as a reference throughout the study. From this data, lower-average images were reconstructed using a NUFFT as well as CS, with the NUFFT images subsequently denoised using the trained CNN. CNNs were successfully applied to 23Na images reconstructed with 50, 40 and 30 averages. SNR was significantly higher in CNN images compared to NUFFT, CS and reference images. Edge sharpness was equivalent for all images. For image quality ranking, CNN images ranked equally best with reference images and significantly better than NUFFT and CS images. Muscle and skin TSC quantification from CNN images were equivalent to those from CS images, with <0.9 mM bias compared to reference values. Denoising CNNs trained on 1H data can be successfully applied to 23Na images of the calf; thus, allowing scan time to be reduced from 10 minutes to 2 minutes with little impact on image quality or TSC quantification accuracy.
△ Less
Submitted 12 March, 2024;
originally announced June 2024.
-
Image2Flow: A hybrid image and graph convolutional neural network for rapid patient-specific pulmonary artery segmentation and CFD flow field calculation from 3D cardiac MRI data
Authors:
Tina Yao,
Endrit Pajaziti,
Michael Quail,
Silvia Schievano,
Jennifer A Steeden,
Vivek Muthurangu
Abstract:
Computational fluid dynamics (CFD) can be used for evaluation of hemodynamics. However, its routine use is limited by labor-intensive manual segmentation, CFD mesh creation, and time-consuming simulation. This study aims to train a deep learning model to both generate patient-specific volume-meshes of the pulmonary artery from 3D cardiac MRI data and directly estimate CFD flow fields.
This study…
▽ More
Computational fluid dynamics (CFD) can be used for evaluation of hemodynamics. However, its routine use is limited by labor-intensive manual segmentation, CFD mesh creation, and time-consuming simulation. This study aims to train a deep learning model to both generate patient-specific volume-meshes of the pulmonary artery from 3D cardiac MRI data and directly estimate CFD flow fields.
This study used 135 3D cardiac MRIs from both a public and private dataset. The pulmonary arteries in the MRIs were manually segmented and converted into volume-meshes. CFD simulations were performed on ground truth meshes and interpolated onto point-point correspondent meshes to create the ground truth dataset. The dataset was split 85/10/15 for training, validation and testing. Image2Flow, a hybrid image and graph convolutional neural network, was trained to transform a pulmonary artery template to patient-specific anatomy and CFD values. Image2Flow was evaluated in terms of segmentation and accuracy of CFD predicted was assessed using node-wise comparisons. Centerline comparisons of Image2Flow and CFD simulations performed using machine learning segmentation were also performed.
Image2Flow achieved excellent segmentation accuracy with a median Dice score of 0.9 (IQR: 0.86-0.92). The median node-wise normalized absolute error for pressure and velocity magnitude was 11.98% (IQR: 9.44-17.90%) and 8.06% (IQR: 7.54-10.41), respectively. Centerline analysis showed no significant difference between the Image2Flow and conventional CFD simulated on machine learning-generated volume-meshes.
This proof-of-concept study has shown it is possible to simultaneously perform patient specific volume-mesh based segmentation and pressure and flow field estimation. Image2Flow completes segmentation and CFD in ~205ms, which ~7000 times faster than manual methods, making it more feasible in a clinical environment.
△ Less
Submitted 28 February, 2024;
originally announced February 2024.
-
Deep Learning Pipeline for Preprocessing and Segmenting Cardiac Magnetic Resonance of Single Ventricle Patients from an Image Registry
Authors:
Tina Yao,
Nicole St. Clair,
Gabriel F. Miller,
Adam L. Dorfman,
Mark A. Fogel,
Sunil Ghelani,
Rajesh Krishnamurthy,
Christopher Z. Lam,
Joshua D. Robinson,
David Schidlow,
Timothy C. Slesnick,
Justin Weigand,
Michael Quail,
Rahul Rathod,
Jennifer A. Steeden,
Vivek Muthurangu
Abstract:
Purpose: To develop and evaluate an end-to-end deep learning pipeline for segmentation and analysis of cardiac magnetic resonance images to provide core-lab processing for a multi-centre registry of Fontan patients.
Materials and Methods: This retrospective study used training (n = 175), validation (n = 25) and testing (n = 50) cardiac magnetic resonance image exams collected from 13 institution…
▽ More
Purpose: To develop and evaluate an end-to-end deep learning pipeline for segmentation and analysis of cardiac magnetic resonance images to provide core-lab processing for a multi-centre registry of Fontan patients.
Materials and Methods: This retrospective study used training (n = 175), validation (n = 25) and testing (n = 50) cardiac magnetic resonance image exams collected from 13 institutions in the UK, US and Canada. The data was used to train and evaluate a pipeline containing three deep-learning models. The pipeline's performance was assessed on the Dice and IoU score between the automated and reference standard manual segmentation. Cardiac function values were calculated from both the automated and manual segmentation and evaluated using Bland-Altman analysis and paired t-tests. The overall pipeline was further evaluated qualitatively on 475 unseen patient exams.
Results: For the 50 testing dataset, the pipeline achieved a median Dice score of 0.91 (0.89-0.94) for end-diastolic volume, 0.86 (0.82-0.89) for end-systolic volume, and 0.74 (0.70-0.77) for myocardial mass. The deep learning-derived end-diastolic volume, end-systolic volume, myocardial mass, stroke volume and ejection fraction had no statistical difference compared to the same values derived from manual segmentation with p values all greater than 0.05. For the 475 unseen patient exams, the pipeline achieved 68% adequate segmentation in both systole and diastole, 26% needed minor adjustments in either systole or diastole, 5% needed major adjustments, and the crop** model only failed in 0.4%.
Conclusion: Deep learning pipeline can provide standardised 'core-lab' segmentation for Fontan patients. This pipeline can now be applied to the >4500 cardiac magnetic resonance exams currently in the FORCE registry as well as any new patients that are recruited.
△ Less
Submitted 21 March, 2023;
originally announced March 2023.
-
Machine Learning in Magnetic Resonance Imaging: Image Reconstruction
Authors:
Javier Montalt-Tordera,
Vivek Muthurangu,
Andreas Hauptmann,
Jennifer Anne Steeden
Abstract:
Magnetic Resonance Imaging (MRI) plays a vital role in diagnosis, management and monitoring of many diseases. However, it is an inherently slow imaging technique. Over the last 20 years, parallel imaging, temporal encoding and compressed sensing have enabled substantial speed-ups in the acquisition of MRI data, by accurately recovering missing lines of k-space data. However, clinical uptake of vas…
▽ More
Magnetic Resonance Imaging (MRI) plays a vital role in diagnosis, management and monitoring of many diseases. However, it is an inherently slow imaging technique. Over the last 20 years, parallel imaging, temporal encoding and compressed sensing have enabled substantial speed-ups in the acquisition of MRI data, by accurately recovering missing lines of k-space data. However, clinical uptake of vastly accelerated acquisitions has been limited, in particular in compressed sensing, due to the time-consuming nature of the reconstructions and unnatural looking images. Following the success of machine learning in a wide range of imaging tasks, there has been a recent explosion in the use of machine learning in the field of MRI image reconstruction. A wide range of approaches have been proposed, which can be applied in k-space and/or image-space. Promising results have been demonstrated from a range of methods, enabling natural looking images and rapid computation. In this review article we summarize the current machine learning approaches used in MRI reconstruction, discuss their drawbacks, clinical applications, and current trends.
△ Less
Submitted 9 December, 2020;
originally announced December 2020.
-
Rapid Whole-Heart CMR with Single Volume Super-resolution
Authors:
Jennifer A. Steeden,
Michael Quail,
Alexander Gotschy,
Andreas Hauptmann,
Simon Arridge,
Rodney Jones,
Vivek Muthurangu
Abstract:
Background: Three-dimensional, whole heart, balanced steady state free precession (WH-bSSFP) sequences provide delineation of intra-cardiac and vascular anatomy. However, they have long acquisition times. Here, we propose significant speed ups using a deep learning single volume super resolution reconstruction, to recover high resolution features from rapidly acquired low resolution WH-bSSFP image…
▽ More
Background: Three-dimensional, whole heart, balanced steady state free precession (WH-bSSFP) sequences provide delineation of intra-cardiac and vascular anatomy. However, they have long acquisition times. Here, we propose significant speed ups using a deep learning single volume super resolution reconstruction, to recover high resolution features from rapidly acquired low resolution WH-bSSFP images. Methods: A 3D residual U-Net was trained using synthetic data, created from a library of high-resolution WH-bSSFP images by simulating 0.5 slice resolution and 0.5 phase resolution. The trained network was validated with synthetic test data, as well as prospective low-resolution data. Results: Synthetic low-resolution data had significantly better image quality after super-resolution reconstruction. Qualitative image scores showed super-resolved images had better edge sharpness, fewer residual artefacts and less image distortion than low-resolution images, with similar scores to high-resolution data. Quantitative image scores showed super-resolved images had significantly better edge sharpness than low-resolution or high-resolution images, with significantly better signal-to-noise ratio than high-resolution data. Vessel diameters measurements showed over-estimation in the low-resolution measurements, compared to the high-resolution data. No significant differences and no bias was found in the super-resolution measurements. Conclusion: This paper demonstrates the potential of using a residual U-Net for super-resolution reconstruction of rapidly acquired low-resolution whole heart bSSFP data within a clinical setting. The resulting network can be applied very quickly, making these techniques particularly appealing within busy clinical workflow. Thus, we believe that this technique may help speed up whole heart CMR in clinical practice.
△ Less
Submitted 22 December, 2019;
originally announced December 2019.
-
Memory reduced non-Cartesian MRI encoding using the mixed-radix tensor product on CPU and GPU
Authors:
Jyh-Miin Lin,
Grzegorz Kowalik,
Jennifer A. Steeden,
Vivek Muthurangu
Abstract:
Multi-dimensional non-Cartesian MRI encoding using the precomputed interpolator can encounter the curse of dimensionality, in which the interpolator size exceeds the available memory on the parallel accelerators. Here we reformulate the multi-dimensional non-uniform fast Fourier transform (NUFFT) to a tensor form. The exponentially growing size of the fully precomputed interpolator can be reduced…
▽ More
Multi-dimensional non-Cartesian MRI encoding using the precomputed interpolator can encounter the curse of dimensionality, in which the interpolator size exceeds the available memory on the parallel accelerators. Here we reformulate the multi-dimensional non-uniform fast Fourier transform (NUFFT) to a tensor form. The exponentially growing size of the fully precomputed interpolator can be reduced by tensor analysis. We propose a tree-like, mixed-radix tensor method which flexibly reduces the storage of the NUFFT. A parallel tensor product algorithm is proposed and tested with in vivo cardiac MRI data. Cross-architecture comparisons show that up to 88.1% and 62.4% memory savings are seen in 3D and 2D CINE MRI, respectively, subject only to a negligible loss of accuracy compared to the double-precision CPU version.
△ Less
Submitted 30 May, 2020; v1 submitted 20 March, 2019;
originally announced March 2019.
-
Real-time Assessment of Right and Left Ventricular Volumes and Function in Children Using High Spatiotemporal Resolution Spiral bSSFP with Compressed Sensing
Authors:
Jennifer A. Steeden,
Grzegorz T. Kowalik,
Oliver Tann,
Marina Hughes,
Kristian H. Mortensen,
Vivek Muthurangu
Abstract:
Background: Real-time (RT) assessment of ventricular volumes and function enables data acquisition during free-breathing. However, in children the requirement for high spatiotemporal resolution requires accelerated imaging techniques. In this study, we implemented a novel RT bSSFP spiral sequence reconstructed using Compressed Sensing (CS) and validated it against the breath-hold (BH) reference st…
▽ More
Background: Real-time (RT) assessment of ventricular volumes and function enables data acquisition during free-breathing. However, in children the requirement for high spatiotemporal resolution requires accelerated imaging techniques. In this study, we implemented a novel RT bSSFP spiral sequence reconstructed using Compressed Sensing (CS) and validated it against the breath-hold (BH) reference standard for assessment of ventricular volumes in children with heart disease.
Methods: Data was acquired in 60 children. Qualitative image scoring and evaluation of ventricular volumes was performed by 3 clinical cardiac MR specialists. 30 cases were reassessed for intra-observer variability, and the other 30 cases for inter-observer variability.
Results: Spiral RT images were of good quality, however qualitative scores reflected more residual artefact than standard BH images and slightly lower edge definition. Quantification of Left Ventricular (LV) and Right Ventricular (RV) metrics showed excellent correlation between the techniques with narrow limits of agreement. However, we observed small but statistically significant overestimation of LV end-diastolic volume, underestimation of LV end-systolic volume, as well as a small overestimation of RV stroke volume and ejection fraction using the RT imaging technique. No difference in inter-observer or intra-observer variability were observed between the BH and RT sequences.
Conclusions: Real-time bSSFP imaging using spiral trajectories combined with a compressed sensing reconstruction is feasible. The main benefit is that it can be acquired during free breathing. However, another important secondary benefit is that a whole ventricular stack can be acquired in ~20 seconds, as opposed to ~6 minutes for standard BH imaging. Thus, this technique holds the potential to significantly shorten MR scan times in children.
△ Less
Submitted 25 April, 2018;
originally announced April 2018.
-
Real-time Cardiovascular MR with Spatio-temporal Artifact Suppression using Deep Learning - Proof of Concept in Congenital Heart Disease
Authors:
Andreas Hauptmann,
Simon Arridge,
Felix Lucka,
Vivek Muthurangu,
Jennifer A. Steeden
Abstract:
PURPOSE: Real-time assessment of ventricular volumes requires high acceleration factors. Residual convolutional neural networks (CNN) have shown potential for removing artifacts caused by data undersampling. In this study we investigated the effect of different radial sampling patterns on the accuracy of a CNN. We also acquired actual real-time undersampled radial data in patients with congenital…
▽ More
PURPOSE: Real-time assessment of ventricular volumes requires high acceleration factors. Residual convolutional neural networks (CNN) have shown potential for removing artifacts caused by data undersampling. In this study we investigated the effect of different radial sampling patterns on the accuracy of a CNN. We also acquired actual real-time undersampled radial data in patients with congenital heart disease (CHD), and compare CNN reconstruction to Compressed Sensing (CS).
METHODS: A 3D (2D plus time) CNN architecture was developed, and trained using 2276 gold-standard paired 3D data sets, with 14x radial undersampling. Four sampling schemes were tested, using 169 previously unseen 3D 'synthetic' test data sets. Actual real-time tiny Golden Angle (tGA) radial SSFP data was acquired in 10 new patients (122 3D data sets), and reconstructed using the 3D CNN as well as a CS algorithm; GRASP.
RESULTS: Sampling pattern was shown to be important for image quality, and accurate visualisation of cardiac structures. For actual real-time data, overall reconstruction time with CNN (including creation of aliased images) was shown to be more than 5x faster than GRASP. Additionally, CNN image quality and accuracy of biventricular volumes was observed to be superior to GRASP for the same raw data.
CONCLUSION: This paper has demonstrated the potential for the use of a 3D CNN for deep de-aliasing of real-time radial data, within the clinical setting. Clinical measures of ventricular volumes using real-time data with CNN reconstruction are not statistically significantly different from the gold-standard, cardiac gated, BH techniques.
△ Less
Submitted 14 June, 2018; v1 submitted 14 March, 2018;
originally announced March 2018.