-
Real-time myocardial landmark tracking for MRI-guided cardiac radio-ablation using Gaussian Processes
Authors:
Niek R. F. Huttinga,
Osman Akdag,
Martin F. Fast,
Joost Verhoeff,
Firdaus A. A. Mohamed Hoesein,
Cornelis A. T. van den Berg,
Alessandro Sbrizzi,
Stefano Mandija
Abstract:
The high speed of cardiorespiratory motion introduces a unique challenge for cardiac stereotactic radio-ablation (STAR) treatments with the MR-linac. Such treatments require tracking myocardial landmarks with a maximum latency of 100 ms, which includes the acquisition of the required data. The aim of this study is to present a new method that allows to track myocardial landmarks from few readouts…
▽ More
The high speed of cardiorespiratory motion introduces a unique challenge for cardiac stereotactic radio-ablation (STAR) treatments with the MR-linac. Such treatments require tracking myocardial landmarks with a maximum latency of 100 ms, which includes the acquisition of the required data. The aim of this study is to present a new method that allows to track myocardial landmarks from few readouts of MRI data, thereby achieving a latency sufficient for STAR treatments. We present a tracking framework that requires only few readouts of k-space data as input, which can be acquired at least an order of magnitude faster than MR-images. Combined with the real-time tracking speed of a probabilistic machine learning framework called Gaussian Processes, this allows to track myocardial landmarks with a sufficiently low latency for cardiac STAR guidance, including both the acquisition of required data, and the tracking inference. The framework is demonstrated in 2D on a motion phantom, and in vivo on volunteers and a ventricular tachycardia (arrhythmia) patient. Moreover, the feasibility of an extension to 3D was demonstrated by in silico 3D experiments with a digital motion phantom. The framework was compared with template matching - a reference, image-based, method - and linear regression methods. Results indicate an order of magnitude lower total latency (<10 ms) for the proposed framework in comparison with alternative methods. The root-mean-square-distances and mean end-point-distance with the reference tracking method was less than 0.8 mm for all experiments, showing excellent (sub-voxel) agreement. The high accuracy in combination with a total latency of less than 10 ms - including data acquisition and processing - make the proposed method a suitable candidate for tracking during STAR treatments.
△ Less
Submitted 19 June, 2023;
originally announced June 2023.
-
Acceleration Strategies for MR-STAT: Achieving High-Resolution Reconstructions on a Desktop PC within 3 minutes
Authors:
Hongyan Liu,
Oscar van der Heide,
Stefano Mandija,
Cornelis A. T. van den Berg,
Alessandro Sbrizzi
Abstract:
MR-STAT is an emerging quantitative magnetic resonance imaging technique which aims at obtaining multi-parametric tissue parameter maps from single short scans. It describes the relationship between the spatial-domain tissue parameters and the time-domain measured signal by using a comprehensive, volumetric forward model. The MR-STAT reconstruction solves a large-scale nonlinear problem, thus is v…
▽ More
MR-STAT is an emerging quantitative magnetic resonance imaging technique which aims at obtaining multi-parametric tissue parameter maps from single short scans. It describes the relationship between the spatial-domain tissue parameters and the time-domain measured signal by using a comprehensive, volumetric forward model. The MR-STAT reconstruction solves a large-scale nonlinear problem, thus is very computationally challenging. In previous work, MR-STAT reconstruction using Cartesian readout data was accelerated by approximating the Hessian matrix with sparse, banded blocks, and can be done on high performance CPU clusters with tens of minutes. In the current work, we propose an accelerated Cartesian MR-STAT algorithm incorporating two different strategies: firstly, a neural network is trained as a fast surrogate to learn the magnetization signal not only in the full time-domain but also in the compressed lowrank domain; secondly, based on the surrogate model, the Cartesian MR-STAT problem is re-formulated and split into smaller sub-problems by the alternating direction method of multipliers. The proposed method substantially reduces the computational requirements for runtime and memory. Simulated and in-vivo balanced MR-STAT experiments show similar reconstruction results using the proposed algorithm compared to the previous sparse Hessian method, and the reconstruction times are at least 40 times shorter. Incorporating sensitivity encoding and regularization terms is straightforward, and allows for better image quality with a negligible increase in reconstruction time. The proposed algorithm could reconstruct both balanced and gradient-spoiled in-vivo data within 3 minutes on a desktop PC, and could thereby facilitate the translation of MR-STAT in clinical settings.
△ Less
Submitted 4 May, 2022;
originally announced May 2022.
-
Combining Deep Learning and 3D Contrast Source Inversion in MR-based Electrical Properties Tomography
Authors:
Reijer L. Leijsen,
Cornelis A. T. van den Berg,
Andrew G. Webb,
Rob F. Remis,
Stefano Mandija
Abstract:
Magnetic resonance-electrical properties tomography (MR-EPT) is a technique used to estimate the conductivity and permittivity of tissues from MR measurements of the transmit magnetic field. Different reconstruction methods are available, however all these methods present several limitations which hamper the clinical applicability. Standard Helmholtz based MR-EPT methods are severely affected by n…
▽ More
Magnetic resonance-electrical properties tomography (MR-EPT) is a technique used to estimate the conductivity and permittivity of tissues from MR measurements of the transmit magnetic field. Different reconstruction methods are available, however all these methods present several limitations which hamper the clinical applicability. Standard Helmholtz based MR-EPT methods are severely affected by noise. Iterative reconstruction methods such as contrast source inversion-EPT (CSI-EPT) are typically time consuming and are dependent on their initialization. Deep learning (DL) based methods require a large amount of training data before sufficient generalization can be achieved. Here, we investigate the benefits achievable using a hybrid approach, i.e. using MR-EPT or DL-EPT as initialization guesses for standard 3D CSI-EPT. Using realistic electromagnetic simulations at 3 T and 7 T, the accuracy and precision of hybrid CSI reconstructions are compared to standard 3D CSI-EPT reconstructions. Our results indicate that a hybrid method consisting of an initial DL-EPT reconstruction followed by a 3D CSI-EPT reconstruction would be beneficial. DL-EPT combined with standard 3D CSI-EPT exploits the power of data driven DL-based EPT reconstructions while the subsequent CSI-EPT facilitates a better generalization by providing data consistency.
△ Less
Submitted 13 August, 2019;
originally announced August 2019.
-
Deep learning brain conductivity map** using a patch-based 3D U-net
Authors:
Nils Hampe,
Ulrich Katscher,
Cornelis A. T. van den Berg,
Khin Khin Tha,
Stefano Mandija
Abstract:
Purpose: To investigate deep learning electrical properties tomography (EPT) for application on different simulated and in-vivo datasets including pathologies for obtaining quantitative brain conductivity maps. Methods: 3D patch-based convolutional neural networks were trained to predict conductivity maps from B1 transceive phase data. To compare the performance of DLEPT networks on different data…
▽ More
Purpose: To investigate deep learning electrical properties tomography (EPT) for application on different simulated and in-vivo datasets including pathologies for obtaining quantitative brain conductivity maps. Methods: 3D patch-based convolutional neural networks were trained to predict conductivity maps from B1 transceive phase data. To compare the performance of DLEPT networks on different datasets, three datasets were used throughout this work, one from simulations and two from in-vivo measurements from healthy volunteers and cancer patients, respectively. At first, networks trained on simulations are tested on all datasets with different levels of homogeneous Gaussian noise introduced in training and testing. Secondly, to investigate potential robustness towards systematical differences between simulated and measured phase maps, in-vivo data with conductivity labels from conventional EPT is used for training. Results: High quality of reconstructions from networks trained on simulations with and without noise confirms the potential of deep learning for EPT. However, artifact encumbered results in this work uncover challenges in application of DLEPT to in-vivo data. Training DLEPT networks on conductivity labels from conventional EPT improves quality of results. This is argued to be caused by robustness to artifacts from image acquisition. Conclusions: Networks trained on simulations with added homogeneous Gaussian noise yield reconstruction artifacts when applied to in-vivo data. Training with realistic phase data and conductivity labels from conventional EPT allows for severely reducing these artifacts.
△ Less
Submitted 12 August, 2019;
originally announced August 2019.
-
Opening a new window on MR-based Electrical Properties Tomography with deep learning
Authors:
Stefano Mandija,
Ettore F. Meliadò,
Niek R. F. Huttinga,
Peter R. Luijten,
Cornelis A. T. van den Berg
Abstract:
Electrical properties (EPs) of tissues, conductivity and permittivity, are modulated by the ionic and water content, which change in presence of pathologies. Information on tissues EPs can be used e.g. as an endogenous biomarker in oncology. MR-Electrical Properties Tomography (MR-EPT) aims to reconstruct tissue EPs by solving an electromagnetic inverse problem relating MR measurements of the tran…
▽ More
Electrical properties (EPs) of tissues, conductivity and permittivity, are modulated by the ionic and water content, which change in presence of pathologies. Information on tissues EPs can be used e.g. as an endogenous biomarker in oncology. MR-Electrical Properties Tomography (MR-EPT) aims to reconstruct tissue EPs by solving an electromagnetic inverse problem relating MR measurements of the transmit radiofrequency RF field to the EPs. However, MR-EPT reconstructions highly suffer from noise in the RF field maps, which limits the clinical applicability. Instead of employing electromagnetic models posing strict requirements on the measured quantities, we propose a data driven approach where the inverse transformation is learned by means of a neural network. Supervised training of a conditional generative adversarial neural network was performed using simulated realistic RF field maps and realistic human head dielectric models. Deep learning EPT (DL-EPT) reconstructions are presented for in-silica MR data and MR measurements at 3 Tesla on phantoms and human brains. DL-EPT shows high quality EP maps, demonstrating good accuracy and greatly improved precision compared to conventional MR-EPT. Moreover, DL-EPT allows permittivity reconstructions at 3 Tesla, which is not possible with state-of-art MR-EPT techniques. The supervised learning-based approach leverages the strength of tailored electromagnetic simulations, allowing inclusion of a priori information (e.g. coil setup) and circumvention of inaccessible MR electromagnetic quantities. Since DL-EPT is highly noise-robust, the requirements for MRI data acquisitions can be relaxed, allowing faster acquisitions and higher resolutions. We believe that DL-EPT greatly improves the quality and applicability of EPT opening a new window for an endogenous biomarker in MRI diagnostics that reflects differences in ionic tissue content.
△ Less
Submitted 19 August, 2019; v1 submitted 30 March, 2018;
originally announced April 2018.
