-
Validation and Generalizability of Self-Supervised Image Reconstruction Methods for Undersampled MRI
Authors:
Thomas Yu,
Tom Hilbert,
Gian Franco Piredda,
Arun Joseph,
Gabriele Bonanno,
Salim Zenkhri,
Patrick Omoumi,
Meritxell Bach Cuadra,
Erick Jorge Canales-Rodríguez,
Tobias Kober,
Jean-Philippe Thiran
Abstract:
Deep learning methods have become the state of the art for undersampled MR reconstruction. Particularly for cases where it is infeasible or impossible for ground truth, fully sampled data to be acquired, self-supervised machine learning methods for reconstruction are becoming increasingly used. However potential issues in the validation of such methods, as well as their generalizability, remain un…
▽ More
Deep learning methods have become the state of the art for undersampled MR reconstruction. Particularly for cases where it is infeasible or impossible for ground truth, fully sampled data to be acquired, self-supervised machine learning methods for reconstruction are becoming increasingly used. However potential issues in the validation of such methods, as well as their generalizability, remain underexplored. In this paper, we investigate important aspects of the validation of self-supervised algorithms for reconstruction of undersampled MR images: quantitative evaluation of prospective reconstructions, potential differences between prospective and retrospective reconstructions, suitability of commonly used quantitative metrics, and generalizability. Two self-supervised algorithms based on self-supervised denoising and the deep image prior were investigated. These methods are compared to a least squares fitting and a compressed sensing reconstruction using in-vivo and phantom data. Their generalizability was tested with prospectively under-sampled data from experimental conditions different to the training. We show that prospective reconstructions can exhibit significant distortion relative to retrospective reconstructions/ground truth. Furthermore, pixel-wise quantitative metrics may not capture differences in perceptual quality accurately, in contrast to a perceptual metric. In addition, all methods showed potential for generalization; however, generalizability is more affected by changes in anatomy/contrast than other changes. We further showed that no-reference image metrics correspond well with human rating of image quality for studying generalizability. Finally, we showed that a well-tuned compressed sensing reconstruction and learned denoising perform similarly on all data.
△ Less
Submitted 12 September, 2022; v1 submitted 29 January, 2022;
originally announced January 2022.
-
FaBiAN: A Fetal Brain magnetic resonance Acquisition Numerical phantom
Authors:
Hélène Lajous,
Christopher W. Roy,
Tom Hilbert,
Priscille de Dumast,
Sébastien Tourbier,
Yasser Alemán-Gómez,
Jérôme Yerly,
Thomas Yu,
Hamza Kebiri,
Kelly Payette,
Jean-Baptiste Ledoux,
Reto Meuli,
Patric Hagmann,
Andras Jakab,
Vincent Dunet,
Mériam Koob,
Tobias Kober,
Matthias Stuber,
Meritxell Bach Cuadra
Abstract:
Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. Magnetic resonance imaging is a powerful tool to investigate equivocal neurological patterns during fetal development. However, the number of acquisitions of satisfactory quality available in this cohort of s…
▽ More
Accurate characterization of in utero human brain maturation is critical as it involves complex and interconnected structural and functional processes that may influence health later in life. Magnetic resonance imaging is a powerful tool to investigate equivocal neurological patterns during fetal development. However, the number of acquisitions of satisfactory quality available in this cohort of sensitive subjects remains scarce, thus hindering the validation of advanced image processing techniques. Numerical phantoms can mitigate these limitations by providing a controlled environment with a known ground truth. In this work, we present FaBiAN, an open-source Fetal Brain magnetic resonance Acquisition Numerical phantom that simulates clinical T2-weighted fast spin echo sequences of the fetal brain. This unique tool is based on a general, flexible and realistic setup that includes stochastic fetal movements, thus providing images of the fetal brain throughout maturation comparable to clinical acquisitions. We demonstrate its value to evaluate the robustness and optimize the accuracy of an algorithm for super-resolution fetal brain magnetic resonance imaging from simulated motion-corrupted 2D low-resolution series as compared to a synthetic high-resolution reference volume. We also show that the images generated can complement clinical datasets to support data-intensive deep learning methods for fetal brain tissue segmentation.
△ Less
Submitted 6 September, 2021;
originally announced September 2021.
-
Multi-compartment diffusion MRI, T2 relaxometry and myelin water imaging as neuroimaging descriptors for anomalous tissue detection
Authors:
Elda Fischi-Gomez,
Jonathan Rafael-Patino,
Marco Pizzolato,
Gian Franco Piredda,
Tom Hilbert,
Tobias Kober,
Erick J. Canales-Rodriguez,
Jean-Philippe Thiran
Abstract:
Multiple sclerosis (MS) is an inflammatory and neurodegenerative disease characterized by diffuse and focal areas of tissue loss. Conventional MRI techniques such as T1-weighted and T2-weighted scans are generally used in the diagnosis and prognosis of the disease. Yet, these methods are limited by the lack of specificity between lesions, their perilesional area and non-lesional tissue. Alternativ…
▽ More
Multiple sclerosis (MS) is an inflammatory and neurodegenerative disease characterized by diffuse and focal areas of tissue loss. Conventional MRI techniques such as T1-weighted and T2-weighted scans are generally used in the diagnosis and prognosis of the disease. Yet, these methods are limited by the lack of specificity between lesions, their perilesional area and non-lesional tissue. Alternative MRI techniques exhibit a higher level of sensitivity to focal and diffuse MS pathology than conventional MRI acquisitions. However, they still suffer from limited specificity when considered alone. In this work, we have combined tissue microstructure information derived from multicompartment diffusion MRI and T2 relaxometry models to explore the voxel-based prediction power of a machine learning model in a cohort of MS patients and healthy controls. Our results show that the combination of multi-modal features, together with a boosting enhanced decision-tree based classifier, which combines a set of weak classifiers to form a strong classifier via a voting mechanism, is able to utilise the complementary information for the classification of abnormal tissue.
△ Less
Submitted 15 April, 2021;
originally announced April 2021.
-
T2 Map** from Super-Resolution-Reconstructed Clinical Fast Spin Echo Magnetic Resonance Acquisitions
Authors:
Hélène Lajous,
Tom Hilbert,
Christopher W. Roy,
Sébastien Tourbier,
Priscille de Dumast,
Thomas Yu,
Jean-Philippe Thiran,
Jean-Baptiste Ledoux,
Davide Piccini,
Patric Hagmann,
Reto Meuli,
Tobias Kober,
Matthias Stuber,
Ruud B. van Heeswijk,
Meritxell Bach Cuadra
Abstract:
Relaxometry studies in preterm and at-term newborns have provided insight into brain microstructure, thus opening new avenues for studying normal brain development and supporting diagnosis in equivocal neurological situations. However, such quantitative techniques require long acquisition times and therefore cannot be straightforwardly translated to in utero brain developmental studies. In clinica…
▽ More
Relaxometry studies in preterm and at-term newborns have provided insight into brain microstructure, thus opening new avenues for studying normal brain development and supporting diagnosis in equivocal neurological situations. However, such quantitative techniques require long acquisition times and therefore cannot be straightforwardly translated to in utero brain developmental studies. In clinical fetal brain magnetic resonance imaging routine, 2D low-resolution T2-weighted fast spin echo sequences are used to minimize the effects of unpredictable fetal motion during acquisition. As super-resolution techniques make it possible to reconstruct a 3D high-resolution volume of the fetal brain from clinical low-resolution images, their combination with quantitative acquisition schemes could provide fast and accurate T2 measurements. In this context, the present work demonstrates the feasibility of using super-resolution reconstruction from conventional T2-weighted fast spin echo sequences for 3D isotropic T2 map**. A quantitative magnetic resonance phantom was imaged using a clinical T2-weighted fast spin echo sequence at variable echo time to allow for super-resolution reconstruction at every echo time and subsequent T2 map** of samples whose relaxometric properties are close to those of fetal brain tissue. We demonstrate that this approach is highly repeatable, accurate and robust when using six echo times (total acquisition time under 9 minutes) as compared to gold-standard single-echo spin echo sequences (several hours for one single 2D slice).
△ Less
Submitted 23 July, 2020;
originally announced July 2020.
-
Model-Informed Machine Learning for Multi-component T2 Relaxometry
Authors:
Thomas Yu,
Erick Jorge Canales Rodriguez,
Marco Pizzolato,
Gian Franco Piredda,
Tom Hilbert,
Elda Fischi-Gomez,
Matthias Weigel,
Muhamed Barakovic,
Meritxell Bach-Cuadra,
Cristina Granziera,
Tobias Kober,
Jean-Philippe Thiran
Abstract:
Recovering the T2 distribution from multi-echo T2 magnetic resonance (MR) signals is challenging but has high potential as it provides biomarkers characterizing the tissue micro-structure, such as the myelin water fraction (MWF). In this work, we propose to combine machine learning and aspects of parametric (fitting from the MRI signal using biophysical models) and non-parametric (model-free fitti…
▽ More
Recovering the T2 distribution from multi-echo T2 magnetic resonance (MR) signals is challenging but has high potential as it provides biomarkers characterizing the tissue micro-structure, such as the myelin water fraction (MWF). In this work, we propose to combine machine learning and aspects of parametric (fitting from the MRI signal using biophysical models) and non-parametric (model-free fitting of the T2 distribution from the signal) approaches to T2 relaxometry in brain tissue by using a multi-layer perceptron (MLP) for the distribution reconstruction. For training our network, we construct an extensive synthetic dataset derived from biophysical models in order to constrain the outputs with \textit{a priori} knowledge of \textit{in vivo} distributions. The proposed approach, called Model-Informed Machine Learning (MIML), takes as input the MR signal and directly outputs the associated T2 distribution. We evaluate MIML in comparison to non-parametric and parametric approaches on synthetic data, an ex vivo scan, and high-resolution scans of healthy subjects and a subject with Multiple Sclerosis. In synthetic data, MIML provides more accurate and noise-robust distributions. In real data, MWF maps derived from MIML exhibit the greatest conformity to anatomical scans, have the highest correlation to a histological map of myelin volume, and the best unambiguous lesion visualization and localization, with superior contrast between lesions and normal appearing tissue. In whole-brain analysis, MIML is 22 to 4980 times faster than non-parametric and parametric methods, respectively.
△ Less
Submitted 20 July, 2020;
originally announced July 2020.
-
Compressed Sensing with Signal Averaging for Improved Sensitivity and Motion Artifact Reduction in Fluorine-19 MRI
Authors:
Emeline Darçot,
Jérôme Yerly,
Tom Hilbert,
Roberto Colotti,
Elena Najdenovska,
Tobias Kober,
Matthias Stuber,
Ruud B. van Heeswijk
Abstract:
Fluorine-19 (19F) MRI of injected perfluorocarbon emulsions (PFCs) allows for the non-invasive quantification of inflammation and cell tracking, but suffers from a low signal-to-noise ratio and extended scan time. To address this limitation, we tested the hypothesis that a 19F MRI pulse sequence that combines a specific undersampling regime with signal averaging has increased sensitivity and robus…
▽ More
Fluorine-19 (19F) MRI of injected perfluorocarbon emulsions (PFCs) allows for the non-invasive quantification of inflammation and cell tracking, but suffers from a low signal-to-noise ratio and extended scan time. To address this limitation, we tested the hypothesis that a 19F MRI pulse sequence that combines a specific undersampling regime with signal averaging has increased sensitivity and robustness against motion artifacts compared to a non-averaged fully-sampled dataset, when both are reconstructed with compressed sensing. To this end, numerical simulations and phantom experiments were performed to characterize the point spread function (PSF) of undersampling patterns and the vulnerability to noise of acquisition-reconstruction strategies with paired numbers of x signal averages and acceleration factor x (NAx-AFx). At all investigated noise levels, the DSC of the acquisition-reconstruction strategies strongly depended on the regularization parameters and acceleration factor. In phantoms, motion robustness of an NA8-AF8 undersampling pattern versus NA1-AF1 was evaluated with simulated and real motions. Differences were assessed with Dice similarity coefficients (DSC), and were consistently higher for NA8-AF8 compared to NA1-AF1 strategy, for both simulated and real cyclic motions (P<0.001). Both acquisition-reconstruction strategies were validated in vivo in mice (n=2) injected with perfluoropolyether. These images displayed a sharper delineation of the liver with the NA8-AF8 strategy than with the NA1-AF1 strategy. In conclusion, we validated the hypothesis that in 19F MRI, the combination of undersampling and averaging improves both the sensitivity and the robustness against motion artifacts compared to a non-averaged fully-sampled dataset, when both are reconstructed with compressed sensing.
△ Less
Submitted 8 October, 2020; v1 submitted 10 September, 2019;
originally announced September 2019.
-
Magnetization Transfer in Magnetic Resonance Fingerprinting
Authors:
Tom Hilbert,
Ding Xia,
Kai Tobias Block,
Zidan Yu,
Riccardo Lattanzi,
Daniel K. Sodickson,
Tobias Kober,
Martijn A. Cloos
Abstract:
Purpose: To study the effects of magnetization transfer (MT, in which a semisolid spin pool interacts with the free pool), in the context of magnetic resonance fingerprinting (MRF).
Methods: Simulations and phantom experiments were performed to study the impact of MT on the MRF signal and its potential influence on T1 and T2 estimation. Subsequently, an MRF sequence implementing off-resonance MT…
▽ More
Purpose: To study the effects of magnetization transfer (MT, in which a semisolid spin pool interacts with the free pool), in the context of magnetic resonance fingerprinting (MRF).
Methods: Simulations and phantom experiments were performed to study the impact of MT on the MRF signal and its potential influence on T1 and T2 estimation. Subsequently, an MRF sequence implementing off-resonance MT pulses and a dictionary with an MT dimension by incorporating a two-pool model were used to estimate the fractional pool size in addition to the B1+, T1, and T2 values. The proposed method was evaluated in the human brain.
Results: Simulations and phantom experiments showed that an MRF signal obtained from a cross-linked bovine serum sample is influenced by MT. Using a dictionary based on an MT model, a better match between simulations and acquired MR signals can be obtained (NRMSE 1.3% versus 4.7%). Adding off-resonance MT pulses can improve the differentiation of MT from T1 and T2. In-vivo results showed that MT affects the MRF signals from white matter (fractional pool-size ~16%) and gray matter (fractional pool-size ~10%). Furthermore, longer T1 (~1060 ms versus ~860 ms) and T2 values (~47 ms versus ~35 ms) can be observed in white matter if MT is accounted for.
Conclusion: Our experiments demonstrated a potential influence of MT on the quantification of T1 and T2 with MRF. A model that encompasses MT effects can improve the accuracy of estimated relaxation parameters and allows quantification of the fractional pool size.
△ Less
Submitted 30 July, 2019;
originally announced July 2019.
