-
CINA: Conditional Implicit Neural Atlas for Spatio-Temporal Representation of Fetal Brains
Authors:
Maik Dannecker,
Vanessa Kyriakopoulou,
Lucilio Cordero-Grande,
Anthony N. Price,
Joseph V. Hajnal,
Daniel Rueckert
Abstract:
We introduce a conditional implicit neural atlas (CINA) for spatio-temporal atlas generation from Magnetic Resonance Images (MRI) of the neurotypical and pathological fetal brain, that is fully independent of affine or non-rigid registration. During training, CINA learns a general representation of the fetal brain and encodes subject specific information into latent code. After training, CINA can…
▽ More
We introduce a conditional implicit neural atlas (CINA) for spatio-temporal atlas generation from Magnetic Resonance Images (MRI) of the neurotypical and pathological fetal brain, that is fully independent of affine or non-rigid registration. During training, CINA learns a general representation of the fetal brain and encodes subject specific information into latent code. After training, CINA can construct a faithful atlas with tissue probability maps of the fetal brain for any gestational age (GA) and anatomical variation covered within the training domain. Thus, CINA is competent to represent both, neurotypical and pathological brains. Furthermore, a trained CINA model can be fit to brain MRI of unseen subjects via test-time optimization of the latent code. CINA can then produce probabilistic tissue maps tailored to a particular subject. We evaluate our method on a total of 198 T2 weighted MRI of normal and abnormal fetal brains from the dHCP and FeTA datasets. We demonstrate CINA's capability to represent a fetal brain atlas that can be flexibly conditioned on GA and on anatomical variations like ventricular volume or degree of cortical folding, making it a suitable tool for modeling both neurotypical and pathological brains. We quantify the fidelity of our atlas by means of tissue segmentation and age prediction and compare it to an established baseline. CINA demonstrates superior accuracy for neurotypical brains and pathological brains with ventriculomegaly. Moreover, CINA scores a mean absolute error of 0.23 weeks in fetal brain age prediction, further confirming an accurate representation of fetal brain development.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Fetal MRI by robust deep generative prior reconstruction and diffeomorphic registration: application to gestational age prediction
Authors:
Lucilio Cordero-Grande,
Juan Enrique Ortuño-Fisac,
Alena Uus,
Maria Deprez,
Andrés Santos,
Joseph V. Hajnal,
María Jesús Ledesma-Carbayo
Abstract:
Magnetic resonance imaging of whole fetal body and placenta is limited by different sources of motion affecting the womb. Usual scanning techniques employ single-shot multi-slice sequences where anatomical information in different slices may be subject to different deformations, contrast variations or artifacts. Volumetric reconstruction formulations have been proposed to correct for these factors…
▽ More
Magnetic resonance imaging of whole fetal body and placenta is limited by different sources of motion affecting the womb. Usual scanning techniques employ single-shot multi-slice sequences where anatomical information in different slices may be subject to different deformations, contrast variations or artifacts. Volumetric reconstruction formulations have been proposed to correct for these factors, but they must accommodate a non-homogeneous and non-isotropic sampling, so regularization becomes necessary. Thus, in this paper we propose a deep generative prior for robust volumetric reconstructions integrated with a diffeomorphic volume to slice registration method. Experiments are performed to validate our contributions and compare with a state of the art method in a cohort of $72$ fetal datasets in the range of $20-36$ weeks gestational age. Results suggest improved image resolution and more accurate prediction of gestational age at scan when comparing to a state of the art reconstruction method. In addition, gestational age prediction results from our volumetric reconstructions compare favourably with existing brain-based approaches, with boosted accuracy when integrating information of organs other than the brain. Namely, a mean absolute error of $0.618$ weeks ($R^2=0.958$) is achieved when combining fetal brain and trunk information.
△ Less
Submitted 29 October, 2021;
originally announced November 2021.
-
Diffusion tensor driven image registration: a deep learning approach
Authors:
Irina Grigorescu,
Alena Uus,
Daan Christiaens,
Lucilio Cordero-Grande,
Jana Hutter,
A. David Edwards,
Joseph V. Hajnal,
Marc Modat,
Maria Deprez
Abstract:
Tracking microsctructural changes in the develo** brain relies on accurate inter-subject image registration. However, most methods rely on either structural or diffusion data to learn the spatial correspondences between two or more images, without taking into account the complementary information provided by using both. Here we propose a deep learning registration framework which combines the st…
▽ More
Tracking microsctructural changes in the develo** brain relies on accurate inter-subject image registration. However, most methods rely on either structural or diffusion data to learn the spatial correspondences between two or more images, without taking into account the complementary information provided by using both. Here we propose a deep learning registration framework which combines the structural information provided by T2-weighted (T2w) images with the rich microstructural information offered by diffusion tensor imaging (DTI) scans. We perform a leave-one-out cross-validation study where we compare the performance of our multi-modality registration model with a baseline model trained on structural data only, in terms of Dice scores and differences in fractional anisotropy (FA) maps. Our results show that in terms of average Dice scores our model performs better in subcortical regions when compared to using structural data only. Moreover, average sum-of-squared differences between warped and fixed FA maps show that our proposed model performs better at aligning the diffusion data.
△ Less
Submitted 14 May, 2020;
originally announced May 2020.
-
Motion corrected MRI with DISORDER: Distributed and Incoherent Sample Orders for Reconstruction Deblurring using Encoding Redundancy
Authors:
Lucilio Cordero-Grande,
Giulio Ferrazzi,
Rui Pedro A. G. Teixeira,
Jonathan O'Muircheartaigh,
Anthony N. Price,
Joseph V. Hajnal
Abstract:
Purpose: To enable rigid-body motion tolerant parallel volumetric magnetic resonance imaging by retrospective head motion correction on a variety of spatio-temporal scales and imaging sequences. Theory and methods: Tolerance against rigid-body motion is based on distributed and incoherent sampling orders for boosting a joint retrospective motion estimation and reconstruction framework. Motion resi…
▽ More
Purpose: To enable rigid-body motion tolerant parallel volumetric magnetic resonance imaging by retrospective head motion correction on a variety of spatio-temporal scales and imaging sequences. Theory and methods: Tolerance against rigid-body motion is based on distributed and incoherent sampling orders for boosting a joint retrospective motion estimation and reconstruction framework. Motion resilience stems from the encoding redundancy in the data, as generally provided by the coil array. Hence, it does not require external sensors, navigators or training data, so the methodology is readily applicable to sequences using 3D encodings. Results: Simulations are performed showing full inter-shot corrections for usual levels of in-vivo motion, large number of shots, standard levels of noise and moderate acceleration factors. Feasibility of inter- and intra-shot corrections is shown under controlled motion in-vivo. Practical efficacy is illustrated by high quality results in most corrupted of 208 volumes from a series of 26 clinical pediatric examinations collected using standard protocols. Conclusion: The proposed framework addresses the rigid motion problem in volumetric anatomical brain scans with sufficient encoding redundancy which has enabled reliable pediatric examinations without sedation.
△ Less
Submitted 2 January, 2020; v1 submitted 1 October, 2019;
originally announced October 2019.
-
Interpretable Convolutional Neural Networks for Preterm Birth Classification
Authors:
Irina Grigorescu,
Lucilio Cordero-Grande,
A David Edwards,
Jo Hajnal,
Marc Modat,
Maria Deprez
Abstract:
The use of convolutional neural networks (CNNs) for classification tasks has become dominant in various medical imaging applications. At the same time, recent advances in interpretable machine learning techniques have shown great potential in explaining classifiers' decisions. Layer-wise relevance propagation (LRP) has been introduced as one of these novel methods that aim to provide visual interp…
▽ More
The use of convolutional neural networks (CNNs) for classification tasks has become dominant in various medical imaging applications. At the same time, recent advances in interpretable machine learning techniques have shown great potential in explaining classifiers' decisions. Layer-wise relevance propagation (LRP) has been introduced as one of these novel methods that aim to provide visual interpretation for the network's decisions. In this work we propose the application of 3D CNNs with LRP for the first time for neonatal T2-weighted magnetic resonance imaging (MRI) data analysis. Through LRP, the decisions of our trained classifier are transformed into heatmaps indicating each voxel's relevance for the outcome of the decision. Our resulting LRP heatmaps reveal anatomically plausible features in distinguishing preterm neonates from term ones.
△ Less
Submitted 30 September, 2019;
originally announced October 2019.
-
In utero diffusion MRI: challenges, advances, and applications
Authors:
Daan Christiaens,
Paddy J. Slator,
Lucilio Cordero-Grande,
Anthony N. Price,
Maria Deprez,
Daniel C. Alexander,
Mary Rutherford,
Joseph V. Hajnal,
Jana Hutter
Abstract:
In utero diffusion MRI provides unique opportunities to non-invasively study the microstructure of tissue during fetal development. A wide range of developmental processes, such as the growth of white matter tracts in the brain, the maturation of placental villous trees, or the fibres in the fetal heart remain to be studied and understood in detail. Advances in fetal interventions and surgery furt…
▽ More
In utero diffusion MRI provides unique opportunities to non-invasively study the microstructure of tissue during fetal development. A wide range of developmental processes, such as the growth of white matter tracts in the brain, the maturation of placental villous trees, or the fibres in the fetal heart remain to be studied and understood in detail. Advances in fetal interventions and surgery furthermore increase the need for ever more precise antenatal diagnosis from fetal MRI. However, the specific properties of the in utero environment, such as fetal and maternal motion, increased field-of-view, tissue interfaces and safety considerations, are significant challenges for most MRI techniques, and particularly for diffusion. Recent years have seen major improvements, driven by the development of bespoke techniques adapted to these specific challenges in both acquisition and processing. Fetal diffusion MRI, an emerging research tool, is now adding valuable novel information for both research and clinical questions. This paper will highlight specific challenges, outline strategies to target them, and discuss two main applications: fetal brain connectomics and placental maturation.
△ Less
Submitted 28 May, 2019;
originally announced May 2019.
-
Scattered slice SHARD reconstruction for motion correction in multi-shell diffusion MRI
Authors:
Daan Christiaens,
Lucilio Cordero-Grande,
Maximilian Pietsch,
Jana Hutter,
Anthony N. Price,
Emer J. Hughes,
Katy Vecchiato,
Maria Deprez,
A. David Edwards,
Joseph V. Hajnal,
J-Donald Tournier
Abstract:
Diffusion MRI offers a unique probe into neural microstructure and connectivity in the develo** brain. However, analysis of neonatal brain imaging data is complicated by inevitable subject motion, leading to a series of scattered slices that need to be aligned within and across diffusion-weighted contrasts. Here, we develop a reconstruction method for scattered slice multi-shell high angular res…
▽ More
Diffusion MRI offers a unique probe into neural microstructure and connectivity in the develo** brain. However, analysis of neonatal brain imaging data is complicated by inevitable subject motion, leading to a series of scattered slices that need to be aligned within and across diffusion-weighted contrasts. Here, we develop a reconstruction method for scattered slice multi-shell high angular resolution diffusion imaging (HARDI) data, jointly estimating an uncorrupted data representation and motion parameters at the slice or multiband excitation level. The reconstruction relies on data-driven representation of multi-shell HARDI data using a bespoke spherical harmonics and radial decomposition (SHARD), which avoids imposing model assumptions, thus facilitating to compare various microstructure imaging methods in the reconstructed output. Furthermore, the proposed framework integrates slice-level outlier rejection, distortion correction, and slice profile correction. We evaluate the method in the neonatal cohort of the develo** Human Connectome Project (650 scans). Validation experiments demonstrate accurate slice-level motion correction across the age range and across the range of motion in the population. Results in the neonatal data show successful reconstruction even in severely motion-corrupted subjects. In addition, we illustrate how local tissue modelling can extract advanced microstructure features such as orientation distribution functions from the motion-corrected reconstructions.
△ Less
Submitted 21 April, 2020; v1 submitted 8 May, 2019;
originally announced May 2019.
-
Complex diffusion-weighted image estimation via matrix recovery under general noise models
Authors:
Lucilio Cordero-Grande,
Daan Christiaens,
Jana Hutter,
Anthony N. Price,
Joseph V. Hajnal
Abstract:
We propose a patch-based singular value shrinkage method for diffusion magnetic resonance image estimation targeted at low signal to noise ratio and accelerated acquisitions. It operates on the complex data resulting from a sensitivity encoding reconstruction, where asymptotically optimal signal recovery guarantees can be attained by modeling the noise propagation in the reconstruction and subsequ…
▽ More
We propose a patch-based singular value shrinkage method for diffusion magnetic resonance image estimation targeted at low signal to noise ratio and accelerated acquisitions. It operates on the complex data resulting from a sensitivity encoding reconstruction, where asymptotically optimal signal recovery guarantees can be attained by modeling the noise propagation in the reconstruction and subsequently simulating or calculating the limit singular value spectrum. Simple strategies are presented to deal with phase inconsistencies and optimize patch construction. The pertinence of our contributions is quantitatively validated on synthetic data, an in vivo adult example, and challenging neonatal and fetal cohorts. Our methodology is compared with related approaches, which generally operate on magnitude-only data and use data-based noise level estimation and singular value truncation. Visual examples are provided to illustrate effectiveness in generating denoised and debiased diffusion estimates with well preserved spatial and diffusion detail.
△ Less
Submitted 20 June, 2019; v1 submitted 14 December, 2018;
originally announced December 2018.
-
MIXANDMIX: numerical techniques for the computation of empirical spectral distributions of population mixtures
Authors:
Lucilio Cordero-Grande
Abstract:
The MIXANDMIX (mixtures by Anderson mixing) tool for the computation of the empirical spectral distribution of random matrices generated by mixtures of populations is described. Within the population mixture model the map** between the population distributions and the limiting spectral distribution can be obtained by solving a set of systems of non-linear equations, for which an efficient implem…
▽ More
The MIXANDMIX (mixtures by Anderson mixing) tool for the computation of the empirical spectral distribution of random matrices generated by mixtures of populations is described. Within the population mixture model the map** between the population distributions and the limiting spectral distribution can be obtained by solving a set of systems of non-linear equations, for which an efficient implementation is provided. The contributions include a method for accelerated fixed point convergence, a homotopy continuation strategy to prevent convergence to non-admissible solutions, a blind non-uniform grid construction for effective distribution support detection and approximation, and a parallel computing architecture. Comparisons are performed with available packages for the single population case and with results obtained by simulation for the more general model implemented here. Results show competitive performance and improved flexibility.
△ Less
Submitted 20 June, 2019; v1 submitted 13 December, 2018;
originally announced December 2018.
-
Learning compact q-space representations for multi-shell diffusion-weighted MRI
Authors:
Daan Christiaens,
Lucilio Cordero-Grande,
Jana Hutter,
Anthony N. Price,
Maria Deprez,
Joseph V. Hajnal,
J-Donald Tournier
Abstract:
Diffusion-weighted MRI measures the direction and scale of the local diffusion process in every voxel through its spectrum in q-space, typically acquired in one or more shells. Recent developments in microstructure imaging and multi-tissue decomposition have sparked renewed attention in the radial b-value dependence of the signal. Applications in motion correction and outlier rejection therefore r…
▽ More
Diffusion-weighted MRI measures the direction and scale of the local diffusion process in every voxel through its spectrum in q-space, typically acquired in one or more shells. Recent developments in microstructure imaging and multi-tissue decomposition have sparked renewed attention in the radial b-value dependence of the signal. Applications in motion correction and outlier rejection therefore require a compact linear signal representation that extends over the radial as well as angular domain. Here, we introduce SHARD, a data-driven representation of the q-space signal based on spherical harmonics and a radial decomposition into orthonormal components. This representation provides a complete, orthogonal signal basis, tailored to the spherical geometry of q-space and calibrated to the data at hand. We demonstrate that the rank-reduced decomposition outperforms model-based alternatives in human brain data, whilst faithfully capturing the micro- and meso-structural information in the signal. Furthermore, we validate the potential of joint radial-spherical as compared to single-shell representations. As such, SHARD is optimally suited for applications that require low-rank signal predictions, such as motion correction and outlier rejection. Finally, we illustrate its application for the latter using outlier robust regression.
△ Less
Submitted 8 October, 2018; v1 submitted 17 June, 2018;
originally announced June 2018.
