-
High-resolution 3D Maps of Left Atrial Displacements using an Unsupervised Image Registration Neural Network
Authors:
Christoforos Galazis,
Anil Anthony Bharath,
Marta Varela
Abstract:
Functional analysis of the left atrium (LA) plays an increasingly important role in the prognosis and diagnosis of cardiovascular diseases. Echocardiography-based measurements of LA dimensions and strains are useful biomarkers, but they provide an incomplete picture of atrial deformations. High-resolution dynamic magnetic resonance images (Cine MRI) offer the opportunity to examine LA motion and d…
▽ More
Functional analysis of the left atrium (LA) plays an increasingly important role in the prognosis and diagnosis of cardiovascular diseases. Echocardiography-based measurements of LA dimensions and strains are useful biomarkers, but they provide an incomplete picture of atrial deformations. High-resolution dynamic magnetic resonance images (Cine MRI) offer the opportunity to examine LA motion and deformation in 3D, at higher spatial resolution and with full LA coverage. However, there are no dedicated tools to automatically characterise LA motion in 3D. Thus, we propose a tool that automatically segments the LA and extracts the displacement fields across the cardiac cycle. The pipeline is able to accurately track the LA wall across the cardiac cycle with an average Hausdorff distance of $2.51 \pm 1.3~mm$ and Dice score of $0.96 \pm 0.02$.
△ Less
Submitted 5 September, 2023;
originally announced September 2023.
-
Prototype of a Cardiac MRI Simulator for the Training of Supervised Neural Networks
Authors:
Marta Varela,
Anil A Bharath
Abstract:
Supervised deep learning methods typically rely on large datasets for training. Ethical and practical considerations usually make it difficult to access large amounts of healthcare data, such as medical images, with known task-specific ground truth. This hampers the development of adequate, unbiased and robust deep learning methods for clinical tasks.
Magnetic Resonance Images (MRI) are the resu…
▽ More
Supervised deep learning methods typically rely on large datasets for training. Ethical and practical considerations usually make it difficult to access large amounts of healthcare data, such as medical images, with known task-specific ground truth. This hampers the development of adequate, unbiased and robust deep learning methods for clinical tasks.
Magnetic Resonance Images (MRI) are the result of several complex physical and engineering processes and the generation of synthetic MR images provides a formidable challenge. Here, we present the first results of ongoing work to create a generator for large synthetic cardiac MR image datasets. As an application for the simulator, we show how the synthetic images can be used to help train a supervised neural network that estimates the volume of the left ventricular myocardium directly from cardiac MR images.
Despite its current limitations, our generator may in the future help address the current shortage of labelled cardiac MRI needed for the development of supervised deep learning tools. It is likely to also find applications in the development of image reconstruction methods and tools to improve robustness, verification and interpretability of deep networks in this setting.
△ Less
Submitted 25 May, 2023;
originally announced May 2023.
-
Automatic Aortic Valve Pathology Detection from 3-Chamber Cine MRI with Spatio-Temporal Attention Maps
Authors:
Y. On,
K. Vimalesvaran,
C. Galazis,
S. Zaman,
J. Howard,
N. Linton,
N. Peters,
G. Cole,
A. A. Bharath,
M. Varela
Abstract:
The assessment of aortic valve pathology using magnetic resonance imaging (MRI) typically relies on blood velocity estimates acquired using phase contrast (PC) MRI. However, abnormalities in blood flow through the aortic valve often manifest by the dephasing of blood signal in gated balanced steady-state free precession (bSSFP) scans (Cine MRI). We propose a 3D classification neural network (NN) t…
▽ More
The assessment of aortic valve pathology using magnetic resonance imaging (MRI) typically relies on blood velocity estimates acquired using phase contrast (PC) MRI. However, abnormalities in blood flow through the aortic valve often manifest by the dephasing of blood signal in gated balanced steady-state free precession (bSSFP) scans (Cine MRI). We propose a 3D classification neural network (NN) to automatically identify aortic valve pathology (aortic regurgitation, aortic stenosis, mixed valve disease) from Cine MR images. We train and test our approach on a retrospective clinical dataset from three UK hospitals, using single-slice 3-chamber cine MRI from N = 576 patients. Our classification model accurately predicts the presence of aortic valve pathology (AVD) with an accuracy of 0.85 +/- 0.03 and can also correctly discriminate the type of AVD pathology (accuracy: 0.75 +/- 0.03). Gradient-weighted class activation map** (Grad-CAM) confirms that the blood pool voxels close to the aortic root contribute the most to the classification. Our approach can be used to improve the diagnosis of AVD and optimise clinical CMR protocols for accurate and efficient AVD detection.
△ Less
Submitted 14 April, 2023; v1 submitted 12 April, 2023;
originally announced April 2023.
-
PAT-CNN: Automatic Segmentation and Quantification of Pericardial Adipose Tissue from T2-Weighted Cardiac Magnetic Resonance Images
Authors:
Zhuoyu Li,
Camille Petri,
James Howard,
Graham Cole,
Marta Varela
Abstract:
Background: Increased pericardial adipose tissue (PAT) is associated with many types of cardiovascular disease (CVD). Although cardiac magnetic resonance images (CMRI) are often acquired in patients with CVD, there are currently no tools to automatically identify and quantify PAT from CMRI. The aim of this study was to create a neural network to segment PAT from T2-weighted CMRI and explore the co…
▽ More
Background: Increased pericardial adipose tissue (PAT) is associated with many types of cardiovascular disease (CVD). Although cardiac magnetic resonance images (CMRI) are often acquired in patients with CVD, there are currently no tools to automatically identify and quantify PAT from CMRI. The aim of this study was to create a neural network to segment PAT from T2-weighted CMRI and explore the correlations between PAT volumes (PATV) and CVD outcomes and mortality. Methods: We trained and tested a deep learning model, PAT-CNN, to segment PAT on T2-weighted cardiac MR images. Using the segmentations from PAT-CNN, we automatically calculated PATV on images from 391 patients. We analysed correlations between PATV and CVD diagnosis and 1-year mortality post-imaging. Results: PAT-CNN was able to accurately segment PAT with Dice score/ Hausdorff distances of 0.74 +- 0.03/27.1 +- 10.9~mm, similar to the values obtained when comparing the segmentations of two independent human observers ($0.76 +- 0.06/21.2 +- 10.3~mm$). Regression models showed that, independently of sex and body-mass index, PATV is significantly positively correlated with a diagnosis of CVD and with 1-year all cause mortality (p-value < 0.01). Conclusions: PAT-CNN can segment PAT from T2-weighted CMR images automatically and accurately. Increased PATV as measured automatically from CMRI is significantly associated with the presence of CVD and can independently predict 1-year mortality.
△ Less
Submitted 9 November, 2022;
originally announced November 2022.
-
Tempera: Spatial Transformer Feature Pyramid Network for Cardiac MRI Segmentation
Authors:
Christoforos Galazis,
Huiyi Wu,
Zhuoyu Li,
Camille Petri,
Anil A. Bharath,
Marta Varela
Abstract:
Assessing the structure and function of the right ventricle (RV) is important in the diagnosis of several cardiac pathologies. However, it remains more challenging to segment the RV than the left ventricle (LV). In this paper, we focus on segmenting the RV in both short (SA) and long-axis (LA) cardiac MR images simultaneously. For this task, we propose a new multi-input/output architecture, hybrid…
▽ More
Assessing the structure and function of the right ventricle (RV) is important in the diagnosis of several cardiac pathologies. However, it remains more challenging to segment the RV than the left ventricle (LV). In this paper, we focus on segmenting the RV in both short (SA) and long-axis (LA) cardiac MR images simultaneously. For this task, we propose a new multi-input/output architecture, hybrid 2D/3D geometric spatial TransformEr Multi-Pass fEature pyRAmid (Tempera). Our feature pyramid extends current designs by allowing not only a multi-scale feature output but multi-scale SA and LA input images as well. Tempera transfers learned features between SA and LA images via layer weight sharing and incorporates a geometric target transformer to map the predicted SA segmentation to LA space. Our model achieves an average Dice score of 0.836 and 0.798 for the SA and LA, respectively, and 26.31 mm and 31.19 mm Hausdorff distances. This opens up the potential for the incorporation of RV segmentation models into clinical workflows.
△ Less
Submitted 1 March, 2022;
originally announced March 2022.
-
Deep Learning methods for automatic evaluation of delayed enhancement-MRI. The results of the EMIDEC challenge
Authors:
Alain Lalande,
Zhihao Chen,
Thibaut Pommier,
Thomas Decourselle,
Abdul Qayyum,
Michel Salomon,
Dominique Ginhac,
Youssef Skandarani,
Arnaud Boucher,
Khawla Brahim,
Marleen de Bruijne,
Robin Camarasa,
Teresa M. Correia,
Xue Feng,
Kibrom B. Girum,
Anja Hennemuth,
Markus Huellebrand,
Raabid Hussain,
Matthias Ivantsits,
Jun Ma,
Craig Meyer,
Rishabh Sharma,
Jixi Shi,
Nikolaos V. Tsekos,
Marta Varela
, et al. (8 additional authors not shown)
Abstract:
A key factor for assessing the state of the heart after myocardial infarction (MI) is to measure whether the myocardium segment is viable after reperfusion or revascularization therapy. Delayed enhancement-MRI or DE-MRI, which is performed several minutes after injection of the contrast agent, provides high contrast between viable and nonviable myocardium and is therefore a method of choice to eva…
▽ More
A key factor for assessing the state of the heart after myocardial infarction (MI) is to measure whether the myocardium segment is viable after reperfusion or revascularization therapy. Delayed enhancement-MRI or DE-MRI, which is performed several minutes after injection of the contrast agent, provides high contrast between viable and nonviable myocardium and is therefore a method of choice to evaluate the extent of MI. To automatically assess myocardial status, the results of the EMIDEC challenge that focused on this task are presented in this paper. The challenge's main objectives were twofold. First, to evaluate if deep learning methods can distinguish between normal and pathological cases. Second, to automatically calculate the extent of myocardial infarction. The publicly available database consists of 150 exams divided into 50 cases with normal MRI after injection of a contrast agent and 100 cases with myocardial infarction (and then with a hyperenhanced area on DE-MRI), whatever their inclusion in the cardiac emergency department. Along with MRI, clinical characteristics are also provided. The obtained results issued from several works show that the automatic classification of an exam is a reachable task (the best method providing an accuracy of 0.92), and the automatic segmentation of the myocardium is possible. However, the segmentation of the diseased area needs to be improved, mainly due to the small size of these areas and the lack of contrast with the surrounding structures.
△ Less
Submitted 10 August, 2021; v1 submitted 9 August, 2021;
originally announced August 2021.
-
Automatic Myocardial Disease Prediction From Delayed-Enhancement Cardiac MRI and Clinical Information
Authors:
Ana Lourenço,
Eric Kerfoot,
Irina Grigorescu,
Cian M Scannell,
Marta Varela,
Teresa M Correia
Abstract:
Delayed-enhancement cardiac magnetic resonance (DE-CMR)provides important diagnostic and prognostic information on myocardial viability. The presence and extent of late gadolinium enhancement (LGE)in DE-CMR is negatively associated with the probability of improvement in left ventricular function after revascularization. Moreover, LGE findings can support the diagnosis of several other cardiomyopat…
▽ More
Delayed-enhancement cardiac magnetic resonance (DE-CMR)provides important diagnostic and prognostic information on myocardial viability. The presence and extent of late gadolinium enhancement (LGE)in DE-CMR is negatively associated with the probability of improvement in left ventricular function after revascularization. Moreover, LGE findings can support the diagnosis of several other cardiomyopathies, but their absence does not rule them out, making disease classification by visual assessment difficult. In this work, we propose deep learning neural networks that can automatically predict myocardial disease from patient clinical information and DE-CMR. All the proposed networks achieve very good classification accuracy (>85%). Including information from DE-CMR (directly as images or as metadata following DE-CMR segmentation) is valuable in this classification task, improving the accuracy to 95-100%.
△ Less
Submitted 16 October, 2020;
originally announced October 2020.
-
Left atrial ejection fraction estimation using SEGANet for fully automated segmentation of CINE MRI
Authors:
Ana Lourenço,
Eric Kerfoot,
Connor Dibblin,
Ebraham Alskaf,
Mustafa Anjari,
Anil A Bharath,
Andrew P King,
Henry Chubb,
Teresa M Correia,
Marta Varela
Abstract:
Atrial fibrillation (AF) is the most common sustained cardiac arrhythmia, characterised by a rapid and irregular electrical activation of the atria. Treatments for AF are often ineffective and few atrial biomarkers exist to automatically characterise atrial function and aid in treatment selection for AF. Clinical metrics of left atrial (LA) function, such as ejection fraction (EF) and active atria…
▽ More
Atrial fibrillation (AF) is the most common sustained cardiac arrhythmia, characterised by a rapid and irregular electrical activation of the atria. Treatments for AF are often ineffective and few atrial biomarkers exist to automatically characterise atrial function and aid in treatment selection for AF. Clinical metrics of left atrial (LA) function, such as ejection fraction (EF) and active atrial contraction ejection fraction (aEF), are promising, but have until now typically relied on volume estimations extrapolated from single-slice images. In this work, we study volumetric functional biomarkers of the LA using a fully automatic SEGmentation of the left Atrium based on a convolutional neural Network (SEGANet). SEGANet was trained using a dedicated data augmentation scheme to segment the LA, across all cardiac phases, in short axis dynamic (CINE) Magnetic Resonance Images (MRI) acquired with full cardiac coverage. Using the automatic segmentations, we plotted volumetric time curves for the LA and estimated LA EF and aEF automatically. The proposed method yields high quality segmentations that compare well with manual segmentations (Dice scores [$0.93 \pm 0.04$], median contour [$0.75 \pm 0.31$] mm and Hausdorff distances [$4.59 \pm 2.06$] mm). LA EF and aEF are also in agreement with literature values and are significantly higher in AF patients than in healthy volunteers. Our work opens up the possibility of automatically estimating LA volumes and functional biomarkers from multi-slice CINE MRI, bypassing the limitations of current single-slice methods and improving the characterisation of atrial function in AF patients.
△ Less
Submitted 31 August, 2020;
originally announced August 2020.