-
A method for quantifying sectoral optic disc pallor in fundus photographs and its association with peripapillary RNFL thickness
Authors:
Samuel Gibbon,
Graciela Muniz-Terrera,
Fabian SL Yii,
Charlene Hamid,
Simon Cox,
Ian JC Maccormick,
Andrew J Tatham,
Craig Ritchie,
Emanuele Trucco,
Baljean Dhillon,
Thomas J MacGillivray
Abstract:
Purpose: To develop an automatic method of quantifying optic disc pallor in fundus photographs and determine associations with peripapillary retinal nerve fibre layer (pRNFL) thickness.
Methods: We used deep learning to segment the optic disc, fovea, and vessels in fundus photographs, and measured pallor. We assessed the relationship between pallor and pRNFL thickness derived from optical cohere…
▽ More
Purpose: To develop an automatic method of quantifying optic disc pallor in fundus photographs and determine associations with peripapillary retinal nerve fibre layer (pRNFL) thickness.
Methods: We used deep learning to segment the optic disc, fovea, and vessels in fundus photographs, and measured pallor. We assessed the relationship between pallor and pRNFL thickness derived from optical coherence tomography scans in 118 participants. Separately, we used images diagnosed by clinical inspection as pale (N=45) and assessed how measurements compared to healthy controls (N=46). We also developed automatic rejection thresholds, and tested the software for robustness to camera type, image format, and resolution.
Results: We developed software that automatically quantified disc pallor across several zones in fundus photographs. Pallor was associated with pRNFL thickness globally (\b{eta} = -9.81 (SE = 3.16), p < 0.05), in the temporal inferior zone (\b{eta} = -29.78 (SE = 8.32), p < 0.01), with the nasal/temporal ratio (\b{eta} = 0.88 (SE = 0.34), p < 0.05), and in the whole disc (\b{eta} = -8.22 (SE = 2.92), p < 0.05). Furthermore, pallor was significantly higher in the patient group. Lastly, we demonstrate the analysis to be robust to camera type, image format, and resolution.
Conclusions: We developed software that automatically locates and quantifies disc pallor in fundus photographs and found associations between pallor measurements and pRNFL thickness.
Translational relevance: We think our method will be useful for the identification, monitoring and progression of diseases characterized by disc pallor/optic atrophy, including glaucoma, compression, and potentially in neurodegenerative disorders.
△ Less
Submitted 13 November, 2023;
originally announced November 2023.
-
Development of a Deep Learning Method to Identify Acute Ischemic Stroke Lesions on Brain CT
Authors:
Alessandro Fontanella,
Wenwen Li,
Grant Mair,
Antreas Antoniou,
Eleanor Platt,
Paul Armitage,
Emanuele Trucco,
Joanna Wardlaw,
Amos Storkey
Abstract:
Computed Tomography (CT) is commonly used to image acute ischemic stroke (AIS) patients, but its interpretation by radiologists is time-consuming and subject to inter-observer variability. Deep learning (DL) techniques can provide automated CT brain scan assessment, but usually require annotated images. Aiming to develop a DL method for AIS using labelled but not annotated CT brain scans from pati…
▽ More
Computed Tomography (CT) is commonly used to image acute ischemic stroke (AIS) patients, but its interpretation by radiologists is time-consuming and subject to inter-observer variability. Deep learning (DL) techniques can provide automated CT brain scan assessment, but usually require annotated images. Aiming to develop a DL method for AIS using labelled but not annotated CT brain scans from patients with AIS, we designed a convolutional neural network-based DL algorithm using routinely-collected CT brain scans from the Third International Stroke Trial (IST-3), which were not acquired using strict research protocols. The DL model aimed to detect AIS lesions and classify the side of the brain affected. We explored the impact of AIS lesion features, background brain appearances, and timing on DL performance. From 5772 unique CT scans of 2347 AIS patients (median age 82), 54% had visible AIS lesions according to expert labelling. Our best-performing DL method achieved 72% accuracy for lesion presence and side. Lesions that were larger (80% accuracy) or multiple (87% accuracy for two lesions, 100% for three or more), were better detected. Follow-up scans had 76% accuracy, while baseline scans 67% accuracy. Chronic brain conditions reduced accuracy, particularly non-stroke lesions and old stroke lesions (32% and 31% error rates respectively). DL methods can be designed for AIS lesion detection on CT using the vast quantities of routinely-collected CT brain scan data. Ultimately, this should lead to more robust and widely-applicable methods.
△ Less
Submitted 29 September, 2023;
originally announced September 2023.
-
Challenges of building medical image datasets for development of deep learning software in stroke
Authors:
Alessandro Fontanella,
Wenwen Li,
Grant Mair,
Antreas Antoniou,
Eleanor Platt,
Chloe Martin,
Paul Armitage,
Emanuele Trucco,
Joanna Wardlaw,
Amos Storkey
Abstract:
Despite the large amount of brain CT data generated in clinical practice, the availability of CT datasets for deep learning (DL) research is currently limited. Furthermore, the data can be insufficiently or improperly prepared for machine learning and thus lead to spurious and irreproducible analyses. This lack of access to comprehensive and diverse datasets poses a significant challenge for the d…
▽ More
Despite the large amount of brain CT data generated in clinical practice, the availability of CT datasets for deep learning (DL) research is currently limited. Furthermore, the data can be insufficiently or improperly prepared for machine learning and thus lead to spurious and irreproducible analyses. This lack of access to comprehensive and diverse datasets poses a significant challenge for the development of DL algorithms. In this work, we propose a complete semi-automatic pipeline to address the challenges of preparing a clinical brain CT dataset for DL analysis and describe the process of standardising this heterogeneous dataset. Challenges include handling image sets with different orientations (axial, sagittal, coronal), different image types (to view soft tissues or bones) and dimensions, and removing redundant background. The final pipeline was able to process 5,868/10,659 (45%) CT image datasets. Reasons for rejection include non-axial data (n=1,920), bone reformats (n=687), separated skull base/vault images (n=1,226), and registration failures (n=465). Further format adjustments, including image crop**, resizing and scaling are also needed for DL processing. Of the axial scans that were not localisers, bone reformats or split brains, 5,868/6,333 (93%) were accepted, while the remaining 465 failed the registration process. Appropriate preparation of medical imaging datasets for DL is a costly and time-intensive process.
△ Less
Submitted 26 September, 2023;
originally announced September 2023.
-
Diffusion Models for Counterfactual Generation and Anomaly Detection in Brain Images
Authors:
Alessandro Fontanella,
Grant Mair,
Joanna Wardlaw,
Emanuele Trucco,
Amos Storkey
Abstract:
Segmentation masks of pathological areas are useful in many medical applications, such as brain tumour and stroke management. Moreover, healthy counterfactuals of diseased images can be used to enhance radiologists' training files and to improve the interpretability of segmentation models. In this work, we present a weakly supervised method to generate a healthy version of a diseased image and the…
▽ More
Segmentation masks of pathological areas are useful in many medical applications, such as brain tumour and stroke management. Moreover, healthy counterfactuals of diseased images can be used to enhance radiologists' training files and to improve the interpretability of segmentation models. In this work, we present a weakly supervised method to generate a healthy version of a diseased image and then use it to obtain a pixel-wise anomaly map. To do so, we start by considering a saliency map that approximately covers the pathological areas, obtained with ACAT. Then, we propose a technique that allows to perform targeted modifications to these regions, while preserving the rest of the image. In particular, we employ a diffusion model trained on healthy samples and combine Denoising Diffusion Probabilistic Model (DDPM) and Denoising Diffusion Implicit Model (DDIM) at each step of the sampling process. DDPM is used to modify the areas affected by a lesion within the saliency map, while DDIM guarantees reconstruction of the normal anatomy outside of it. The two parts are also fused at each timestep, to guarantee the generation of a sample with a coherent appearance and a seamless transition between edited and unedited parts. We verify that when our method is applied to healthy samples, the input images are reconstructed without significant modifications. We compare our approach with alternative weakly supervised methods on IST-3 for stroke lesion segmentation and on BraTS2021 for brain tumour segmentation, where we improve the DICE score of the best competing method from $0.6534$ to $0.7056$.
△ Less
Submitted 3 August, 2023;
originally announced August 2023.
-
ACAT: Adversarial Counterfactual Attention for Classification and Detection in Medical Imaging
Authors:
Alessandro Fontanella,
Antreas Antoniou,
Wenwen Li,
Joanna Wardlaw,
Grant Mair,
Emanuele Trucco,
Amos Storkey
Abstract:
In some medical imaging tasks and other settings where only small parts of the image are informative for the classification task, traditional CNNs can sometimes struggle to generalise. Manually annotated Regions of Interest (ROI) are sometimes used to isolate the most informative parts of the image. However, these are expensive to collect and may vary significantly across annotators. To overcome t…
▽ More
In some medical imaging tasks and other settings where only small parts of the image are informative for the classification task, traditional CNNs can sometimes struggle to generalise. Manually annotated Regions of Interest (ROI) are sometimes used to isolate the most informative parts of the image. However, these are expensive to collect and may vary significantly across annotators. To overcome these issues, we propose a framework that employs saliency maps to obtain soft spatial attention masks that modulate the image features at different scales. We refer to our method as Adversarial Counterfactual Attention (ACAT). ACAT increases the baseline classification accuracy of lesions in brain CT scans from 71.39% to 72.55% and of COVID-19 related findings in lung CT scans from 67.71% to 70.84% and exceeds the performance of competing methods. We investigate the best way to generate the saliency maps employed in our architecture and propose a way to obtain them from adversarially generated counterfactual images. They are able to isolate the area of interest in brain and lung CT scans without using any manual annotations. In the task of localising the lesion location out of 6 possible regions, they obtain a score of 65.05% on brain CT scans, improving the score of 61.29% obtained with the best competing method.
△ Less
Submitted 11 August, 2023; v1 submitted 27 March, 2023;
originally announced March 2023.
-
SoftEnNet: Symbiotic Monocular Depth Estimation and Lumen Segmentation for Colonoscopy Endorobots
Authors:
Alwyn Mathew,
Ludovic Magerand,
Emanuele Trucco,
Luigi Manfredi
Abstract:
Colorectal cancer is the third most common cause of cancer death worldwide. Optical colonoscopy is the gold standard for detecting colorectal cancer; however, about 25 percent of polyps are missed during the procedure. A vision-based autonomous endorobot can improve colonoscopy procedures significantly through systematic, complete screening of the colonic mucosa. The reliable robot navigation need…
▽ More
Colorectal cancer is the third most common cause of cancer death worldwide. Optical colonoscopy is the gold standard for detecting colorectal cancer; however, about 25 percent of polyps are missed during the procedure. A vision-based autonomous endorobot can improve colonoscopy procedures significantly through systematic, complete screening of the colonic mucosa. The reliable robot navigation needed requires a three-dimensional understanding of the environment and lumen tracking to support autonomous tasks. We propose a novel multi-task model that simultaneously predicts dense depth and lumen segmentation with an ensemble of deep networks. The depth estimation sub-network is trained in a self-supervised fashion guided by view synthesis; the lumen segmentation sub-network is supervised. The two sub-networks are interconnected with pathways that enable information exchange and thereby mutual learning. As the lumen is in the image's deepest visual space, lumen segmentation helps with the depth estimation at the farthest location. In turn, the estimated depth guides the lumen segmentation network as the lumen location defines the farthest scene location. Unlike other environments, view synthesis often fails in the colon because of the deformable wall, textureless surface, specularities, and wide field of view image distortions, all challenges that our pipeline addresses. We conducted qualitative analysis on a synthetic dataset and quantitative analysis on a colon training model and real colonoscopy videos. The experiments show that our model predicts accurate scale-invariant depth maps and lumen segmentation from colonoscopy images in near real-time.
△ Less
Submitted 19 January, 2023;
originally announced January 2023.
-
Machine learning of neuroimaging to diagnose cognitive impairment and dementia: a systematic review and comparative analysis
Authors:
Enrico Pellegrini,
Lucia Ballerini,
Maria del C. Valdes Hernandez,
Francesca M. Chappell,
Victor González-Castro,
Devasuda Anblagan,
Samuel Danso,
Susana Muñoz Maniega,
Dominic Job,
Cyril Pernet,
Grant Mair,
Tom MacGillivray,
Emanuele Trucco,
Joanna Wardlaw
Abstract:
INTRODUCTION: Advanced machine learning methods might help to identify dementia risk from neuroimaging, but their accuracy to date is unclear.
METHODS: We systematically reviewed the literature, 2006 to late 2016, for machine learning studies differentiating healthy ageing through to dementia of various types, assessing study quality, and comparing accuracy at different disease boundaries.
RES…
▽ More
INTRODUCTION: Advanced machine learning methods might help to identify dementia risk from neuroimaging, but their accuracy to date is unclear.
METHODS: We systematically reviewed the literature, 2006 to late 2016, for machine learning studies differentiating healthy ageing through to dementia of various types, assessing study quality, and comparing accuracy at different disease boundaries.
RESULTS: Of 111 relevant studies, most assessed Alzheimer's disease (AD) vs healthy controls, used ADNI data, support vector machines and only T1-weighted sequences. Accuracy was highest for differentiating AD from healthy controls, and poor for differentiating healthy controls vs MCI vs AD, or MCI converters vs non-converters. Accuracy increased using combined data types, but not by data source, sample size or machine learning method.
DISCUSSION: Machine learning does not differentiate clinically-relevant disease categories yet. More diverse datasets, combinations of different types of data, and close clinical integration of machine learning would help to advance the field.
△ Less
Submitted 11 April, 2018; v1 submitted 5 April, 2018;
originally announced April 2018.
-
A non-archimedean Montel's theorem
Authors:
Charles Favre,
Jan Kiwi,
Eugenio Trucco
Abstract:
We prove a version of Montel's theorem for analytic functions over a non-archimedean complete valued field. We propose a definition of normal family in this context, and give applications of our results to the dynamics of non-archimedean entire functions.
We prove a version of Montel's theorem for analytic functions over a non-archimedean complete valued field. We propose a definition of normal family in this context, and give applications of our results to the dynamics of non-archimedean entire functions.
△ Less
Submitted 21 September, 2011; v1 submitted 4 May, 2011;
originally announced May 2011.
-
Wandering Fatou Components and Algebraic Julia Sets
Authors:
Eugenio Trucco
Abstract:
We study the dynamics of polynomials with coefficients in a non-Archimedean field $K,$ where $K$ is a field containing a dense subset of algebraic elements over a discrete valued field $k.$ We prove that every wandering Fatou component is contained in the basin of a periodic orbit. We obtain a complete description of the new Julia set points that appear when passing from $K$ to the Berkovich lin…
▽ More
We study the dynamics of polynomials with coefficients in a non-Archimedean field $K,$ where $K$ is a field containing a dense subset of algebraic elements over a discrete valued field $k.$ We prove that every wandering Fatou component is contained in the basin of a periodic orbit. We obtain a complete description of the new Julia set points that appear when passing from $K$ to the Berkovich line over $K$. We give a dynamical characterization of polynomials having algebraic Julia sets. More precisely, we establish that a polynomial with algebraic coefficients has algebraic Julia set if every critical element is nonrecurrent.
△ Less
Submitted 13 May, 2010; v1 submitted 24 September, 2009;
originally announced September 2009.
