-
A Comparison of Self-Supervised Pretraining Approaches for Predicting Disease Risk from Chest Radiograph Images
Authors:
Yanru Chen,
Michael T Lu,
Vineet K Raghu
Abstract:
Deep learning is the state-of-the-art for medical imaging tasks, but requires large, labeled datasets. For risk prediction, large datasets are rare since they require both imaging and follow-up (e.g., diagnosis codes). However, the release of publicly available imaging data with diagnostic labels presents an opportunity for self and semi-supervised approaches to improve label efficiency for risk p…
▽ More
Deep learning is the state-of-the-art for medical imaging tasks, but requires large, labeled datasets. For risk prediction, large datasets are rare since they require both imaging and follow-up (e.g., diagnosis codes). However, the release of publicly available imaging data with diagnostic labels presents an opportunity for self and semi-supervised approaches to improve label efficiency for risk prediction. Though several studies have compared self-supervised approaches in natural image classification, object detection, and medical image interpretation, there is limited data on which approaches learn robust representations for risk prediction. We present a comparison of semi- and self-supervised learning to predict mortality risk using chest x-ray images. We find that a semi-supervised autoencoder outperforms contrastive and transfer learning in internal and external validation.
△ Less
Submitted 15 June, 2023;
originally announced June 2023.
-
Deep Learning-based Assessment of Hepatic Steatosis on chest CT
Authors:
Zhongyi Zhang,
Jakob Weiss,
Jana Taron,
Roman Zeleznik,
Michael T. Lu,
Hugo J. W. L. Aerts
Abstract:
Purpose: Automatic methods are required for the early detection of hepatic steatosis to avoid progression to cirrhosis and cancer. Here, we developed a fully automated deep learning pipeline to quantify hepatic steatosis on non-contrast enhanced chest computed tomography (CT) scans. Materials and Methods: We developed and evaluated our pipeline on chest CT images of 1,431 randomly selected Nationa…
▽ More
Purpose: Automatic methods are required for the early detection of hepatic steatosis to avoid progression to cirrhosis and cancer. Here, we developed a fully automated deep learning pipeline to quantify hepatic steatosis on non-contrast enhanced chest computed tomography (CT) scans. Materials and Methods: We developed and evaluated our pipeline on chest CT images of 1,431 randomly selected National Lung Screening Trial (NLST) participants. A dataset of 451 CT scans with volumetric liver segmentations of expert readers was used for training a deep learning model. For testing, in an independent dataset of 980 CT scans hepatic attenuation was manually measured by an expert reader on three cross-sectional images at different hepatic levels by selecting three circular regions of interest. Additionally, 100 randomly selected cases of the test set were volumetrically segmented by expert readers. Hepatic steatosis on the test set was defined as mean hepatic attenuation of < 40 Hounsfield unit. Spearman correlation was conducted to analyze liver fat quantification accuracy and the Cohen's Kappa coefficient was calculated for hepatic steatosis prediction reliability. Results: Our pipeline demonstrated strong performance and achieved a mean dice score of 0.970 for the volumetric liver segmentation. The spearman correlation of the liver fat quantification was 0.954 (P <0.0001) between the automated and expert reader measurements. The cohen's kappa coefficient was 0.875 for automatic assessment of hepatic steatosis. Conclusion: We developed a fully automatic deep learning-based pipeline for the assessment of hepatic steatosis in chest CT images. With the fast and cheap screening of hepatic steatosis, our pipeline has the potential to help initiate preventive measures to avoid progression to cirrhosis and cancer.
△ Less
Submitted 4 February, 2022;
originally announced February 2022.
-
ModelHub.AI: Dissemination Platform for Deep Learning Models
Authors:
Ahmed Hosny,
Michael Schwier,
Christoph Berger,
Evin P Örnek,
Mehmet Turan,
Phi V Tran,
Leon Weninger,
Fabian Isensee,
Klaus H Maier-Hein,
Richard McKinley,
Michael T Lu,
Udo Hoffmann,
Bjoern Menze,
Spyridon Bakas,
Andriy Fedorov,
Hugo JWL Aerts
Abstract:
Recent advances in artificial intelligence research have led to a profusion of studies that apply deep learning to problems in image analysis and natural language processing among others. Additionally, the availability of open-source computational frameworks has lowered the barriers to implementing state-of-the-art methods across multiple domains. Albeit leading to major performance breakthroughs…
▽ More
Recent advances in artificial intelligence research have led to a profusion of studies that apply deep learning to problems in image analysis and natural language processing among others. Additionally, the availability of open-source computational frameworks has lowered the barriers to implementing state-of-the-art methods across multiple domains. Albeit leading to major performance breakthroughs in some tasks, effective dissemination of deep learning algorithms remains challenging, inhibiting reproducibility and benchmarking studies, impeding further validation, and ultimately hindering their effectiveness in the cumulative scientific progress. In develo** a platform for sharing research outputs, we present ModelHub.AI (www.modelhub.ai), a community-driven container-based software engine and platform for the structured dissemination of deep learning models. For contributors, the engine controls data flow throughout the inference cycle, while the contributor-facing standard template exposes model-specific functions including inference, as well as pre- and post-processing. Python and RESTful Application programming interfaces (APIs) enable users to interact with models hosted on ModelHub.AI and allows both researchers and developers to utilize models out-of-the-box. ModelHub.AI is domain-, data-, and framework-agnostic, catering to different workflows and contributors' preferences.
△ Less
Submitted 26 November, 2019;
originally announced November 2019.