CT-based COVID-19 Triage: Deep Multitask Learning Improves Joint Identification and Severity Quantification
Authors:
Mikhail Goncharov,
Maxim Pisov,
Alexey Shevtsov,
Boris Shirokikh,
Anvar Kurmukov,
Ivan Blokhin,
Valeria Chernina,
Alexander Solovev,
Victor Gombolevskiy,
Sergey Morozov,
Mikhail Belyaev
Abstract:
The current COVID-19 pandemic overloads healthcare systems, including radiology departments. Though several deep learning approaches were developed to assist in CT analysis, nobody considered study triage directly as a computer science problem. We describe two basic setups: Identification of COVID-19 to prioritize studies of potentially infected patients to isolate them as early as possible; Sever…
▽ More
The current COVID-19 pandemic overloads healthcare systems, including radiology departments. Though several deep learning approaches were developed to assist in CT analysis, nobody considered study triage directly as a computer science problem. We describe two basic setups: Identification of COVID-19 to prioritize studies of potentially infected patients to isolate them as early as possible; Severity quantification to highlight studies of severe patients and direct them to a hospital or provide emergency medical care. We formalize these tasks as binary classification and estimation of affected lung percentage. Though similar problems were well-studied separately, we show that existing methods provide reasonable quality only for one of these setups. We employ a multitask approach to consolidate both triage approaches and propose a convolutional neural network to combine all available labels within a single model. In contrast with the most popular multitask approaches, we add classification layers to the most spatially detailed upper part of U-Net instead of the bottom, less detailed latent representation. We train our model on approximately 2000 publicly available CT studies and test it with a carefully designed set consisting of 32 COVID-19 studies, 30 cases with bacterial pneumonia, 31 healthy patients, and 30 patients with other lung pathologies to emulate a typical patient flow in an out-patient hospital. The proposed multitask model outperforms the latent-based one and achieves ROC AUC scores ranging from 0.87+-01 (bacterial pneumonia) to 0.97+-01 (healthy controls) for Identification of COVID-19 and 0.97+-01 Spearman Correlation for Severity quantification. We release all the code and create a public leaderboard, where other community members can test their models on our test dataset.
△ Less
Submitted 26 November, 2020; v1 submitted 2 June, 2020;
originally announced June 2020.
Incorporating Task-Specific Structural Knowledge into CNNs for Brain Midline Shift Detection
Authors:
Maxim Pisov,
Mikhail Goncharov,
Nadezhda Kurochkina,
Sergey Morozov,
Victor Gombolevskiy,
Valeria Chernina,
Anton Vladzymyrskyy,
Ksenia Zamyatina,
Anna Chesnokova,
Igor Pronin,
Michael Shifrin,
Mikhail Belyaev
Abstract:
Midline shift (MLS) is a well-established factor used for outcome prediction in traumatic brain injury, stroke and brain tumors. The importance of automatic estimation of MLS was recently highlighted by ACR Data Science Institute. In this paper we introduce a novel deep learning based approach for the problem of MLS detection, which exploits task-specific structural knowledge. We evaluate our meth…
▽ More
Midline shift (MLS) is a well-established factor used for outcome prediction in traumatic brain injury, stroke and brain tumors. The importance of automatic estimation of MLS was recently highlighted by ACR Data Science Institute. In this paper we introduce a novel deep learning based approach for the problem of MLS detection, which exploits task-specific structural knowledge. We evaluate our method on a large dataset containing heterogeneous images with significant MLS and show that its mean error approaches the inter-expert variability. Finally, we show the robustness of our approach by validating it on an external dataset, acquired during routine clinical practice.
△ Less
Submitted 14 December, 2019; v1 submitted 13 August, 2019;
originally announced August 2019.
