-
RadioPathomics: Multimodal Learning in Non-Small Cell Lung Cancer for Adaptive Radiotherapy
Authors:
Matteo Tortora,
Ermanno Cordelli,
Rosa Sicilia,
Lorenzo Nibid,
Edy Ippolito,
Giuseppe Perrone,
Sara Ramella,
Paolo Soda
Abstract:
The current cancer treatment practice collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent raise of radiomics and pathomics, i.e. the extraction of quantitative features from radiology and histopathology images routinely collected to predict clinical outcomes or to guid…
▽ More
The current cancer treatment practice collects multimodal data, such as radiology images, histopathology slides, genomics and clinical data. The importance of these data sources taken individually has fostered the recent raise of radiomics and pathomics, i.e. the extraction of quantitative features from radiology and histopathology images routinely collected to predict clinical outcomes or to guide clinical decisions using artificial intelligence algorithms. Nevertheless, how to combine them into a single multimodal framework is still an open issue. In this work we therefore develop a multimodal late fusion approach that combines hand-crafted features computed from radiomics, pathomics and clinical data to predict radiation therapy treatment outcomes for non-small-cell lung cancer patients. Within this context, we investigate eight different late fusion rules (i.e. product, maximum, minimum, mean, decision template, Dempster-Shafer, majority voting, and confidence rule) and two patient-wise aggregation rules leveraging the richness of information given by computer tomography images and whole-slide scans. The experiments in leave-one-patient-out cross-validation on an in-house cohort of 33 patients show that the proposed multimodal paradigm with an AUC equal to $90.9\%$ outperforms each unimodal approach, suggesting that data integration can advance precision medicine. As a further contribution, we also compare the hand-crafted representations with features automatically computed by deep networks, and the late fusion paradigm with early fusion, another popular multimodal approach. In both cases, the experiments show that the proposed multimodal approach provides the best results.
△ Less
Submitted 26 April, 2022;
originally announced April 2022.
-
AIforCOVID: predicting the clinical outcomes in patients with COVID-19 applying AI to chest-X-rays. An Italian multicentre study
Authors:
Paolo Soda,
Natascha Claudia D'Amico,
Jacopo Tessadori,
Giovanni Valbusa,
Valerio Guarrasi,
Chandra Bortolotto,
Muhammad Usman Akbar,
Rosa Sicilia,
Ermanno Cordelli,
Deborah Fazzini,
Michaela Cellina,
Giancarlo Oliva,
Giovanni Callea,
Silvia Panella,
Maurizio Cariati,
Diletta Cozzi,
Vittorio Miele,
Elvira Stellato,
Gian Paolo Carrafiello,
Giulia Castorani,
Annalisa Simeone,
Lorenzo Preda,
Giulio Iannello,
Alessio Del Bue,
Fabio Tedoldi
, et al. (3 additional authors not shown)
Abstract:
Recent epidemiological data report that worldwide more than 53 million people have been infected by SARS-CoV-2, resulting in 1.3 million deaths. The disease has been spreading very rapidly and few months after the identification of the first infected, shortage of hospital resources quickly became a problem. In this work we investigate whether chest X-ray (CXR) can be used as a possible tool for th…
▽ More
Recent epidemiological data report that worldwide more than 53 million people have been infected by SARS-CoV-2, resulting in 1.3 million deaths. The disease has been spreading very rapidly and few months after the identification of the first infected, shortage of hospital resources quickly became a problem. In this work we investigate whether chest X-ray (CXR) can be used as a possible tool for the early identification of patients at risk of severe outcome, like intensive care or death. CXR is a radiological technique that compared to computed tomography (CT) it is simpler, faster, more widespread and it induces lower radiation dose. We present a dataset including data collected from 820 patients by six Italian hospitals in spring 2020 during the first COVID-19 emergency. The dataset includes CXR images, several clinical attributes and clinical outcomes. We investigate the potential of artificial intelligence to predict the prognosis of such patients, distinguishing between severe and mild cases, thus offering a baseline reference for other researchers and practitioners. To this goal, we present three approaches that use features extracted from CXR images, either handcrafted or automatically by convolutional neuronal networks, which are then integrated with the clinical data. Exhaustive evaluation shows promising performance both in 10-fold and leave-one-centre-out cross-validation, implying that clinical data and images have the potential to provide useful information for the management of patients and hospital resources.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
Use of a Night-Tracking Camera for Characterization and Orbit improvement of Defunct Spacecraft
Authors:
E. Cordelli,
P. Schlatter,
P. Lauber,
T. Schildknecht
Abstract:
The precise knowledge of the positions of space debris objects and in particular of defunct satellites is fundamental for satellite operations. Several studies showed that it is possible to improve the accuracy of the orbit determination results by fusing different types of observables, i.e. classical astrometric positions and range measurements. Particularly promising in the space debris field ar…
▽ More
The precise knowledge of the positions of space debris objects and in particular of defunct satellites is fundamental for satellite operations. Several studies showed that it is possible to improve the accuracy of the orbit determination results by fusing different types of observables, i.e. classical astrometric positions and range measurements. Particularly promising in the space debris field are the ranges provided by a satellite laser ranging system. The factors that limit the applicability of the satellite laser ranging (SLR) techniques are the altitude of the target, the accuracy of the predicted ephemeris of the target, the energy of the laser pulse, and the laser field of view. In this paper we will show a way to overcome the mentioned challenges by using a night-tracking camera for the real time correction of the pointing of the SLR system (active tracking), and for the simultaneous acquisition of measurements used to improve the orbits and to study the attitude of the target. After presenting the basic functionalities, the performance of the night-tracking camera, and the procedure to acquire the measurements, we will also show the potential of this tool to allow improving orbits in real-time. This study is carried out for defunct or recently decommissioned satellites. Only real angular/laser measurements provided by the sensors of the Swiss Optical Ground Station and Geodynamics Observatory Zimmerwald (SwissOGS) owned by the Astronomical Institute of the University of Bern (AIUB) are used.
△ Less
Submitted 1 March, 2019;
originally announced March 2019.