Medical Image Harmonization Using Deep Learning Based Canonical Map**: Toward Robust and Generalizable Learning in Imaging
Authors:
Vishnu M. Bashyam,
Jimit Doshi,
Guray Erus,
Dhivya Srinivasan,
Ahmed Abdulkadir,
Mohamad Habes,
Yong Fan,
Colin L. Masters,
Paul Maruff,
Chuanjun Zhuo,
Henry Völzke,
Sterling C. Johnson,
Jurgen Fripp,
Nikolaos Koutsouleris,
Theodore D. Satterthwaite,
Daniel H. Wolf,
Raquel E. Gur,
Ruben C. Gur,
John C. Morris,
Marilyn S. Albert,
Hans J. Grabe,
Susan M. Resnick,
R. Nick Bryan,
David A. Wolk,
Haochang Shou
, et al. (2 additional authors not shown)
Abstract:
Conventional and deep learning-based methods have shown great potential in the medical imaging domain, as means for deriving diagnostic, prognostic, and predictive biomarkers, and by contributing to precision medicine. However, these methods have yet to see widespread clinical adoption, in part due to limited generalization performance across various imaging devices, acquisition protocols, and pat…
▽ More
Conventional and deep learning-based methods have shown great potential in the medical imaging domain, as means for deriving diagnostic, prognostic, and predictive biomarkers, and by contributing to precision medicine. However, these methods have yet to see widespread clinical adoption, in part due to limited generalization performance across various imaging devices, acquisition protocols, and patient populations. In this work, we propose a new paradigm in which data from a diverse range of acquisition conditions are "harmonized" to a common reference domain, where accurate model learning and prediction can take place. By learning an unsupervised image to image canonical map** from diverse datasets to a reference domain using generative deep learning models, we aim to reduce confounding data variation while preserving semantic information, thereby rendering the learning task easier in the reference domain. We test this approach on two example problems, namely MRI-based brain age prediction and classification of schizophrenia, leveraging pooled cohorts of neuroimaging MRI data spanning 9 sites and 9701 subjects. Our results indicate a substantial improvement in these tasks in out-of-sample data, even when training is restricted to a single site.
△ Less
Submitted 11 October, 2020;
originally announced October 2020.