-
Continuous-Time Deep Glioma Growth Models
Authors:
Jens Petersen,
Fabian Isensee,
Gregor Köhler,
Paul F. Jäger,
David Zimmerer,
Ulf Neuberger,
Wolfgang Wick,
Jürgen Debus,
Sabine Heiland,
Martin Bendszus,
Philipp Vollmuth,
Klaus H. Maier-Hein
Abstract:
The ability to estimate how a tumor might evolve in the future could have tremendous clinical benefits, from improved treatment decisions to better dose distribution in radiation therapy. Recent work has approached the glioma growth modeling problem via deep learning and variational inference, thus learning growth dynamics entirely from a real patient data distribution. So far, this approach was c…
▽ More
The ability to estimate how a tumor might evolve in the future could have tremendous clinical benefits, from improved treatment decisions to better dose distribution in radiation therapy. Recent work has approached the glioma growth modeling problem via deep learning and variational inference, thus learning growth dynamics entirely from a real patient data distribution. So far, this approach was constrained to predefined image acquisition intervals and sequences of fixed length, which limits its applicability in more realistic scenarios. We overcome these limitations by extending Neural Processes, a class of conditional generative models for stochastic time series, with a hierarchical multi-scale representation encoding including a spatio-temporal attention mechanism. The result is a learned growth model that can be conditioned on an arbitrary number of observations, and that can produce a distribution of temporally consistent growth trajectories on a continuous time axis. On a dataset of 379 patients, the approach successfully captures both global and finer-grained variations in the images, exhibiting superior performance compared to other learned growth models.
△ Less
Submitted 2 July, 2021; v1 submitted 23 June, 2021;
originally announced June 2021.
-
Deep Probabilistic Modeling of Glioma Growth
Authors:
Jens Petersen,
Paul F. Jäger,
Fabian Isensee,
Simon A. A. Kohl,
Ulf Neuberger,
Wolfgang Wick,
Jürgen Debus,
Sabine Heiland,
Martin Bendszus,
Philipp Kickingereder,
Klaus H. Maier-Hein
Abstract:
Existing approaches to modeling the dynamics of brain tumor growth, specifically glioma, employ biologically inspired models of cell diffusion, using image data to estimate the associated parameters. In this work, we propose an alternative approach based on recent advances in probabilistic segmentation and representation learning that implicitly learns growth dynamics directly from data without an…
▽ More
Existing approaches to modeling the dynamics of brain tumor growth, specifically glioma, employ biologically inspired models of cell diffusion, using image data to estimate the associated parameters. In this work, we propose an alternative approach based on recent advances in probabilistic segmentation and representation learning that implicitly learns growth dynamics directly from data without an underlying explicit model. We present evidence that our approach is able to learn a distribution of plausible future tumor appearances conditioned on past observations of the same tumor.
△ Less
Submitted 9 July, 2019;
originally announced July 2019.
-
Automated brain extraction of multi-sequence MRI using artificial neural networks
Authors:
Fabian Isensee,
Marianne Schell,
Irada Tursunova,
Gianluca Brugnara,
David Bonekamp,
Ulf Neuberger,
Antje Wick,
Heinz-Peter Schlemmer,
Sabine Heiland,
Wolfgang Wick,
Martin Bendszus,
Klaus Hermann Maier-Hein,
Philipp Kickingereder
Abstract:
Brain extraction is a critical preprocessing step in the analysis of MRI neuroimaging studies and influences the accuracy of downstream analyses. The majority of brain extraction algorithms are, however, optimized for processing healthy brains and thus frequently fail in the presence of pathologically altered brain or when applied to heterogeneous MRI datasets. Here we introduce a new, rigorously…
▽ More
Brain extraction is a critical preprocessing step in the analysis of MRI neuroimaging studies and influences the accuracy of downstream analyses. The majority of brain extraction algorithms are, however, optimized for processing healthy brains and thus frequently fail in the presence of pathologically altered brain or when applied to heterogeneous MRI datasets. Here we introduce a new, rigorously validated algorithm (termed HD-BET) relying on artificial neural networks that aims to overcome these limitations. We demonstrate that HD-BET outperforms six popular, publicly available brain extraction algorithms in several large-scale neuroimaging datasets, including one from a prospective multicentric trial in neuro-oncology, yielding state-of-the-art performance with median improvements of +1.16 to +2.11 points for the DICE coefficient and -0.66 to -2.51 mm for the Hausdorff distance. Importantly, the HD-BET algorithm shows robust performance in the presence of pathology or treatment-induced tissue alterations, is applicable to a broad range of MRI sequence types and is not influenced by variations in MRI hardware and acquisition parameters encountered in both research and clinical practice. For broader accessibility our HD-BET prediction algorithm is made freely available (http://www.neuroAI-HD.org) and may become an essential component for robust, automated, high-throughput processing of MRI neuroimaging data.
△ Less
Submitted 13 August, 2019; v1 submitted 31 January, 2019;
originally announced January 2019.
