-
The Brain Tumor Segmentation (BraTS) Challenge 2023: Local Synthesis of Healthy Brain Tissue via Inpainting
Authors:
Florian Kofler,
Felix Meissen,
Felix Steinbauer,
Robert Graf,
Eva Oswald,
Ezequiel de da Rosa,
Hongwei Bran Li,
Ujjwal Baid,
Florian Hoelzl,
Oezguen Turgut,
Izabela Horvath,
Diana Waldmannstetter,
Christina Bukas,
Maruf Adewole,
Syed Muhammad Anwar,
Anastasia Janas,
Anahita Fathi Kazerooni,
Dominic LaBella,
Ahmed W Moawad,
Keyvan Farahani,
James Eddy,
Timothy Bergquist,
Verena Chung,
Russell Takeshi Shinohara,
Farouk Dako
, et al. (43 additional authors not shown)
Abstract:
A myriad of algorithms for the automatic analysis of brain MR images is available to support clinicians in their decision-making. For brain tumor patients, the image acquisition time series typically starts with a scan that is already pathological. This poses problems, as many algorithms are designed to analyze healthy brains and provide no guarantees for images featuring lesions. Examples include…
▽ More
A myriad of algorithms for the automatic analysis of brain MR images is available to support clinicians in their decision-making. For brain tumor patients, the image acquisition time series typically starts with a scan that is already pathological. This poses problems, as many algorithms are designed to analyze healthy brains and provide no guarantees for images featuring lesions. Examples include but are not limited to algorithms for brain anatomy parcellation, tissue segmentation, and brain extraction. To solve this dilemma, we introduce the BraTS 2023 inpainting challenge. Here, the participants' task is to explore inpainting techniques to synthesize healthy brain scans from lesioned ones. The following manuscript contains the task formulation, dataset, and submission procedure. Later it will be updated to summarize the findings of the challenge. The challenge is organized as part of the BraTS 2023 challenge hosted at the MICCAI 2023 conference in Vancouver, Canada.
△ Less
Submitted 9 August, 2023; v1 submitted 15 May, 2023;
originally announced May 2023.
-
Deep Quality Estimation: Creating Surrogate Models for Human Quality Ratings
Authors:
Florian Kofler,
Ivan Ezhov,
Lucas Fidon,
Izabela Horvath,
Ezequiel de la Rosa,
John LaMaster,
Hongwei Li,
Tom Finck,
Suprosanna Shit,
Johannes Paetzold,
Spyridon Bakas,
Marie Piraud,
Jan Kirschke,
Tom Vercauteren,
Claus Zimmer,
Benedikt Wiestler,
Bjoern Menze
Abstract:
Human ratings are abstract representations of segmentation quality. To approximate human quality ratings on scarce expert data, we train surrogate quality estimation models. We evaluate on a complex multi-class segmentation problem, specifically glioma segmentation, following the BraTS annotation protocol. The training data features quality ratings from 15 expert neuroradiologists on a scale rangi…
▽ More
Human ratings are abstract representations of segmentation quality. To approximate human quality ratings on scarce expert data, we train surrogate quality estimation models. We evaluate on a complex multi-class segmentation problem, specifically glioma segmentation, following the BraTS annotation protocol. The training data features quality ratings from 15 expert neuroradiologists on a scale ranging from 1 to 6 stars for various computer-generated and manual 3D annotations. Even though the networks operate on 2D images and with scarce training data, we can approximate segmentation quality within a margin of error comparable to human intra-rater reliability. Segmentation quality prediction has broad applications. While an understanding of segmentation quality is imperative for successful clinical translation of automatic segmentation quality algorithms, it can play an essential role in training new segmentation models. Due to the split-second inference times, it can be directly applied within a loss function or as a fully-automatic dataset curation mechanism in a federated learning setting.
△ Less
Submitted 30 August, 2022; v1 submitted 17 May, 2022;
originally announced May 2022.
-
blob loss: instance imbalance aware loss functions for semantic segmentation
Authors:
Florian Kofler,
Suprosanna Shit,
Ivan Ezhov,
Lucas Fidon,
Izabela Horvath,
Rami Al-Maskari,
Hongwei Li,
Harsharan Bhatia,
Timo Loehr,
Marie Piraud,
Ali Erturk,
Jan Kirschke,
Jan C. Peeken,
Tom Vercauteren,
Claus Zimmer,
Benedikt Wiestler,
Bjoern Menze
Abstract:
Deep convolutional neural networks (CNN) have proven to be remarkably effective in semantic segmentation tasks. Most popular loss functions were introduced targeting improved volumetric scores, such as the Dice coefficient (DSC). By design, DSC can tackle class imbalance, however, it does not recognize instance imbalance within a class. As a result, a large foreground instance can dominate minor i…
▽ More
Deep convolutional neural networks (CNN) have proven to be remarkably effective in semantic segmentation tasks. Most popular loss functions were introduced targeting improved volumetric scores, such as the Dice coefficient (DSC). By design, DSC can tackle class imbalance, however, it does not recognize instance imbalance within a class. As a result, a large foreground instance can dominate minor instances and still produce a satisfactory DSC. Nevertheless, detecting tiny instances is crucial for many applications, such as disease monitoring. For example, it is imperative to locate and surveil small-scale lesions in the follow-up of multiple sclerosis patients. We propose a novel family of loss functions, \emph{blob loss}, primarily aimed at maximizing instance-level detection metrics, such as F1 score and sensitivity. \emph{Blob loss} is designed for semantic segmentation problems where detecting multiple instances matters. We extensively evaluate a DSC-based \emph{blob loss} in five complex 3D semantic segmentation tasks featuring pronounced instance heterogeneity in terms of texture and morphology. Compared to soft Dice loss, we achieve 5% improvement for MS lesions, 3% improvement for liver tumor, and an average 2% improvement for microscopy segmentation tasks considering F1 score.
△ Less
Submitted 6 June, 2023; v1 submitted 17 May, 2022;
originally announced May 2022.
-
METGAN: Generative Tumour Inpainting and Modality Synthesis in Light Sheet Microscopy
Authors:
Izabela Horvath,
Johannes C. Paetzold,
Oliver Schoppe,
Rami Al-Maskari,
Ivan Ezhov,
Suprosanna Shit,
Hongwei Li,
Ali Ertuerk,
Bjoern H. Menze
Abstract:
Novel multimodal imaging methods are capable of generating extensive, super high resolution datasets for preclinical research. Yet, a massive lack of annotations prevents the broad use of deep learning to analyze such data. So far, existing generative models fail to mitigate this problem because of frequent labeling errors. In this paper, we introduce a novel generative method which leverages real…
▽ More
Novel multimodal imaging methods are capable of generating extensive, super high resolution datasets for preclinical research. Yet, a massive lack of annotations prevents the broad use of deep learning to analyze such data. So far, existing generative models fail to mitigate this problem because of frequent labeling errors. In this paper, we introduce a novel generative method which leverages real anatomical information to generate realistic image-label pairs of tumours. We construct a dual-pathway generator, for the anatomical image and label, trained in a cycle-consistent setup, constrained by an independent, pretrained segmentor. The generated images yield significant quantitative improvement compared to existing methods. To validate the quality of synthesis, we train segmentation networks on a dataset augmented with the synthetic data, substantially improving the segmentation over baseline.
△ Less
Submitted 23 April, 2021; v1 submitted 22 April, 2021;
originally announced April 2021.
-
How the planned V0 railway line would increase the resilience of the railway network of Hungary against attacks
Authors:
B. G. Tóth,
I. Horváth
Abstract:
The spatial distribution of the railway crossings on the river Danube in Hungary is very uneven. There is only one electrified and double-tracked bridge in the country, the Southern Railway Bridge in Budapest. The Újpest bridge in Budapest only provides connection through line 4 which is not electrified and the Baja bridge is not electrified, too, and both of them are single-tracked. The long-plan…
▽ More
The spatial distribution of the railway crossings on the river Danube in Hungary is very uneven. There is only one electrified and double-tracked bridge in the country, the Southern Railway Bridge in Budapest. The Újpest bridge in Budapest only provides connection through line 4 which is not electrified and the Baja bridge is not electrified, too, and both of them are single-tracked. The long-planned V0 railway line that is to be cross the Danube approximately halfway between Budapest and Baja would not only help to redistribute the total network flow which currently passes through almost exclusively the Southern bridge but would also provide redundancy for the existing bridges in the case of their disruption. Four of the five proposed V0 path alternatives are analyzed on the basis of these two network properties.
△ Less
Submitted 26 May, 2020;
originally announced May 2020.
-
Multi timescale bandwidth profile and its application for burst-aware fairness
Authors:
Szilveszter Nádas,
Balázs Varga,
Illés Horváth,
András Mészáros,
Miklós Telek
Abstract:
We propose a resource sharing scheme that takes into account the traffic history over several predefined time scales and provides fair resource sharing considering the traffic history. Our concept builds on a simplified version of core-stateless resource sharing, where we only use a few Drop Precedences (DPs). For packet marking we introduce Multi timescale bandwidth profile. Additionally, we prov…
▽ More
We propose a resource sharing scheme that takes into account the traffic history over several predefined time scales and provides fair resource sharing considering the traffic history. Our concept builds on a simplified version of core-stateless resource sharing, where we only use a few Drop Precedences (DPs). For packet marking we introduce Multi timescale bandwidth profile. Additionally, we provide basic dimensioning concepts for the proposed schema and present its simulation based performance analysis.
△ Less
Submitted 19 March, 2019;
originally announced March 2019.
-
High order concentrated non-negative matrix-exponential functions
Authors:
Gabor Horvath,
Illes Horvath,
Miklos Telek
Abstract:
Highly concentrated functions play an important role in many research fields including control system analysis and physics, and they turned out to be the key idea behind inverse Laplace transform methods as well.
This paper uses the matrix-exponential family of functions to create highly concentrated functions, whose squared coefficient of variation (SCV) is very low. In the field of stochastic…
▽ More
Highly concentrated functions play an important role in many research fields including control system analysis and physics, and they turned out to be the key idea behind inverse Laplace transform methods as well.
This paper uses the matrix-exponential family of functions to create highly concentrated functions, whose squared coefficient of variation (SCV) is very low. In the field of stochastic modeling, matrix-exponential functions have been used for decades. They have many advantages: they are easy to manipulate, always non-negative, and integrals involving matrix-exponential functions often have closed-form solutions. For the time being there is no symbolic construction available to obtain the most concentrated matrix-exponential functions, and the numerical optimization-based approach has many pitfalls, too.
In this paper, we present a numerical optimization-based procedure to construct highly concentrated matrix-exponential functions. To make the objective function explicit and easy to evaluate we introduce and use a new representation called hyper-trigonometric representation. This representation makes it possible to achieve very low SCV.
△ Less
Submitted 23 January, 2019;
originally announced January 2019.