-
Active Learning in Brain Tumor Segmentation with Uncertainty Sampling, Annotation Redundancy Restriction, and Data Initialization
Authors:
Daniel D Kim,
Rajat S Chandra,
Jian Peng,
**g Wu,
Xue Feng,
Michael Atalay,
Chetan Bettegowda,
Craig Jones,
Haris Sair,
Wei-hua Liao,
Chengzhang Zhu,
Beiji Zou,
Li Yang,
Anahita Fathi Kazerooni,
Ali Nabavizadeh,
Harrison X Bai,
Zhicheng Jiao
Abstract:
Deep learning models have demonstrated great potential in medical 3D imaging, but their development is limited by the expensive, large volume of annotated data required. Active learning (AL) addresses this by training a model on a subset of the most informative data samples without compromising performance. We compared different AL strategies and propose a framework that minimizes the amount of da…
▽ More
Deep learning models have demonstrated great potential in medical 3D imaging, but their development is limited by the expensive, large volume of annotated data required. Active learning (AL) addresses this by training a model on a subset of the most informative data samples without compromising performance. We compared different AL strategies and propose a framework that minimizes the amount of data needed for state-of-the-art performance. 638 multi-institutional brain tumor MRI images were used to train a 3D U-net model and compare AL strategies. We investigated uncertainty sampling, annotation redundancy restriction, and initial dataset selection techniques. Uncertainty estimation techniques including Bayesian estimation with dropout, bootstrap**, and margins sampling were compared to random query. Strategies to avoid annotation redundancy by removing similar images within the to-be-annotated subset were considered as well. We determined the minimum amount of data necessary to achieve similar performance to the model trained on the full dataset (α = 0.1). A variance-based selection strategy using radiomics to identify the initial training dataset is also proposed. Bayesian approximation with dropout at training and testing showed similar results to that of the full data model with less than 20% of the training data (p=0.293) compared to random query achieving similar performance at 56.5% of the training data (p=0.814). Annotation redundancy restriction techniques achieved state-of-the-art performance at approximately 40%-50% of the training data. Radiomics dataset initialization had higher Dice with initial dataset sizes of 20 and 80 images, but improvements were not significant. In conclusion, we investigated various AL strategies with dropout uncertainty estimation achieving state-of-the-art performance with the least annotated data.
△ Less
Submitted 4 February, 2023;
originally announced February 2023.
-
Primordial Power Spectrum from Lensed CMB Temperature Spectrum using Iterative Delensing
Authors:
Rajorshi Sushovan Chandra,
Tarun Souradeep
Abstract:
We address a current caveat in the deconvolution of the Primordial Power Spectrum (PPS), from observed Cosmic Microwave Background (CMB) temperature anisotropy, in the presence of weak lensing of the CMB by the large scale structure (LSS) in the Universe. Richardson-Lucy (RL) deconvolution algorithm has been used in the context of reconstructing a free-form PPS, $P_R(k)$ from the observed lensed C…
▽ More
We address a current caveat in the deconvolution of the Primordial Power Spectrum (PPS), from observed Cosmic Microwave Background (CMB) temperature anisotropy, in the presence of weak lensing of the CMB by the large scale structure (LSS) in the Universe. Richardson-Lucy (RL) deconvolution algorithm has been used in the context of reconstructing a free-form PPS, $P_R(k)$ from the observed lensed CMB temperature anisotropy power spectrum $\widetilde{C}_{\ell}^{TT}$. We propose and demonstrate that the RL algorithm works in the context of a non-linear convolution where the non-linear contribution is small, such as the effect of weak lensing of the $\widetilde{C}_{\ell}^{TT}$, for the deconvolution of the PPS from it. The Non-Linear Iterative Richardson-Lucy (NIRL) algorithm is successful at both convergence, as well as fidelity, in reconstructing features in some underlying PPS. This makes PPS reconstruction efforts more robust in accounting for the weak lensing effect in the CMB temperature observations. No prior assumptions on the PPS are involved during the iterative delensing process, and distinct improvement is noted over a power-law template based delensing approach used earlier, at the cost of moderately increased computational cost due to the NIRL reconstruction kernel.
△ Less
Submitted 24 November, 2022; v1 submitted 28 December, 2021;
originally announced December 2021.
-
Primordial Power Spectrum Reconstruction From CMB Weak Lensing Power Spectrum
Authors:
Rajorshi Sushovan Chandra,
Tarun Souradeep
Abstract:
We use the modified Richardson-Lucy deconvolution algorithm to reconstruct the Primordial Power Spectrum from the Weak Lensing Power spectrum reconstructed from the CMB anisotropies. This provides an independent window to observe and constrain the PPS $P_R(k)$ along different $k$ scales as compared to CMB Temperature Power Spectrum. The Weak Lensing Power spectrum does not contain secondary variat…
▽ More
We use the modified Richardson-Lucy deconvolution algorithm to reconstruct the Primordial Power Spectrum from the Weak Lensing Power spectrum reconstructed from the CMB anisotropies. This provides an independent window to observe and constrain the PPS $P_R(k)$ along different $k$ scales as compared to CMB Temperature Power Spectrum. The Weak Lensing Power spectrum does not contain secondary variations in power and hence is cleaner, unlike the Temperature Power spectrum which suffers from lensing which is visible in its PPS reconstructions. We demonstrate that the physical behaviour of the weak lensing kernel is different from the temperature kernel and reconstructs broad features over $k$. We provide an in-depth analysis of the error propagation using simulated data and Monte-Carlo sampling, based on Planck best-fit cosmological parameters to simulate the data and cosmic variance limited error bars. The error and initial condition analysis provides a clear picture of the optimal reconstruction region for the estimator and we provide and algorithm for $P_R(k)$ sampling to be used based on the given data, errors and its binning properties. Eventually we plan to use this method on actual mission data and provide a cross reference to PPS reconstructed from other sectors and any possible features in them.
△ Less
Submitted 25 April, 2021;
originally announced April 2021.