Loss Functions in the Era of Semantic Segmentation: A Survey and Outlook
Authors:
Reza Azad,
Moein Heidary,
Kadir Yilmaz,
Michael Hüttemann,
Sanaz Karimijafarbigloo,
Yuli Wu,
Anke Schmeink,
Dorit Merhof
Abstract:
Semantic image segmentation, the process of classifying each pixel in an image into a particular class, plays an important role in many visual understanding systems. As the predominant criterion for evaluating the performance of statistical models, loss functions are crucial for sha** the development of deep learning-based segmentation algorithms and improving their overall performance. To aid r…
▽ More
Semantic image segmentation, the process of classifying each pixel in an image into a particular class, plays an important role in many visual understanding systems. As the predominant criterion for evaluating the performance of statistical models, loss functions are crucial for sha** the development of deep learning-based segmentation algorithms and improving their overall performance. To aid researchers in identifying the optimal loss function for their particular application, this survey provides a comprehensive and unified review of $25$ loss functions utilized in image segmentation. We provide a novel taxonomy and thorough review of how these loss functions are customized and leveraged in image segmentation, with a systematic categorization emphasizing their significant features and applications. Furthermore, to evaluate the efficacy of these methods in real-world scenarios, we propose unbiased evaluations of some distinct and renowned loss functions on established medical and natural image datasets. We conclude this review by identifying current challenges and unveiling future research opportunities. Finally, we have compiled the reviewed studies that have open-source implementations on our GitHub page.
△ Less
Submitted 8 December, 2023;
originally announced December 2023.
Beyond Self-Attention: Deformable Large Kernel Attention for Medical Image Segmentation
Authors:
Reza Azad,
Leon Niggemeier,
Michael Huttemann,
Amirhossein Kazerouni,
Ehsan Khodapanah Aghdam,
Yury Velichko,
Ulas Bagci,
Dorit Merhof
Abstract:
Medical image segmentation has seen significant improvements with transformer models, which excel in gras** far-reaching contexts and global contextual information. However, the increasing computational demands of these models, proportional to the squared token count, limit their depth and resolution capabilities. Most current methods process D volumetric image data slice-by-slice (called pseudo…
▽ More
Medical image segmentation has seen significant improvements with transformer models, which excel in gras** far-reaching contexts and global contextual information. However, the increasing computational demands of these models, proportional to the squared token count, limit their depth and resolution capabilities. Most current methods process D volumetric image data slice-by-slice (called pseudo 3D), missing crucial inter-slice information and thus reducing the model's overall performance. To address these challenges, we introduce the concept of \textbf{Deformable Large Kernel Attention (D-LKA Attention)}, a streamlined attention mechanism employing large convolution kernels to fully appreciate volumetric context. This mechanism operates within a receptive field akin to self-attention while sidestep** the computational overhead. Additionally, our proposed attention mechanism benefits from deformable convolutions to flexibly warp the sampling grid, enabling the model to adapt appropriately to diverse data patterns. We designed both 2D and 3D adaptations of the D-LKA Attention, with the latter excelling in cross-depth data understanding. Together, these components shape our novel hierarchical Vision Transformer architecture, the \textit{D-LKA Net}. Evaluations of our model against leading methods on popular medical segmentation datasets (Synapse, NIH Pancreas, and Skin lesion) demonstrate its superior performance. Our code implementation is publicly available at the: https://github.com/mindflow-institue/deformableLKA
△ Less
Submitted 31 August, 2023;
originally announced September 2023.
