Skip to main content

Showing 1–15 of 15 results for author: Sladoje, N

Searching in archive cs. Search in all archives.
.
  1. arXiv:2407.04352  [pdf, other

    cs.HC cs.LG

    UpStory: the Uppsala Storytelling dataset

    Authors: Marc Fraile, Natalia Calvo-Barajas, Anastasia Sophia Apeiron, Giovanna Varni, Joakim Lindblad, Nataša Sladoje, Ginevra Castellano

    Abstract: Friendship and rapport play an important role in the formation of constructive social interactions, and have been widely studied in educational settings due to their impact on student outcomes. Given the growing interest in automating the analysis of such phenomena through Machine Learning (ML), access to annotated interaction datasets is highly valuable. However, no dataset on dyadic child-child… ▽ More

    Submitted 5 July, 2024; originally announced July 2024.

  2. arXiv:2407.01869  [pdf, other

    eess.IV cs.CV cs.LG

    Let it shine: Autofluorescence of Papanicolaou-stain improves AI-based cytological oral cancer detection

    Authors: Wenyi Lian, Joakim Lindblad, Christina Runow Stark, Jan-Michaél Hirsch, Nataša Sladoje

    Abstract: Oral cancer is a global health challenge. It is treatable if detected early, but it is often fatal in late stages. There is a shift from the invasive and time-consuming tissue sampling and histological examination, toward non-invasive brush biopsies and cytological examination. Reliable computer-assisted methods are essential for cost-effective and accurate cytological analysis, but the lack of de… ▽ More

    Submitted 1 July, 2024; originally announced July 2024.

    Comments: 16 pages, 12 figures, 11 tables

  3. arXiv:2303.00403  [pdf, other

    cs.CV cs.LG

    Can representation learning for multimodal image registration be improved by supervision of intermediate layers?

    Authors: Elisabeth Wetzer, Joakim Lindblad, Nataša Sladoje

    Abstract: Multimodal imaging and correlative analysis typically require image alignment. Contrastive learning can generate representations of multimodal images, reducing the challenging task of multimodal image registration to a monomodal one. Previously, additional supervision on intermediate layers in contrastive learning has improved biomedical image classification. We evaluate if a similar approach impr… ▽ More

    Submitted 1 March, 2023; originally announced March 2023.

    Comments: 15 Pages + 9 Pages Appendix, 10 Figures

  4. arXiv:2203.03981  [pdf, other

    cs.CV cs.LG

    End-to-end Multiple Instance Learning with Gradient Accumulation

    Authors: Axel Andersson, Nadezhda Koriakina, Nataša Sladoje, Joakim Lindblad

    Abstract: Being able to learn on weakly labeled data, and provide interpretability, are two of the main reasons why attention-based deep multiple instance learning (ABMIL) methods have become particularly popular for classification of histopathological images. Such image data usually come in the form of gigapixel-sized whole-slide-images (WSI) that are cropped into smaller patches (instances). However, the… ▽ More

    Submitted 8 March, 2022; originally announced March 2022.

  5. arXiv:2202.01783  [pdf, other

    eess.IV cs.CV cs.LG

    Oral cancer detection and interpretation: Deep multiple instance learning versus conventional deep single instance learning

    Authors: Nadezhda Koriakina, Nataša Sladoje, Vladimir Bašić, Joakim Lindblad

    Abstract: The current medical standard for setting an oral cancer (OC) diagnosis is histological examination of a tissue sample from the oral cavity. This process is time consuming and more invasive than an alternative approach of acquiring a brush sample followed by cytological analysis. Skilled cytotechnologists are able to detect changes due to malignancy, however, to introduce this approach into clinica… ▽ More

    Submitted 3 February, 2022; originally announced February 2022.

  6. arXiv:2201.03597  [pdf, other

    cs.CV

    Cross-Modality Sub-Image Retrieval using Contrastive Multimodal Image Representations

    Authors: Eva Breznik, Elisabeth Wetzer, Joakim Lindblad, Nataša Sladoje

    Abstract: In tissue characterization and cancer diagnostics, multimodal imaging has emerged as a powerful technique. Thanks to computational advances, large datasets can be exploited to discover patterns in pathologies and improve diagnosis. However, this requires efficient and scalable image retrieval methods. Cross-modality image retrieval is particularly challenging, since images of similar (or even the… ▽ More

    Submitted 20 March, 2023; v1 submitted 10 January, 2022; originally announced January 2022.

  7. arXiv:2110.10156  [pdf, other

    eess.IV cs.CV

    Cross-Sim-NGF: FFT-Based Global Rigid Multimodal Alignment of Image Volumes using Normalized Gradient Fields

    Authors: Johan Öfverstedt, Joakim Lindblad, Nataša Sladoje

    Abstract: Multimodal image alignment involves finding spatial correspondences between volumes varying in appearance and structure. Automated alignment methods are often based on local optimization that can be highly sensitive to their initialization. We propose a global optimization method for rigid multimodal 3D image alignment, based on a novel efficient algorithm for computing similarity of normalized gr… ▽ More

    Submitted 19 October, 2021; originally announced October 2021.

    Comments: 5 pages, 3 figures, 3 tables. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

  8. Fast computation of mutual information in the frequency domain with applications to global multimodal image alignment

    Authors: Johan Öfverstedt, Joakim Lindblad, Nataša Sladoje

    Abstract: Multimodal image alignment is the process of finding spatial correspondences between images formed by different imaging techniques or under different conditions, to facilitate heterogeneous data fusion and correlative analysis. The information-theoretic concept of mutual information (MI) is widely used as a similarity measure to guide multimodal alignment processes, where most works have focused o… ▽ More

    Submitted 28 June, 2021; originally announced June 2021.

    Comments: 7 pages, 4 figures, 2 tables. The article is under consideration at Pattern Recognition Letters

    MSC Class: 92C55; 94A08; 94A15; 94A17; 68U10; 68W01

    Journal ref: Pattern Recognition Letters, Vol. 159, pp. 196-203, 2022

  9. Is Image-to-Image Translation the Panacea for Multimodal Image Registration? A Comparative Study

    Authors: Jiahao Lu, Johan Öfverstedt, Joakim Lindblad, Nataša Sladoje

    Abstract: Despite current advancement in the field of biomedical image processing, propelled by the deep learning revolution, multimodal image registration, due to its several challenges, is still often performed manually by specialists. The recent success of image-to-image (I2I) translation in computer vision applications and its growing use in biomedical areas provide a tempting possibility of transformin… ▽ More

    Submitted 31 October, 2022; v1 submitted 30 March, 2021; originally announced March 2021.

    Comments: 37 pages, 10 figures, 2 tables

  10. INSPIRE: Intensity and spatial information-based deformable image registration

    Authors: Johan Öfverstedt, Joakim Lindblad, Nataša Sladoje

    Abstract: We present INSPIRE, a top-performing general-purpose method for deformable image registration. INSPIRE brings distance measures which combine intensity and spatial information into an elastic B-splines-based transformation model and incorporates an inverse inconsistency penalization supporting symmetric registration performance. We introduce several theoretical and algorithmic solutions which prov… ▽ More

    Submitted 2 February, 2023; v1 submitted 13 December, 2020; originally announced December 2020.

    Comments: 24 pages, 7 figures, 5 tables

  11. arXiv:2006.06325  [pdf, other

    cs.CV cs.LG eess.IV

    CoMIR: Contrastive Multimodal Image Representation for Registration

    Authors: Nicolas Pielawski, Elisabeth Wetzer, Johan Öfverstedt, Jiahao Lu, Carolina Wählby, Joakim Lindblad, Nataša Sladoje

    Abstract: We propose contrastive coding to learn shared, dense image representations, referred to as CoMIRs (Contrastive Multimodal Image Representations). CoMIRs enable the registration of multimodal images where existing registration methods often fail due to a lack of sufficiently similar image structures. CoMIRs reduce the multimodal registration problem to a monomodal one, in which general intensity-ba… ▽ More

    Submitted 23 October, 2020; v1 submitted 11 June, 2020; originally announced June 2020.

    Comments: 21 pages, 11 figures

    Journal ref: NeurIPS 2020

  12. A Deep Learning based Pipeline for Efficient Oral Cancer Screening on Whole Slide Images

    Authors: Jiahao Lu, Nataša Sladoje, Christina Runow Stark, Eva Darai Ramqvist, Jan-Michaél Hirsch, Joakim Lindblad

    Abstract: Oral cancer incidence is rapidly increasing worldwide. The most important determinant factor in cancer survival is early diagnosis. To facilitate large scale screening, we propose a fully automated pipeline for oral cancer detection on whole slide cytology images. The pipeline consists of fully convolutional regression-based nucleus detection, followed by per-cell focus selection, and CNN based cl… ▽ More

    Submitted 15 April, 2020; v1 submitted 23 October, 2019; originally announced October 2019.

    Comments: Accepted to ICIAR 2020

    Journal ref: In Proceedings of the 17th International Conference on Image Analysis and Recognition (ICIAR), LNCS-12132, pp. 249-261, Póvoa de Varzim, Portugal, June 2020

  13. Stochastic Distance Transform

    Authors: Johan Öfverstedt, Joakim Lindblad, Nataša Sladoje

    Abstract: The distance transform (DT) and its many variations are ubiquitous tools for image processing and analysis. In many imaging scenarios, the images of interest are corrupted by noise. This has a strong negative impact on the accuracy of the DT, which is highly sensitive to spurious noise points. In this study, we consider images represented as discrete random sets and observe statistics of DT comput… ▽ More

    Submitted 18 October, 2018; originally announced October 2018.

    Comments: 12 pages, 4 figures, 3 tables

    Journal ref: In Proceedings of the 21th international conference on Discrete Geometry for Computer Imagery (DGCI), LNCS-11414, pp. 75-86, Paris, France, March 2019

  14. arXiv:1808.05071  [pdf, other

    cs.CV

    Ensemble of Convolutional Neural Networks for Dermoscopic Images Classification

    Authors: Tomáš Majtner, Buda Bajić, Sule Yildirim, Jon Yngve Hardeberg, Joakim Lindblad, Nataša Sladoje

    Abstract: In this report, we are presenting our automated prediction system for disease classification within dermoscopic images. The proposed solution is based on deep learning, where we employed transfer learning strategy on VGG16 and GoogLeNet architectures. The key feature of our solution is preprocessing based primarily on image augmentation and colour normalization. The solution was evaluated on Task… ▽ More

    Submitted 15 August, 2018; originally announced August 2018.

    Comments: 5 pages, 2 figures

  15. Fast and Robust Symmetric Image Registration Based on Distances Combining Intensity and Spatial Information

    Authors: Johan Öfverstedt, Joakim Lindblad, Nataša Sladoje

    Abstract: Intensity-based image registration approaches rely on similarity measures to guide the search for geometric correspondences with high affinity between images. The properties of the used measure are vital for the robustness and accuracy of the registration. In this study a symmetric, intensity interpolation-free, affine registration framework based on a combination of intensity and spatial informat… ▽ More

    Submitted 21 February, 2019; v1 submitted 30 July, 2018; originally announced July 2018.

    Comments: 14 pages, 4 tables, 7 figures