-
Robustness Testing of Black-Box Models Against CT Degradation Through Test-Time Augmentation
Authors:
Jack Highton,
Quok Zong Chong,
Samuel Finestone,
Arian Beqiri,
Julia A. Schnabel,
Kanwal K. Bhatia
Abstract:
Deep learning models for medical image segmentation and object detection are becoming increasingly available as clinical products. However, as details are rarely provided about the training data, models may unexpectedly fail when cases differ from those in the training distribution. An approach allowing potential users to independently test the robustness of a model, treating it as a black box and…
▽ More
Deep learning models for medical image segmentation and object detection are becoming increasingly available as clinical products. However, as details are rarely provided about the training data, models may unexpectedly fail when cases differ from those in the training distribution. An approach allowing potential users to independently test the robustness of a model, treating it as a black box and using only a few cases from their own site, is key for adoption. To address this, a method to test the robustness of these models against CT image quality variation is presented. In this work we present this framework by demonstrating that given the same training data, the model architecture and data pre processing greatly affect the robustness of several frequently used segmentation and object detection methods to simulated CT imaging artifacts and degradation. Our framework also addresses the concern about the sustainability of deep learning models in clinical use, by considering future shifts in image quality due to scanner deterioration or imaging protocol changes which are not reflected in a limited local test dataset.
△ Less
Submitted 27 June, 2024;
originally announced June 2024.
-
Mask the Unknown: Assessing Different Strategies to Handle Weak Annotations in the MICCAI2023 Mediastinal Lymph Node Quantification Challenge
Authors:
Stefan M. Fischer,
Johannes Kiechle,
Daniel M. Lang,
Jan C. Peeken,
Julia A. Schnabel
Abstract:
Pathological lymph node delineation is crucial in cancer diagnosis, progression assessment, and treatment planning. The MICCAI 2023 Lymph Node Quantification Challenge published the first public dataset for pathological lymph node segmentation in the mediastinum. As lymph node annotations are expensive, the challenge was formed as a weakly supervised learning task, where only a subset of all lymph…
▽ More
Pathological lymph node delineation is crucial in cancer diagnosis, progression assessment, and treatment planning. The MICCAI 2023 Lymph Node Quantification Challenge published the first public dataset for pathological lymph node segmentation in the mediastinum. As lymph node annotations are expensive, the challenge was formed as a weakly supervised learning task, where only a subset of all lymph nodes in the training set have been annotated. For the challenge submission, multiple methods for training on these weakly supervised data were explored, including noisy label training, loss masking of unlabeled data, and an approach that integrated the TotalSegmentator toolbox as a form of pseudo labeling in order to reduce the number of unknown voxels. Furthermore, multiple public TCIA datasets were incorporated into the training to improve the performance of the deep learning model. Our submitted model achieved a Dice score of 0.628 and an average symmetric surface distance of 5.8~mm on the challenge test set. With our submitted model, we accomplished third rank in the MICCAI2023 LNQ challenge. A finding of our analysis was that the integration of all visible, including non-pathological, lymph nodes improved the overall segmentation performance on pathological lymph nodes of the test set. Furthermore, segmentation models trained only on clinically enlarged lymph nodes, as given in the challenge scenario, could not generalize to smaller pathological lymph nodes. The code and model for the challenge submission are available at \url{https://gitlab.lrz.de/compai/MediastinalLymphNodeSegmentation}.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
Interpretable Representation Learning of Cardiac MRI via Attribute Regularization
Authors:
Maxime Di Folco,
Cosmin I. Bercea,
Julia A. Schnabel
Abstract:
Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. Several approaches have been recently considered to encode attributes in the latent space to enhance its interpretability. Notably, attribute regularization aims to encode a set of attributes along the dimensions of a latent representation. However, this approach is b…
▽ More
Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. Several approaches have been recently considered to encode attributes in the latent space to enhance its interpretability. Notably, attribute regularization aims to encode a set of attributes along the dimensions of a latent representation. However, this approach is based on Variational AutoEncoder and suffers from blurry reconstruction. In this paper, we propose an Attributed-regularized Soft Introspective Variational Autoencoder that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder. We demonstrate on short-axis cardiac Magnetic Resonance images of the UK Biobank the ability of the proposed method to address blurry reconstruction issues of variational autoencoder methods while preserving the latent space interpretability.
△ Less
Submitted 12 June, 2024;
originally announced June 2024.
-
Self-Supervised k-Space Regularization for Motion-Resolved Abdominal MRI Using Neural Implicit k-Space Representation
Authors:
Veronika Spieker,
Hannah Eichhorn,
Jonathan K. Stelter,
Wenqi Huang,
Rickmer F. Braren,
Daniel Rückert,
Francisco Sahli Costabal,
Kerstin Hammernik,
Claudia Prieto,
Dimitrios C. Karampinos,
Julia A. Schnabel
Abstract:
Neural implicit k-space representations have shown promising results for dynamic MRI at high temporal resolutions. Yet, their exclusive training in k-space limits the application of common image regularization methods to improve the final reconstruction. In this work, we introduce the concept of parallel imaging-inspired self-consistency (PISCO), which we incorporate as novel self-supervised k-spa…
▽ More
Neural implicit k-space representations have shown promising results for dynamic MRI at high temporal resolutions. Yet, their exclusive training in k-space limits the application of common image regularization methods to improve the final reconstruction. In this work, we introduce the concept of parallel imaging-inspired self-consistency (PISCO), which we incorporate as novel self-supervised k-space regularization enforcing a consistent neighborhood relationship. At no additional data cost, the proposed regularization significantly improves neural implicit k-space reconstructions on simulated data. Abdominal in-vivo reconstructions using PISCO result in enhanced spatio-temporal image quality compared to state-of-the-art methods. Code is available at https://github.com/vjspi/PISCO-NIK.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Multi-Image Visual Question Answering for Unsupervised Anomaly Detection
Authors:
Jun Li,
Cosmin I. Bercea,
Philip Müller,
Lina Felsner,
Suhwan Kim,
Daniel Rueckert,
Benedikt Wiestler,
Julia A. Schnabel
Abstract:
Unsupervised anomaly detection enables the identification of potential pathological areas by juxtaposing original images with their pseudo-healthy reconstructions generated by models trained exclusively on normal images. However, the clinical interpretation of resultant anomaly maps presents a challenge due to a lack of detailed, understandable explanations. Recent advancements in language models…
▽ More
Unsupervised anomaly detection enables the identification of potential pathological areas by juxtaposing original images with their pseudo-healthy reconstructions generated by models trained exclusively on normal images. However, the clinical interpretation of resultant anomaly maps presents a challenge due to a lack of detailed, understandable explanations. Recent advancements in language models have shown the capability of mimicking human-like understanding and providing detailed descriptions. This raises an interesting question: \textit{How can language models be employed to make the anomaly maps more explainable?} To the best of our knowledge, we are the first to leverage a language model for unsupervised anomaly detection, for which we construct a dataset with different questions and answers. Additionally, we present a novel multi-image visual question answering framework tailored for anomaly detection, incorporating diverse feature fusion strategies to enhance visual knowledge extraction. Our experiments reveal that the framework, augmented by our new Knowledge Q-Former module, adeptly answers questions on the anomaly detection dataset. Besides, integrating anomaly maps as inputs distinctly aids in improving the detection of unseen pathologies.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
Search for Neutrino Emission from GRB 221009A using the KM3NeT ARCA and ORCA detectors
Authors:
S. Aiello,
A. Albert,
M. Alshamsi,
S. Alves Garre,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
F. Badaracco,
L. Bailly-Salins,
Z. Bardačová,
B. Baret,
A. Bariego-Quintana,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
M. Benhassi,
D. M. Benoit
, et al. (251 additional authors not shown)
Abstract:
Gamma-ray bursts are promising candidate sources of high-energy astrophysical neutrinos. The recent GRB 221009A event, identified as the brightest gamma-ray burst ever detected, provides a unique opportunity to investigate hadronic emissions involving neutrinos. The KM3NeT undersea neutrino detectors participated in the worldwide follow-up effort triggered by the event, searching for neutrino even…
▽ More
Gamma-ray bursts are promising candidate sources of high-energy astrophysical neutrinos. The recent GRB 221009A event, identified as the brightest gamma-ray burst ever detected, provides a unique opportunity to investigate hadronic emissions involving neutrinos. The KM3NeT undersea neutrino detectors participated in the worldwide follow-up effort triggered by the event, searching for neutrino events. In this letter, we summarize subsequent searches, in a wide energy range from MeV up to a few PeVs. No neutrino events are found in any of the searches performed. Upper limits on the neutrino emission associated with GRB 221009A are computed.
△ Less
Submitted 30 April, 2024; v1 submitted 8 April, 2024;
originally announced April 2024.
-
DinoBloom: A Foundation Model for Generalizable Cell Embeddings in Hematology
Authors:
Valentin Koch,
Sophia J. Wagner,
Salome Kazeminia,
Ece Sancar,
Matthias Hehr,
Julia Schnabel,
Tingying Peng,
Carsten Marr
Abstract:
In hematology, computational models offer significant potential to improve diagnostic accuracy, streamline workflows, and reduce the tedious work of analyzing single cells in peripheral blood or bone marrow smears. However, clinical adoption of computational models has been hampered by the lack of generalization due to large batch effects, small dataset sizes, and poor performance in transfer lear…
▽ More
In hematology, computational models offer significant potential to improve diagnostic accuracy, streamline workflows, and reduce the tedious work of analyzing single cells in peripheral blood or bone marrow smears. However, clinical adoption of computational models has been hampered by the lack of generalization due to large batch effects, small dataset sizes, and poor performance in transfer learning from natural images. To address these challenges, we introduce DinoBloom, the first foundation model for single cell images in hematology, utilizing a tailored DINOv2 pipeline. Our model is built upon an extensive collection of 13 diverse, publicly available datasets of peripheral blood and bone marrow smears, the most substantial open-source cohort in hematology so far, comprising over 380,000 white blood cell images. To assess its generalization capability, we evaluate it on an external dataset with a challenging domain shift. We show that our model outperforms existing medical and non-medical vision models in (i) linear probing and k-nearest neighbor evaluations for cell-type classification on blood and bone marrow smears and (ii) weakly supervised multiple instance learning for acute myeloid leukemia subty** by a large margin. A family of four DinoBloom models (small, base, large, and giant) can be adapted for a wide range of downstream applications, be a strong baseline for classification problems, and facilitate the assessment of batch effects in new datasets. All models are available at github.com/marrlab/DinoBloom.
△ Less
Submitted 7 April, 2024;
originally announced April 2024.
-
Towards Learning Contrast Kinetics with Multi-Condition Latent Diffusion Models
Authors:
Richard Osuala,
Daniel Lang,
Preeti Verma,
Smriti Joshi,
Apostolia Tsirikoglou,
Grzegorz Skorupko,
Kaisar Kushibar,
Lidia Garrucho,
Walter H. L. Pinaya,
Oliver Diaz,
Julia Schnabel,
Karim Lekadir
Abstract:
Contrast agents in dynamic contrast enhanced magnetic resonance imaging allow to localize tumors and observe their contrast kinetics, which is essential for cancer characterization and respective treatment decision-making. However, contrast agent administration is not only associated with adverse health risks, but also restricted for patients during pregnancy, and for those with kidney malfunction…
▽ More
Contrast agents in dynamic contrast enhanced magnetic resonance imaging allow to localize tumors and observe their contrast kinetics, which is essential for cancer characterization and respective treatment decision-making. However, contrast agent administration is not only associated with adverse health risks, but also restricted for patients during pregnancy, and for those with kidney malfunction, or other adverse reactions. With contrast uptake as key biomarker for lesion malignancy, cancer recurrence risk, and treatment response, it becomes pivotal to reduce the dependency on intravenous contrast agent administration. To this end, we propose a multi-conditional latent diffusion model capable of acquisition time-conditioned image synthesis of DCE-MRI temporal sequences. To evaluate medical image synthesis, we additionally propose and validate the Fréchet radiomics distance as an image quality measure based on biomarker variability between synthetic and real imaging data. Our results demonstrate our method's ability to generate realistic multi-sequence fat-saturated breast DCE-MRI and uncover the emerging potential of deep learning based contrast kinetics simulation. We publicly share our accessible codebase at https://github.com/RichardObi/ccnet and provide a user-friendly library for Fréchet radiomics distance calculation at https://pypi.org/project/frd-score.
△ Less
Submitted 1 May, 2024; v1 submitted 20 March, 2024;
originally announced March 2024.
-
Diffusion Models with Implicit Guidance for Medical Anomaly Detection
Authors:
Cosmin I. Bercea,
Benedikt Wiestler,
Daniel Rueckert,
Julia A. Schnabel
Abstract:
Diffusion models have advanced unsupervised anomaly detection by improving the transformation of pathological images into pseudo-healthy equivalents. Nonetheless, standard approaches may compromise critical information during pathology removal, leading to restorations that do not align with unaffected regions in the original scans. Such discrepancies can inadvertently increase false positive rates…
▽ More
Diffusion models have advanced unsupervised anomaly detection by improving the transformation of pathological images into pseudo-healthy equivalents. Nonetheless, standard approaches may compromise critical information during pathology removal, leading to restorations that do not align with unaffected regions in the original scans. Such discrepancies can inadvertently increase false positive rates and reduce specificity, complicating radiological evaluations. This paper introduces Temporal Harmonization for Optimal Restoration (THOR), which refines the de-noising process by integrating implicit guidance through temporal anomaly maps. THOR aims to preserve the integrity of healthy tissue in areas unaffected by pathology. Comparative evaluations show that THOR surpasses existing diffusion-based methods in detecting and segmenting anomalies in brain MRIs and wrist X-rays. Code: https://github.com/ci-ber/THOR_DDPM.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Physics-Informed Deep Learning for Motion-Corrected Reconstruction of Quantitative Brain MRI
Authors:
Hannah Eichhorn,
Veronika Spieker,
Kerstin Hammernik,
Elisa Saks,
Kilian Weiss,
Christine Preibisch,
Julia A. Schnabel
Abstract:
We propose PHIMO, a physics-informed learning-based motion correction method tailored to quantitative MRI. PHIMO leverages information from the signal evolution to exclude motion-corrupted k-space lines from a data-consistent reconstruction. We demonstrate the potential of PHIMO for the application of T2* quantification from gradient echo MRI, which is particularly sensitive to motion due to its s…
▽ More
We propose PHIMO, a physics-informed learning-based motion correction method tailored to quantitative MRI. PHIMO leverages information from the signal evolution to exclude motion-corrupted k-space lines from a data-consistent reconstruction. We demonstrate the potential of PHIMO for the application of T2* quantification from gradient echo MRI, which is particularly sensitive to motion due to its sensitivity to magnetic field inhomogeneities. A state-of-the-art technique for motion correction requires redundant acquisition of the k-space center, prolonging the acquisition. We show that PHIMO can detect and exclude intra-scan motion events and, thus, correct for severe motion artifacts. PHIMO approaches the performance of the state-of-the-art motion correction method, while substantially reducing the acquisition time by over 40%, facilitating clinical applicability. Our code is available at https://github.com/HannahEichhorn/PHIMO.
△ Less
Submitted 24 June, 2024; v1 submitted 13 March, 2024;
originally announced March 2024.
-
Results of the follow-up of ANTARES neutrino alerts
Authors:
A. Albert,
S. Alves,
M. André,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
Y. Becherini,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Brânzas,
R. Bruijn,
J. Brunner,
J. Busto,
B. Caiffi,
D. Calvo
, et al. (166 additional authors not shown)
Abstract:
High-energy neutrinos could be produced in the interaction of charged cosmic rays with matter or radiation surrounding astrophysical sources. To look for transient sources associated with neutrino emission, a follow-up program of neutrino alerts has been operating within the ANTARES Collaboration since 2009. This program, named TAToO, has triggered robotic optical telescopes (MASTER, TAROT, ROTSE…
▽ More
High-energy neutrinos could be produced in the interaction of charged cosmic rays with matter or radiation surrounding astrophysical sources. To look for transient sources associated with neutrino emission, a follow-up program of neutrino alerts has been operating within the ANTARES Collaboration since 2009. This program, named TAToO, has triggered robotic optical telescopes (MASTER, TAROT, ROTSE and the SVOM ground based telescopes) immediately after the detection of any relevant neutrino candidate and scheduled several observations in the weeks following the detection. A subset of ANTARES events with highest probabilities of being of cosmic origin has also been followed by the Swift and the INTEGRAL satellites, the Murchison Widefield Array radio telescope and the H.E.S.S. high-energy gamma-ray telescope. The results of twelve years of observations are reported. No optical counterpart has been significantly associated with an ANTARES candidate neutrino signal during image analysis. Constraints on transient neutrino emission have been set. In September 2015, ANTARES issued a neutrino alert and during the follow-up, a potential transient counterpart was identified by Swift and MASTER. A multi-wavelength follow-up campaign has allowed to identify the nature of this source and has proven its fortuitous association with the neutrino. The return of experience is particularly important for the design of the alert system of KM3NeT, the next generation neutrino telescope in the Mediterranean Sea.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
Astronomy potential of KM3NeT/ARCA
Authors:
S. Aiello,
A. Albert,
M. Alshamsi,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
F. Badaracco,
L. Bailly-Salins,
Z. Bardacová,
B. Baret,
A. Bariego-Quintana,
A. Baruzzi,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati
, et al. (253 additional authors not shown)
Abstract:
The KM3NeT/ARCA neutrino detector is currently under construction at 3500 m depth offshore Capo Passero, Sicily, in the Mediterranean Sea. The main science objectives are the detection of high-energy cosmic neutrinos and the discovery of their sources. Simulations were conducted for the full KM3NeT/ARCA detector, instrumenting a volume of 1 km$^3$, to estimate the sensitivity and discovery potenti…
▽ More
The KM3NeT/ARCA neutrino detector is currently under construction at 3500 m depth offshore Capo Passero, Sicily, in the Mediterranean Sea. The main science objectives are the detection of high-energy cosmic neutrinos and the discovery of their sources. Simulations were conducted for the full KM3NeT/ARCA detector, instrumenting a volume of 1 km$^3$, to estimate the sensitivity and discovery potential to point-like neutrino sources and an all-sky diffuse neutrino flux. This paper covers the reconstruction of track- and shower-like signatures, as well as the criteria employed for neutrino event selection. By leveraging both the track and shower observation channels, the KM3NeT/ARCA detector demonstrates the capability to detect the diffuse astrophysical neutrino flux within half a year of operation, achieving a 5$σ$ statistical significance. With an angular resolution below 0.1$^\circ$ for tracks and under 2$^\circ$ for showers, the sensitivity to point-like neutrino sources surpasses existing observed limits across the entire sky.
△ Less
Submitted 29 March, 2024; v1 submitted 13 February, 2024;
originally announced February 2024.
-
Towards Universal Unsupervised Anomaly Detection in Medical Imaging
Authors:
Cosmin I. Bercea,
Benedikt Wiestler,
Daniel Rueckert,
Julia A. Schnabel
Abstract:
The increasing complexity of medical imaging data underscores the need for advanced anomaly detection methods to automatically identify diverse pathologies. Current methods face challenges in capturing the broad spectrum of anomalies, often limiting their use to specific lesion types in brain scans. To address this challenge, we introduce a novel unsupervised approach, termed \textit{Reversed Auto…
▽ More
The increasing complexity of medical imaging data underscores the need for advanced anomaly detection methods to automatically identify diverse pathologies. Current methods face challenges in capturing the broad spectrum of anomalies, often limiting their use to specific lesion types in brain scans. To address this challenge, we introduce a novel unsupervised approach, termed \textit{Reversed Auto-Encoders (RA)}, designed to create realistic pseudo-healthy reconstructions that enable the detection of a wider range of pathologies. We evaluate the proposed method across various imaging modalities, including magnetic resonance imaging (MRI) of the brain, pediatric wrist X-ray, and chest X-ray, and demonstrate superior performance in detecting anomalies compared to existing state-of-the-art methods. Our unsupervised anomaly detection approach may enhance diagnostic accuracy in medical imaging by identifying a broader range of unknown pathologies. Our code is publicly available at: \url{https://github.com/ci-ber/RA}.
△ Less
Submitted 19 January, 2024;
originally announced January 2024.
-
Low-resource finetuning of foundation models beats state-of-the-art in histopathology
Authors:
Benedikt Roth,
Valentin Koch,
Sophia J. Wagner,
Julia A. Schnabel,
Carsten Marr,
Tingying Peng
Abstract:
To handle the large scale of whole slide images in computational pathology, most approaches first tessellate the images into smaller patches, extract features from these patches, and finally aggregate the feature vectors with weakly-supervised learning. The performance of this workflow strongly depends on the quality of the extracted features. Recently, foundation models in computer vision showed…
▽ More
To handle the large scale of whole slide images in computational pathology, most approaches first tessellate the images into smaller patches, extract features from these patches, and finally aggregate the feature vectors with weakly-supervised learning. The performance of this workflow strongly depends on the quality of the extracted features. Recently, foundation models in computer vision showed that leveraging huge amounts of data through supervised or self-supervised learning improves feature quality and generalizability for a variety of tasks. In this study, we benchmark the most popular vision foundation models as feature extractors for histopathology data. We evaluate the models in two settings: slide-level classification and patch-level classification. We show that foundation models are a strong baseline. Our experiments demonstrate that by finetuning a foundation model on a single GPU for only two hours or three days depending on the dataset, we can match or outperform state-of-the-art feature extractors for computational pathology. These findings imply that even with little resources one can finetune a feature extractor tailored towards a specific downstream task and dataset. This is a considerable shift from the current state, where only few institutions with large amounts of resources and datasets are able to train a feature extractor. We publish all code used for training and evaluation as well as the finetuned models.
△ Less
Submitted 9 January, 2024;
originally announced January 2024.
-
Influence of Prompting Strategies on Segment Anything Model (SAM) for Short-axis Cardiac MRI segmentation
Authors:
Josh Stein,
Maxime Di Folco,
Julia A. Schnabel
Abstract:
The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits limitations in handling specific medical imaging tasks that require fine-structure segmentation or precise boundaries. In this paper, we focus on the task of cardi…
▽ More
The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits limitations in handling specific medical imaging tasks that require fine-structure segmentation or precise boundaries. In this paper, we focus on the task of cardiac magnetic resonance imaging (cMRI) short-axis view segmentation using the SAM foundation model. We conduct a comprehensive investigation of the impact of different prompting strategies (including bounding boxes, positive points, negative points, and their combinations) on segmentation performance. We evaluate on two public datasets using the baseline model and models fine-tuned with varying amounts of annotated data, ranging from a limited number of volumes to a fully annotated dataset. Our findings indicate that prompting strategies significantly influence segmentation performance. Combining positive points with either bounding boxes or negative points shows substantial benefits, but little to no benefit when combined simultaneously. We further observe that fine-tuning SAM with a few annotated volumes improves segmentation performance when properly prompted. Specifically, fine-tuning with bounding boxes has a positive impact, while fine-tuning without bounding boxes leads to worse results compared to baseline.
△ Less
Submitted 14 December, 2023;
originally announced December 2023.
-
Attribute Regularized Soft Introspective Variational Autoencoder for Interpretable Cardiac Disease Classification
Authors:
Maxime Di Folco,
Cosmin I. Bercea,
Julia A. Schnabel
Abstract:
Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. In this paper, we propose a novel interpretable approach that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder. Comparative experiments on a cardiac MRI dataset demonstrate the ability of th…
▽ More
Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. In this paper, we propose a novel interpretable approach that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder. Comparative experiments on a cardiac MRI dataset demonstrate the ability of the proposed method to address blurry reconstruction issues of variational autoencoder methods and improve latent space interpretability. Additionally, our analysis of a downstream task reveals that the classification of cardiac disease using the regularized latent space heavily relies on attribute regularized dimensions, demonstrating great interpretability by connecting the used attributes for prediction with clinical observations.
△ Less
Submitted 14 December, 2023;
originally announced December 2023.
-
The Power Board of the KM3NeT Digital Optical Module: design, upgrade, and production
Authors:
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
F. Badaracco,
L. Bailly-Salins,
Z. Bardacova,
B. Baret,
A. Bariego Quintana,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
M. Benhassi,
D. M. Benoit
, et al. (259 additional authors not shown)
Abstract:
The KM3NeT Collaboration is building an underwater neutrino observatory at the bottom of the Mediterranean Sea consisting of two neutrino telescopes, both composed of a three-dimensional array of light detectors, known as digital optical modules. Each digital optical module contains a set of 31 three inch photomultiplier tubes distributed over the surface of a 0.44 m diameter pressure-resistant gl…
▽ More
The KM3NeT Collaboration is building an underwater neutrino observatory at the bottom of the Mediterranean Sea consisting of two neutrino telescopes, both composed of a three-dimensional array of light detectors, known as digital optical modules. Each digital optical module contains a set of 31 three inch photomultiplier tubes distributed over the surface of a 0.44 m diameter pressure-resistant glass sphere. The module includes also calibration instruments and electronics for power, readout and data acquisition. The power board was developed to supply power to all the elements of the digital optical module. The design of the power board began in 2013, and several prototypes were produced and tested. After an exhaustive validation process in various laboratories within the KM3NeT Collaboration, a mass production batch began, resulting in the construction of over 1200 power boards so far. These boards were integrated in the digital optical modules that have already been produced and deployed, 828 until October 2023. In 2017, an upgrade of the power board, to increase reliability and efficiency, was initiated. After the validation of a pre-production series, a production batch of 800 upgraded boards is currently underway. This paper describes the design, architecture, upgrade, validation, and production of the power board, including the reliability studies and tests conducted to ensure the safe operation at the bottom of the Mediterranean Sea throughout the observatory's lifespan
△ Less
Submitted 24 November, 2023;
originally announced November 2023.
-
sQUlearn -- A Python Library for Quantum Machine Learning
Authors:
David A. Kreplin,
Moritz Willmann,
Jan Schnabel,
Frederic Rapp,
Manuel Hagelüken,
Marco Roth
Abstract:
sQUlearn introduces a user-friendly, NISQ-ready Python library for quantum machine learning (QML), designed for seamless integration with classical machine learning tools like scikit-learn. The library's dual-layer architecture serves both QML researchers and practitioners, enabling efficient prototy**, experimentation, and pipelining. sQUlearn provides a comprehensive toolset that includes both…
▽ More
sQUlearn introduces a user-friendly, NISQ-ready Python library for quantum machine learning (QML), designed for seamless integration with classical machine learning tools like scikit-learn. The library's dual-layer architecture serves both QML researchers and practitioners, enabling efficient prototy**, experimentation, and pipelining. sQUlearn provides a comprehensive toolset that includes both quantum kernel methods and quantum neural networks, along with features like customizable data encoding strategies, automated execution handling, and specialized kernel regularization techniques. By focusing on NISQ-compatibility and end-to-end automation, sQUlearn aims to bridge the gap between current quantum computing capabilities and practical machine learning applications. The library provides substantial flexibility, enabling quick transitions between the underlying quantum frameworks Qiskit and PennyLane, as well as between simulation and running on actual hardware.
△ Less
Submitted 19 April, 2024; v1 submitted 15 November, 2023;
originally announced November 2023.
-
Learning Physics-Inspired Regularization for Medical Image Registration with Hypernetworks
Authors:
Anna Reithmeir,
Julia A. Schnabel,
Veronika A. Zimmer
Abstract:
Medical image registration aims at identifying the spatial deformation between images of the same anatomical region and is fundamental to image-based diagnostics and therapy. To date, the majority of the deep learning-based registration methods employ regularizers that enforce global spatial smoothness, e.g., the diffusion regularizer. However, such regularizers are not tailored to the data and mi…
▽ More
Medical image registration aims at identifying the spatial deformation between images of the same anatomical region and is fundamental to image-based diagnostics and therapy. To date, the majority of the deep learning-based registration methods employ regularizers that enforce global spatial smoothness, e.g., the diffusion regularizer. However, such regularizers are not tailored to the data and might not be capable of reflecting the complex underlying deformation. In contrast, physics-inspired regularizers promote physically plausible deformations. One such regularizer is the linear elastic regularizer which models the deformation of elastic material. These regularizers are driven by parameters that define the material's physical properties. For biological tissue, a wide range of estimations of such parameters can be found in the literature and it remains an open challenge to identify suitable parameter values for successful registration. To overcome this problem and to incorporate physical properties into learning-based registration, we propose to use a hypernetwork that learns the effect of the physical parameters of a physics-inspired regularizer on the resulting spatial deformation field. In particular, we adapt the HyperMorph framework to learn the effect of the two elasticity parameters of the linear elastic regularizer. Our approach enables the efficient discovery of suitable, data-specific physical parameters at test time.
△ Less
Submitted 4 December, 2023; v1 submitted 14 November, 2023;
originally announced November 2023.
-
Searches for neutrino counterparts of gravitational waves from the LIGO/Virgo third observing run with KM3NeT
Authors:
KM3NeT Collaboration,
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
L. Bailly-Salins,
Z. Bardačová,
B. Baret,
A. Bariego-Quintana,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
M. Benhassi,
D. M. Benoit
, et al. (251 additional authors not shown)
Abstract:
The KM3NeT neutrino telescope is currently being deployed at two different sites in the Mediterranean Sea. First searches for astrophysical neutrinos have been performed using data taken with the partial detector configuration already in operation. The paper presents the results of two independent searches for neutrinos from compact binary mergers detected during the third observing run of the LIG…
▽ More
The KM3NeT neutrino telescope is currently being deployed at two different sites in the Mediterranean Sea. First searches for astrophysical neutrinos have been performed using data taken with the partial detector configuration already in operation. The paper presents the results of two independent searches for neutrinos from compact binary mergers detected during the third observing run of the LIGO and Virgo gravitational wave interferometers. The first search looks for a global increase in the detector counting rates that could be associated with inverse beta decay events generated by MeV-scale electron anti-neutrinos. The second one focuses on upgoing track-like events mainly induced by muon (anti-)neutrinos in the GeV--TeV energy range. Both searches yield no significant excess for the sources in the gravitational wave catalogs. For each source, upper limits on the neutrino flux and on the total energy emitted in neutrinos in the respective energy ranges have been set. Stacking analyses of binary black hole mergers and neutron star-black hole mergers have also been performed to constrain the characteristic neutrino emission from these categories.
△ Less
Submitted 7 May, 2024; v1 submitted 7 November, 2023;
originally announced November 2023.
-
FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare
Authors:
Karim Lekadir,
Aasa Feragen,
Abdul Joseph Fofanah,
Alejandro F Frangi,
Alena Buyx,
Anais Emelie,
Andrea Lara,
Antonio R Porras,
An-Wen Chan,
Arcadi Navarro,
Ben Glocker,
Benard O Botwe,
Bishesh Khanal,
Brigit Beger,
Carol C Wu,
Celia Cintas,
Curtis P Langlotz,
Daniel Rueckert,
Deogratias Mzurikwao,
Dimitrios I Fotiadis,
Doszhan Zhussupov,
Enzo Ferrante,
Erik Meijering,
Eva Weicken,
Fabio A González
, et al. (93 additional authors not shown)
Abstract:
Despite major advances in artificial intelligence (AI) for medicine and healthcare, the deployment and adoption of AI technologies remain limited in real-world clinical practice. In recent years, concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. To increase real world adoption, it is essential that medical AI tools are trusted and accepted…
▽ More
Despite major advances in artificial intelligence (AI) for medicine and healthcare, the deployment and adoption of AI technologies remain limited in real-world clinical practice. In recent years, concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. To increase real world adoption, it is essential that medical AI tools are trusted and accepted by patients, clinicians, health organisations and authorities. This work describes the FUTURE-AI guideline as the first international consensus framework for guiding the development and deployment of trustworthy AI tools in healthcare. The FUTURE-AI consortium was founded in 2021 and currently comprises 118 inter-disciplinary experts from 51 countries representing all continents, including AI scientists, clinicians, ethicists, and social scientists. Over a two-year period, the consortium defined guiding principles and best practices for trustworthy AI through an iterative process comprising an in-depth literature review, a modified Delphi survey, and online consensus meetings. The FUTURE-AI framework was established based on 6 guiding principles for trustworthy AI in healthcare, i.e. Fairness, Universality, Traceability, Usability, Robustness and Explainability. Through consensus, a set of 28 best practices were defined, addressing technical, clinical, legal and socio-ethical dimensions. The recommendations cover the entire lifecycle of medical AI, from design, development and validation to regulation, deployment, and monitoring. FUTURE-AI is a risk-informed, assumption-free guideline which provides a structured approach for constructing medical AI tools that will be trusted, deployed and adopted in real-world practice. Researchers are encouraged to take the recommendations into account in proof-of-concept stages to facilitate future translation towards clinical practice of medical AI.
△ Less
Submitted 11 August, 2023;
originally announced September 2023.
-
Searches for neutrinos in the direction of radio-bright blazars with the ANTARES telescope
Authors:
ANTARES Collaboration,
A. Albert,
S. Alves,
M. André,
M. Ardid,
S. Ardid,
J. J. Aubert,
J Aublin,
B. Baret,
S. Basa,
Y. Becherini,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Brânzaş,
R. Bruijn,
J. Brunner,
J. Busto,
B. Caiffi
, et al. (140 additional authors not shown)
Abstract:
Active galaxies, especially blazars, are among the most promising neutrino source candidates. To date, ANTARES searches for these objects considered GeV-TeV $γ$-ray bright blazars. Here, a statistically complete radio-bright blazar sample is used as the target for searches of origins of neutrinos collected by the ANTARES neutrino telescope over 13 years of operation. The hypothesis of a neutrino-b…
▽ More
Active galaxies, especially blazars, are among the most promising neutrino source candidates. To date, ANTARES searches for these objects considered GeV-TeV $γ$-ray bright blazars. Here, a statistically complete radio-bright blazar sample is used as the target for searches of origins of neutrinos collected by the ANTARES neutrino telescope over 13 years of operation. The hypothesis of a neutrino-blazar directional correlation is tested by pair counting and by a complementary likelihood-based approach. The resulting post-trial $p$-value is $3.0\%$ ($2.2σ$ in the two-sided convention), possibly indicating a correlation. Additionally, a time-dependent analysis is performed to search for temporal clustering of neutrino candidates as a mean of detecting neutrino flares in blazars. None of the investigated sources alone reaches a significant flare detection level. However, the presence of 18 sources with a pre-trial significance above $3σ$ indicates a $p=1.4\%$ ($2.5σ$ in the two-sided convention) detection of a time-variable neutrino flux. An \textit{a posteriori} investigation reveals an intriguing temporal coincidence of neutrino, radio, and $γ$-ray flares of the J0242+1101 blazar at a $p=0.5\%$ ($2.9σ$ in the two-sided convention) level. Altogether, the results presented here suggest a possible connection of neutrino candidates detected by the ANTARES telescope with radio-bright blazars.
△ Less
Submitted 13 September, 2023;
originally announced September 2023.
-
Prospects for combined analyses of hadronic emission from $γ$-ray sources in the Milky Way with CTA and KM3NeT
Authors:
T. Unbehaun,
L. Mohrmann,
S. Funk,
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anghinolfi,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
C. Bagatelas,
L. Bailly-Salins,
Z. Bardačová,
B. Baret,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman
, et al. (249 additional authors not shown)
Abstract:
The Cherenkov Telescope Array and the KM3NeT neutrino telescopes are major upcoming facilities in the fields of $γ$-ray and neutrino astronomy, respectively. Possible simultaneous production of $γ$ rays and neutrinos in astrophysical accelerators of cosmic-ray nuclei motivates a combination of their data. We assess the potential of a combined analysis of CTA and KM3NeT data to determine the contri…
▽ More
The Cherenkov Telescope Array and the KM3NeT neutrino telescopes are major upcoming facilities in the fields of $γ$-ray and neutrino astronomy, respectively. Possible simultaneous production of $γ$ rays and neutrinos in astrophysical accelerators of cosmic-ray nuclei motivates a combination of their data. We assess the potential of a combined analysis of CTA and KM3NeT data to determine the contribution of hadronic emission processes in known Galactic $γ$-ray emitters, comparing this result to the cases of two separate analyses. In doing so, we demonstrate the capability of Gammapy, an open-source software package for the analysis of $γ$-ray data, to also process data from neutrino telescopes. For a selection of prototypical $γ$-ray sources within our Galaxy, we obtain models for primary proton and electron spectra in the hadronic and leptonic emission scenario, respectively, by fitting published $γ$-ray spectra. Using these models and instrument response functions for both detectors, we employ the Gammapy package to generate pseudo data sets, where we assume 200 hours of CTA observations and 10 years of KM3NeT detector operation. We then apply a three-dimensional binned likelihood analysis to these data sets, separately for each instrument and jointly for both. We find that the largest benefit of the combined analysis lies in the possibility of a consistent modelling of the $γ$-ray and neutrino emission. Assuming a purely leptonic scenario as input, we obtain, for the most favourable source, an average expected 68% credible interval that constrains the contribution of hadronic processes to the observed $γ$-ray emission to below 15%.
△ Less
Submitted 2 February, 2024; v1 submitted 6 September, 2023;
originally announced September 2023.
-
A skeletonization algorithm for gradient-based optimization
Authors:
Martin J. Menten,
Johannes C. Paetzold,
Veronika A. Zimmer,
Suprosanna Shit,
Ivan Ezhov,
Robbie Holland,
Monika Probst,
Julia A. Schnabel,
Daniel Rueckert
Abstract:
The skeleton of a digital image is a compact representation of its topology, geometry, and scale. It has utility in many computer vision applications, such as image description, segmentation, and registration. However, skeletonization has only seen limited use in contemporary deep learning solutions. Most existing skeletonization algorithms are not differentiable, making it impossible to integrate…
▽ More
The skeleton of a digital image is a compact representation of its topology, geometry, and scale. It has utility in many computer vision applications, such as image description, segmentation, and registration. However, skeletonization has only seen limited use in contemporary deep learning solutions. Most existing skeletonization algorithms are not differentiable, making it impossible to integrate them with gradient-based optimization. Compatible algorithms based on morphological operations and neural networks have been proposed, but their results often deviate from the geometry and topology of the true medial axis. This work introduces the first three-dimensional skeletonization algorithm that is both compatible with gradient-based optimization and preserves an object's topology. Our method is exclusively based on matrix additions and multiplications, convolutional operations, basic non-linear functions, and sampling from a uniform probability distribution, allowing it to be easily implemented in any major deep learning library. In benchmarking experiments, we prove the advantages of our skeletonization algorithm compared to non-differentiable, morphological, and neural-network-based baselines. Finally, we demonstrate the utility of our algorithm by integrating it with two medical image processing applications that use gradient-based optimization: deep-learning-based blood vessel segmentation, and multimodal registration of the mandible in computed tomography and magnetic resonance images.
△ Less
Submitted 5 September, 2023;
originally announced September 2023.
-
Bias in Unsupervised Anomaly Detection in Brain MRI
Authors:
Cosmin I. Bercea,
Esther Puyol-Antón,
Benedikt Wiestler,
Daniel Rueckert,
Julia A. Schnabel,
Andrew P. King
Abstract:
Unsupervised anomaly detection methods offer a promising and flexible alternative to supervised approaches, holding the potential to revolutionize medical scan analysis and enhance diagnostic performance.
In the current landscape, it is commonly assumed that differences between a test case and the training distribution are attributed solely to pathological conditions, implying that any disparity…
▽ More
Unsupervised anomaly detection methods offer a promising and flexible alternative to supervised approaches, holding the potential to revolutionize medical scan analysis and enhance diagnostic performance.
In the current landscape, it is commonly assumed that differences between a test case and the training distribution are attributed solely to pathological conditions, implying that any disparity indicates an anomaly. However, the presence of other potential sources of distributional shift, including scanner, age, sex, or race, is frequently overlooked. These shifts can significantly impact the accuracy of the anomaly detection task. Prominent instances of such failures have sparked concerns regarding the bias, credibility, and fairness of anomaly detection.
This work presents a novel analysis of biases in unsupervised anomaly detection. By examining potential non-pathological distributional shifts between the training and testing distributions, we shed light on the extent of these biases and their influence on anomaly detection results. Moreover, this study examines the algorithmic limitations that arise due to biases, providing valuable insights into the challenges encountered by anomaly detection algorithms in accurately learning and capturing the entire range of variability present in the normative distribution. Through this analysis, we aim to enhance the understanding of these biases and pave the way for future improvements in the field. Here, we specifically investigate Alzheimer's disease detection from brain MR imaging as a case study, revealing significant biases related to sex, race, and scanner variations that substantially impact the results. These findings align with the broader goal of improving the reliability, fairness, and effectiveness of anomaly detection in medical imaging.
△ Less
Submitted 26 August, 2023;
originally announced August 2023.
-
The Very-high-energy Open Data Format: towards a shared, open data format in very-high-energy astronomy
Authors:
B. Khélifi,
R. Zanin,
K. Kosack,
L. Olivera-Nieto,
J. Schnabel
Abstract:
In very-high-energy (VHE) gamma-ray astronomy, the community is converging towards the use of a common open data format, called "Data formats for Gamma-ray Astronomy", for the high-level data products. This format is in use for ground-based TeV observatories like H.E.S.S., MAGIC or HAWC, some of whom plan to openly release high-level data products. These efforts are parallel to the development and…
▽ More
In very-high-energy (VHE) gamma-ray astronomy, the community is converging towards the use of a common open data format, called "Data formats for Gamma-ray Astronomy", for the high-level data products. This format is in use for ground-based TeV observatories like H.E.S.S., MAGIC or HAWC, some of whom plan to openly release high-level data products. These efforts are parallel to the development and use of open analysis software such as the Gammapy package. This open initiative has shown that it is possible to define common standards even without governance. With the advent of open VHE observatories (e.g. CTAO, KM3NeT) and an increase in both multi-wavelength and multi-messenger studies, such standards should evolve to support all of VHE multi-messenger astrophysics. For these reasons, a new initiative has been created to specify formats of high-level data from very and ultra high energy gamma-ray facilities and from VHE neutrino detectors. It also aims to better respect the FAIR principles and the IVOA recommendations.This communication will present the Very-high-energy Open Data Format (VODF) project that has been established by eleven VHE astroparticle facilities. Its structure, its organisation and its goal will be presented. Anchored in Open Science, our goal is to solicit comments and future contributions from the VHE astrophysics community.
△ Less
Submitted 25 August, 2023;
originally announced August 2023.
-
ICoNIK: Generating Respiratory-Resolved Abdominal MR Reconstructions Using Neural Implicit Representations in k-Space
Authors:
Veronika Spieker,
Wenqi Huang,
Hannah Eichhorn,
Jonathan Stelter,
Kilian Weiss,
Veronika A. Zimmer,
Rickmer F. Braren,
Dimitrios C. Karampinos,
Kerstin Hammernik,
Julia A. Schnabel
Abstract:
Motion-resolved reconstruction for abdominal magnetic resonance imaging (MRI) remains a challenge due to the trade-off between residual motion blurring caused by discretized motion states and undersampling artefacts. In this work, we propose to generate blurring-free motion-resolved abdominal reconstructions by learning a neural implicit representation directly in k-space (NIK). Using measured sam…
▽ More
Motion-resolved reconstruction for abdominal magnetic resonance imaging (MRI) remains a challenge due to the trade-off between residual motion blurring caused by discretized motion states and undersampling artefacts. In this work, we propose to generate blurring-free motion-resolved abdominal reconstructions by learning a neural implicit representation directly in k-space (NIK). Using measured sampling points and a data-derived respiratory navigator signal, we train a network to generate continuous signal values. To aid the regularization of sparsely sampled regions, we introduce an additional informed correction layer (ICo), which leverages information from neighboring regions to correct NIK's prediction. Our proposed generative reconstruction methods, NIK and ICoNIK, outperform standard motion-resolved reconstruction techniques and provide a promising solution to address motion artefacts in abdominal MRI.
△ Less
Submitted 17 August, 2023;
originally announced August 2023.
-
Embedded Software of the KM3NeT Central Logic Board
Authors:
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anghinolfi,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
C. Bagatelas,
L. Bailly-Salins,
Z. Bardačová,
B. Baret,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
M. Benhassi,
D. M. Benoit
, et al. (249 additional authors not shown)
Abstract:
The KM3NeT Collaboration is building and operating two deep sea neutrino telescopes at the bottom of the Mediterranean Sea. The telescopes consist of latices of photomultiplier tubes housed in pressure-resistant glass spheres, called digital optical modules and arranged in vertical detection units. The two main scientific goals are the determination of the neutrino mass ordering and the discovery…
▽ More
The KM3NeT Collaboration is building and operating two deep sea neutrino telescopes at the bottom of the Mediterranean Sea. The telescopes consist of latices of photomultiplier tubes housed in pressure-resistant glass spheres, called digital optical modules and arranged in vertical detection units. The two main scientific goals are the determination of the neutrino mass ordering and the discovery and observation of high-energy neutrino sources in the Universe. Neutrinos are detected via the Cherenkov light, which is induced by charged particles originated in neutrino interactions. The photomultiplier tubes convert the Cherenkov light into electrical signals that are acquired and timestamped by the acquisition electronics. Each optical module houses the acquisition electronics for collecting and timestam** the photomultiplier signals with one nanosecond accuracy. Once finished, the two telescopes will have installed more than six thousand optical acquisition nodes, completing one of the more complex networks in the world in terms of operation and synchronization. The embedded software running in the acquisition nodes has been designed to provide a framework that will operate with different hardware versions and functionalities. The hardware will not be accessible once in operation, which complicates the embedded software architecture. The embedded software provides a set of tools to facilitate remote manageability of the deployed hardware, including safe reconfiguration of the firmware. This paper presents the architecture and the techniques, methods and implementation of the embedded software running in the acquisition nodes of the KM3NeT neutrino telescopes.
△ Less
Submitted 12 October, 2023; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Sparse annotation strategies for segmentation of short axis cardiac MRI
Authors:
Josh Stein,
Maxime Di Folco,
Julia Schnabel
Abstract:
Short axis cardiac MRI segmentation is a well-researched topic, with excellent results achieved by state-of-the-art models in a supervised setting. However, annotating MRI volumes is time-consuming and expensive. Many different approaches (e.g. transfer learning, data augmentation, few-shot learning, etc.) have emerged in an effort to use fewer annotated data and still achieve similar performance…
▽ More
Short axis cardiac MRI segmentation is a well-researched topic, with excellent results achieved by state-of-the-art models in a supervised setting. However, annotating MRI volumes is time-consuming and expensive. Many different approaches (e.g. transfer learning, data augmentation, few-shot learning, etc.) have emerged in an effort to use fewer annotated data and still achieve similar performance as a fully supervised model. Nevertheless, to the best of our knowledge, none of these works focus on which slices of MRI volumes are most important to annotate for yielding the best segmentation results. In this paper, we investigate the effects of training with sparse volumes, i.e. reducing the number of cases annotated, and sparse annotations, i.e. reducing the number of slices annotated per case. We evaluate the segmentation performance using the state-of-the-art nnU-Net model on two public datasets to identify which slices are the most important to annotate. We have shown that training on a significantly reduced dataset (48 annotated volumes) can give a Dice score greater than 0.85 and results comparable to using the full dataset (160 and 240 volumes for each dataset respectively). In general, training on more slice annotations provides more valuable information compared to training on more volumes. Further, annotating slices from the middle of volumes yields the most beneficial results in terms of segmentation performance, and the apical region the worst. When evaluating the trade-off between annotating volumes against slices, annotating as many slices as possible instead of annotating more volumes is a better strategy.
△ Less
Submitted 24 July, 2023;
originally announced July 2023.
-
Attribute Regularized Soft Introspective VAE: Towards Cardiac Attribute Regularization Through MRI Domains
Authors:
Maxime Di Folco,
Cosmin Bercea,
Julia A. Schnabel
Abstract:
Deep generative models have emerged as influential instruments for data generation and manipulation. Enhancing the controllability of these models by selectively modifying data attributes has been a recent focus. Variational Autoencoders (VAEs) have shown promise in capturing hidden attributes but often produce blurry reconstructions. Controlling these attributes through different imaging domains…
▽ More
Deep generative models have emerged as influential instruments for data generation and manipulation. Enhancing the controllability of these models by selectively modifying data attributes has been a recent focus. Variational Autoencoders (VAEs) have shown promise in capturing hidden attributes but often produce blurry reconstructions. Controlling these attributes through different imaging domains is difficult in medical imaging. Recently, Soft Introspective VAE leverage the benefits of both VAEs and Generative Adversarial Networks (GANs), which have demonstrated impressive image synthesis capabilities, by incorporating an adversarial loss into VAE training. In this work, we propose the Attributed Soft Introspective VAE (Attri-SIVAE) by incorporating an attribute regularized loss, into the Soft-Intro VAE framework. We evaluate experimentally the proposed method on cardiac MRI data from different domains, such as various scanner vendors and acquisition centers. The proposed method achieves similar performance in terms of reconstruction and regularization compared to the state-of-the-art Attributed regularized VAE but additionally also succeeds in kee** the same regularization level when tested on a different dataset, unlike the compared method.
△ Less
Submitted 14 December, 2023; v1 submitted 24 July, 2023;
originally announced July 2023.
-
Mask, Stitch, and Re-Sample: Enhancing Robustness and Generalizability in Anomaly Detection through Automatic Diffusion Models
Authors:
Cosmin I. Bercea,
Michael Neumayr,
Daniel Rueckert,
Julia A. Schnabel
Abstract:
The introduction of diffusion models in anomaly detection has paved the way for more effective and accurate image reconstruction in pathologies. However, the current limitations in controlling noise granularity hinder diffusion models' ability to generalize across diverse anomaly types and compromise the restoration of healthy tissues. To overcome these challenges, we propose AutoDDPM, a novel app…
▽ More
The introduction of diffusion models in anomaly detection has paved the way for more effective and accurate image reconstruction in pathologies. However, the current limitations in controlling noise granularity hinder diffusion models' ability to generalize across diverse anomaly types and compromise the restoration of healthy tissues. To overcome these challenges, we propose AutoDDPM, a novel approach that enhances the robustness of diffusion models. AutoDDPM utilizes diffusion models to generate initial likelihood maps of potential anomalies and seamlessly integrates them with the original image. Through joint noised distribution re-sampling, AutoDDPM achieves harmonization and in-painting effects. Our study demonstrates the efficacy of AutoDDPM in replacing anomalous regions while preserving healthy tissues, considerably surpassing diffusion models' limitations. It also contributes valuable insights and analysis on the limitations of current diffusion models, promoting robust and interpretable anomaly detection in medical imaging - an essential aspect of building autonomous clinical decision systems with higher interpretability.
△ Less
Submitted 31 May, 2023;
originally announced May 2023.
-
Deep Learning for Retrospective Motion Correction in MRI: A Comprehensive Review
Authors:
Veronika Spieker,
Hannah Eichhorn,
Kerstin Hammernik,
Daniel Rueckert,
Christine Preibisch,
Dimitrios C. Karampinos,
Julia A. Schnabel
Abstract:
Motion represents one of the major challenges in magnetic resonance imaging (MRI). Since the MR signal is acquired in frequency space, any motion of the imaged object leads to complex artefacts in the reconstructed image in addition to other MR imaging artefacts. Deep learning has been frequently proposed for motion correction at several stages of the reconstruction process. The wide range of MR a…
▽ More
Motion represents one of the major challenges in magnetic resonance imaging (MRI). Since the MR signal is acquired in frequency space, any motion of the imaged object leads to complex artefacts in the reconstructed image in addition to other MR imaging artefacts. Deep learning has been frequently proposed for motion correction at several stages of the reconstruction process. The wide range of MR acquisition sequences, anatomies and pathologies of interest, and motion patterns (rigid vs. deformable and random vs. regular) makes a comprehensive solution unlikely. To facilitate the transfer of ideas between different applications, this review provides a detailed overview of proposed methods for learning-based motion correction in MRI together with their common challenges and potentials. This review identifies differences and synergies in underlying data usage, architectures, training and evaluation strategies. We critically discuss general trends and outline future directions, with the aim to enhance interaction between different application areas and research fields.
△ Less
Submitted 25 September, 2023; v1 submitted 11 May, 2023;
originally announced May 2023.
-
Physics-Aware Motion Simulation for T2*-Weighted Brain MRI
Authors:
Hannah Eichhorn,
Kerstin Hammernik,
Veronika Spieker,
Samira M. Epp,
Daniel Rueckert,
Christine Preibisch,
Julia A. Schnabel
Abstract:
In this work, we propose a realistic, physics-aware motion simulation procedure for T2*-weighted magnetic resonance imaging (MRI) to improve learning-based motion correction. As T2*-weighted MRI is highly sensitive to motion-related changes in magnetic field inhomogeneities, it is of utmost importance to include physics information in the simulation. Additionally, current motion simulations often…
▽ More
In this work, we propose a realistic, physics-aware motion simulation procedure for T2*-weighted magnetic resonance imaging (MRI) to improve learning-based motion correction. As T2*-weighted MRI is highly sensitive to motion-related changes in magnetic field inhomogeneities, it is of utmost importance to include physics information in the simulation. Additionally, current motion simulations often only assume simplified motion patterns. Our simulations, on the other hand, include real recorded subject motion and realistic effects of motion-induced magnetic field inhomogeneity changes. We demonstrate the use of such simulated data by training a convolutional neural network to detect the presence of motion in affected k-space lines. The network accurately detects motion-affected k-space lines for simulated displacements down to $\geq$ 0.5mm (accuracy on test set: 92.5%). Finally, our results demonstrate exciting opportunities of simulation-based k-space line detection combined with more powerful reconstruction methods.
△ Less
Submitted 30 August, 2023; v1 submitted 20 March, 2023;
originally announced March 2023.
-
Reversing the Abnormal: Pseudo-Healthy Generative Networks for Anomaly Detection
Authors:
Cosmin I Bercea,
Benedikt Wiestler,
Daniel Rueckert,
Julia A Schnabel
Abstract:
Early and accurate disease detection is crucial for patient management and successful treatment outcomes. However, the automatic identification of anomalies in medical images can be challenging. Conventional methods rely on large labeled datasets which are difficult to obtain. To overcome these limitations, we introduce a novel unsupervised approach, called PHANES (Pseudo Healthy generative networ…
▽ More
Early and accurate disease detection is crucial for patient management and successful treatment outcomes. However, the automatic identification of anomalies in medical images can be challenging. Conventional methods rely on large labeled datasets which are difficult to obtain. To overcome these limitations, we introduce a novel unsupervised approach, called PHANES (Pseudo Healthy generative networks for ANomaly Segmentation). Our method has the capability of reversing anomalies, i.e., preserving healthy tissue and replacing anomalous regions with pseudo-healthy (PH) reconstructions. Unlike recent diffusion models, our method does not rely on a learned noise distribution nor does it introduce random alterations to the entire image. Instead, we use latent generative networks to create masks around possible anomalies, which are refined using inpainting generative networks. We demonstrate the effectiveness of PHANES in detecting stroke lesions in T1w brain MRI datasets and show significant improvements over state-of-the-art (SOTA) methods. We believe that our proposed framework will open new avenues for interpretable, fast, and accurate anomaly segmentation with the potential to support various clinical-oriented downstream tasks.
△ Less
Submitted 15 March, 2023;
originally announced March 2023.
-
3D Masked Autoencoders with Application to Anomaly Detection in Non-Contrast Enhanced Breast MRI
Authors:
Daniel M. Lang,
Eli Schwartz,
Cosmin I. Bercea,
Raja Giryes,
Julia A. Schnabel
Abstract:
Self-supervised models allow (pre-)training on unlabeled data and therefore have the potential to overcome the need for large annotated cohorts. One leading self-supervised model is the masked autoencoder (MAE) which was developed on natural imaging data. The MAE is masking out a high fraction of visual transformer (ViT) input patches, to then recover the uncorrupted images as a pretraining task.…
▽ More
Self-supervised models allow (pre-)training on unlabeled data and therefore have the potential to overcome the need for large annotated cohorts. One leading self-supervised model is the masked autoencoder (MAE) which was developed on natural imaging data. The MAE is masking out a high fraction of visual transformer (ViT) input patches, to then recover the uncorrupted images as a pretraining task. In this work, we extend MAE to perform anomaly detection on breast magnetic resonance imaging (MRI). This new model, coined masked autoencoder for medical imaging (MAEMI) is trained on two non-contrast enhanced MRI sequences, aiming at lesion detection without the need for intravenous injection of contrast media and temporal image acquisition. During training, only non-cancerous images are presented to the model, with the purpose of localizing anomalous tumor regions during test time. We use a public dataset for model development. Performance of the architecture is evaluated in reference to subtraction images created from dynamic contrast enhanced (DCE)-MRI.
△ Less
Submitted 10 March, 2023;
originally announced March 2023.
-
Search for neutrino counterparts to the gravitational wave sources from LIGO/Virgo O3 run with the ANTARES detector
Authors:
ANTARES Collaboration,
A. Albert,
S. Alves,
M. André,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
Y. Becherini,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Brânzaş,
R. Bruijn,
J. Brunner,
J. Busto,
B. Caiffi
, et al. (128 additional authors not shown)
Abstract:
Since 2015 the LIGO and Virgo interferometers have detected gravitational waves from almost one hundred coalescences of compact objects (black holes and neutron stars). This article presents the results of a search performed with data from the ANTARES telescope to identify neutrino counterparts to the gravitational wave sources detected during the third LIGO/Virgo observing run and reported in the…
▽ More
Since 2015 the LIGO and Virgo interferometers have detected gravitational waves from almost one hundred coalescences of compact objects (black holes and neutron stars). This article presents the results of a search performed with data from the ANTARES telescope to identify neutrino counterparts to the gravitational wave sources detected during the third LIGO/Virgo observing run and reported in the catalogues GWTC-2, GWTC-2.1, and GWTC-3. This search is sensitive to all-sky neutrinos of all flavours and of energies $>100$ GeV, thanks to the inclusion of both track-like events (mainly induced by $ν_μ$ charged-current interactions) and shower-like events (induced by other interaction types). Neutrinos are selected if they are detected within $\pm 500$ s from the GW merger and with a reconstructed direction compatible with its sky localisation. No significant excess is found for any of the 80 analysed GW events, and upper limits on the neutrino emission are derived. Using the information from the GW catalogues and assuming isotropic emission, upper limits on the total energy $E_{\rm tot, ν}$ emitted as neutrinos of all flavours and on the ratio $f_ν= E_{\rm tot, ν}/E_{\rm GW}$ between neutrino and GW emissions are also computed. Finally, a stacked analysis of all the 72 binary black hole mergers (respectively the 7 neutron star - black hole merger candidates) has been performed to constrain the typical neutrino emission within this population, leading to the limits: $E_{\rm tot, ν} < 4.0 \times 10^{53}$ erg and $f_ν< 0.15$ (respectively, $E_{\rm tot, ν} < 3.2 \times 10^{53}$ erg and $f_ν< 0.88$) for $E^{-2}$ spectrum and isotropic emission. Other assumptions including softer spectra and non-isotropic scenarios have also been tested.
△ Less
Submitted 17 April, 2023; v1 submitted 15 February, 2023;
originally announced February 2023.
-
Probing invisible neutrino decay with KM3NeT-ORCA
Authors:
KM3NeT Collaboration,
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
M. Anghinolfi,
M. Anguita,
M. Ardid,
S. Ardid,
J. Aublin,
C. Bagatelas,
L. Bailly-Salins,
B. Baret,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
E. Berbee,
V. Bertin,
S. Biagi,
M. Boettcher,
M. Bou Cabo
, et al. (230 additional authors not shown)
Abstract:
In the era of precision measurements of the neutrino oscillation parameters, upcoming neutrino experiments will also be sensitive to physics beyond the Standard Model. KM3NeT/ORCA is a neutrino detector optimised for measuring atmospheric neutrinos from a few GeV to around 100 GeV. In this paper, the sensitivity of the KM3NeT/ORCA detector to neutrino decay has been explored. A three-flavour neutr…
▽ More
In the era of precision measurements of the neutrino oscillation parameters, upcoming neutrino experiments will also be sensitive to physics beyond the Standard Model. KM3NeT/ORCA is a neutrino detector optimised for measuring atmospheric neutrinos from a few GeV to around 100 GeV. In this paper, the sensitivity of the KM3NeT/ORCA detector to neutrino decay has been explored. A three-flavour neutrino oscillation scenario, where the third neutrino mass state $ν_3$ decays into an invisible state, e.g. a sterile neutrino, is considered. We find that KM3NeT/ORCA would be sensitive to invisible neutrino decays with $1/α_3=τ_3/m_3 < 180$~$\mathrm{ps/eV}$ at $90\%$ confidence level, assuming true normal ordering. Finally, the impact of neutrino decay on the precision of KM3NeT/ORCA measurements for $θ_{23}$, $Δm^2_{31}$ and mass ordering have been studied. No significant effect of neutrino decay on the sensitivity to these measurements has been found.
△ Less
Submitted 27 March, 2023; v1 submitted 6 February, 2023;
originally announced February 2023.
-
Fully transformer-based biomarker prediction from colorectal cancer histology: a large-scale multicentric study
Authors:
Sophia J. Wagner,
Daniel Reisenbüchler,
Nicholas P. West,
Jan Moritz Niehues,
Gregory Patrick Veldhuizen,
Philip Quirke,
Heike I. Grabsch,
Piet A. van den Brandt,
Gordon G. A. Hutchins,
Susan D. Richman,
Tanwei Yuan,
Rupert Langer,
Josien Christina Anna Jenniskens,
Kelly Offermans,
Wolfram Mueller,
Richard Gray,
Stephen B. Gruber,
Joel K. Greenson,
Gad Rennert,
Joseph D. Bonner,
Daniel Schmolze,
Jacqueline A. James,
Maurice B. Loughrey,
Manuel Salto-Tellez,
Hermann Brenner
, et al. (6 additional authors not shown)
Abstract:
Background: Deep learning (DL) can extract predictive and prognostic biomarkers from routine pathology slides in colorectal cancer. For example, a DL test for the diagnosis of microsatellite instability (MSI) in CRC has been approved in 2022. Current approaches rely on convolutional neural networks (CNNs). Transformer networks are outperforming CNNs and are replacing them in many applications, but…
▽ More
Background: Deep learning (DL) can extract predictive and prognostic biomarkers from routine pathology slides in colorectal cancer. For example, a DL test for the diagnosis of microsatellite instability (MSI) in CRC has been approved in 2022. Current approaches rely on convolutional neural networks (CNNs). Transformer networks are outperforming CNNs and are replacing them in many applications, but have not been used for biomarker prediction in cancer at a large scale. In addition, most DL approaches have been trained on small patient cohorts, which limits their clinical utility. Methods: In this study, we developed a new fully transformer-based pipeline for end-to-end biomarker prediction from pathology slides. We combine a pre-trained transformer encoder and a transformer network for patch aggregation, capable of yielding single and multi-target prediction at patient level. We train our pipeline on over 9,000 patients from 10 colorectal cancer cohorts. Results: A fully transformer-based approach massively improves the performance, generalizability, data efficiency, and interpretability as compared with current state-of-the-art algorithms. After training on a large multicenter cohort, we achieve a sensitivity of 0.97 with a negative predictive value of 0.99 for MSI prediction on surgical resection specimens. We demonstrate for the first time that resection specimen-only training reaches clinical-grade performance on endoscopic biopsy tissue, solving a long-standing diagnostic problem. Interpretation: A fully transformer-based end-to-end pipeline trained on thousands of pathology slides yields clinical-grade performance for biomarker prediction on surgical resections and biopsies. Our new methods are freely available under an open source license.
△ Less
Submitted 1 March, 2023; v1 submitted 23 January, 2023;
originally announced January 2023.
-
Hint for a TeV neutrino emission from the Galactic Ridge with ANTARES
Authors:
A. Albert,
S. Alves,
M. André,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
Y. Becherini,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Brânzaş,
R. Bruijn,
J. Brunner,
J. Busto,
B. Caiffi,
D. Calvo
, et al. (129 additional authors not shown)
Abstract:
Interactions of cosmic ray protons, atomic nuclei, and electrons in the interstellar medium in the inner part of the Milky Way produce a $γ$-ray flux from the Galactic Ridge. If the $γ$-ray emission is dominated by proton and nuclei interactions, a neutrino flux comparable to the $γ$-ray flux is expected from the same sky region. Data collected by the ANTARES neutrino telescope are used to constra…
▽ More
Interactions of cosmic ray protons, atomic nuclei, and electrons in the interstellar medium in the inner part of the Milky Way produce a $γ$-ray flux from the Galactic Ridge. If the $γ$-ray emission is dominated by proton and nuclei interactions, a neutrino flux comparable to the $γ$-ray flux is expected from the same sky region. Data collected by the ANTARES neutrino telescope are used to constrain the neutrino flux from the Galactic Ridge in the 1-100 TeV energy range. Neutrino events reconstructed both as tracks and showers are considered in the analysis and the selection is optimized for the search of an excess in the region $|l| < 30°$, $|b| < 2°$. The expected background in the search region is estimated using an off-zone region with similar sky coverage. Neutrino signal originating from a power-law spectrum with spectral index ranging from $Γ_ν=1$ to $4$ is simulated in both channels. The observed energy distributions are fitted to constrain the neutrino emission from the Ridge. The energy distributions in the signal region are inconsistent with the background expectation at $\sim 96\%$ confidence level. The mild excess over the background is consistent with a neutrino flux with a power law with a spectral index $2.45^{+0.22}_{-0.34}$ and a flux normalization $dN_ν/dE_ν= 4.0^{+2.7}_{-2.0} \times 10^{-16} \text{GeV}^{-1} \text{cm}^{-2} \text{s}^{-1} \text{sr}^{-1}$ at 40 TeV reference energy. Such flux is consistent with the expected neutrino signal if the bulk of the observed $γ$-ray flux from the Galactic Ridge originates from interactions of cosmic ray protons and nuclei with a power-law spectrum extending well into the PeV energy range.
△ Less
Submitted 12 May, 2023; v1 submitted 22 December, 2022;
originally announced December 2022.
-
Review of the online analyses of multi-messenger alerts and electromagnetic transient events with the ANTARES neutrino telescope
Authors:
A. Albert,
S. Alves,
M. André,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Brânzaş,
R. Bruijn,
J. Brunner,
J. Busto,
B. Caiffi,
D. Calvo,
S. Campion
, et al. (124 additional authors not shown)
Abstract:
By constantly monitoring at least one complete hemisphere of the sky, neutrino telescopes are well designed to detect neutrinos emitted by transient astrophysical events. Real-time searches with the ANTARES telescope have been performed to look for neutrino candidates coincident with gamma-ray bursts detected by the Swift and Fermi satellites, highenergy neutrino events registered by IceCube, tran…
▽ More
By constantly monitoring at least one complete hemisphere of the sky, neutrino telescopes are well designed to detect neutrinos emitted by transient astrophysical events. Real-time searches with the ANTARES telescope have been performed to look for neutrino candidates coincident with gamma-ray bursts detected by the Swift and Fermi satellites, highenergy neutrino events registered by IceCube, transient events from blazars monitored by HAWC, photon-neutrino coincidences by AMON notices and gravitational wave candidates observed by LIGO/Virgo. By requiring temporal coincidence, this approach increases the sensitivity and the significance of a potential discovery. Thanks to the good angular accuracy of neutrino candidates reconstructed with the ANTARES telescope, a coincident detection can also improve the positioning area of non-well localised triggers such as those detected by gravitational wave interferometers. This paper summarises the results of the follow-up performed by the ANTARES telescope between 01/2014 and 02/2022, which corresponds to the end of the data taking period.
△ Less
Submitted 26 February, 2024; v1 submitted 14 November, 2022;
originally announced November 2022.
-
Automated Quality Controlled Analysis of 2D Phase Contrast Cardiovascular Magnetic Resonance Imaging
Authors:
Emily Chan,
Ciaran O'Hanlon,
Carlota Asegurado Marquez,
Marwenie Petalcorin,
Jorge Mariscal-Harana,
Haotian Gu,
Raymond J. Kim,
Robert M. Judd,
Phil Chowienczyk,
Julia A. Schnabel,
Reza Razavi,
Andrew P. King,
Bram Ruijsink,
Esther Puyol-Antón
Abstract:
Flow analysis carried out using phase contrast cardiac magnetic resonance imaging (PC-CMR) enables the quantification of important parameters that are used in the assessment of cardiovascular function. An essential part of this analysis is the identification of the correct CMR views and quality control (QC) to detect artefacts that could affect the flow quantification. We propose a novel deep lear…
▽ More
Flow analysis carried out using phase contrast cardiac magnetic resonance imaging (PC-CMR) enables the quantification of important parameters that are used in the assessment of cardiovascular function. An essential part of this analysis is the identification of the correct CMR views and quality control (QC) to detect artefacts that could affect the flow quantification. We propose a novel deep learning based framework for the fully-automated analysis of flow from full CMR scans that first carries out these view selection and QC steps using two sequential convolutional neural networks, followed by automatic aorta and pulmonary artery segmentation to enable the quantification of key flow parameters. Accuracy values of 0.958 and 0.914 were obtained for view classification and QC, respectively. For segmentation, Dice scores were $>$0.969 and the Bland-Altman plots indicated excellent agreement between manual and automatic peak flow values. In addition, we tested our pipeline on an external validation data set, with results indicating good robustness of the pipeline. This work was carried out using multivendor clinical data consisting of 986 cases, indicating the potential for the use of this pipeline in a clinical setting.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Search for Gamma-Ray and Neutrino Coincidences Using HAWC and ANTARES Data
Authors:
H. A. Ayala Solares,
S. Coutu,
D. Cowen,
D. B. Fox,
T. Grégoire,
F. McBride,
M. Mostafá,
K. Murase,
S. Wissel,
A. Albert,
S. Alves,
M. André,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza
, et al. (207 additional authors not shown)
Abstract:
In the quest for high-energy neutrino sources, the Astrophysical Multimessenger Observatory Network (AMON) has implemented a new search by combining data from the High Altitude Water Cherenkov (HAWC) observatory and the Astronomy with a Neutrino Telescope and Abyss environmental RESearch (ANTARES) neutrino telescope. Using the same analysis strategy as in a previous detector combination of HAWC an…
▽ More
In the quest for high-energy neutrino sources, the Astrophysical Multimessenger Observatory Network (AMON) has implemented a new search by combining data from the High Altitude Water Cherenkov (HAWC) observatory and the Astronomy with a Neutrino Telescope and Abyss environmental RESearch (ANTARES) neutrino telescope. Using the same analysis strategy as in a previous detector combination of HAWC and IceCube data, we perform a search for coincidences in HAWC and ANTARES events that are below the threshold for sending public alerts in each individual detector. Data were collected between July 2015 and February 2020 with a livetime of 4.39 years. Over this time period, 3 coincident events with an estimated false-alarm rate of $< 1$ coincidence per year were found. This number is consistent with background expectations.
△ Less
Submitted 13 March, 2023; v1 submitted 27 September, 2022;
originally announced September 2022.
-
Limits on the nuclearite flux using the ANTARES neutrino telescope
Authors:
ANTARES Collaboration,
A. Albert,
S. Alves,
M. André,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Brânzaş,
R. Bruijn,
J. Brunner,
J. Busto,
B. Caiffi,
D. Calvo
, et al. (121 additional authors not shown)
Abstract:
In this work, a search for nuclearites of strange quark matter by using nine years of ANTARES data taken in the period 2009-2017 is presented. The passage through matter of these particles is simulated %according to the model of de Rújula and Glashow taking into account a detailed description of the detector response to nuclearites and of the data acquisition conditions. A down-going flux of cosmi…
▽ More
In this work, a search for nuclearites of strange quark matter by using nine years of ANTARES data taken in the period 2009-2017 is presented. The passage through matter of these particles is simulated %according to the model of de Rújula and Glashow taking into account a detailed description of the detector response to nuclearites and of the data acquisition conditions. A down-going flux of cosmic nuclearites with Galactic velocities ($β= 10^{-3}$) was considered for this study. The mass threshold for detecting these particles at the detector level is \mbox{ $4 \times 10^{13}$ GeV/c$^{2}$}. Upper limits on the nuclearite flux for masses up to $10^{17}$ GeV/c$^{2}$ at the level of $\sim 5 \times 10^{-17}$ cm$^{-2}$ s$^{-1}$ sr$^{-1}$ are obtained. These are the first upper limits on nuclearites established with a neutrino telescope and the most stringent ever set for Galactic velocities.
△ Less
Submitted 10 December, 2022; v1 submitted 24 August, 2022;
originally announced August 2022.
-
Evaluation of 3D GANs for Lung Tissue Modelling in Pulmonary CT
Authors:
Sam Ellis,
Octavio E. Martinez Manzanera,
Vasileios Baltatzis,
Ibrahim Nawaz,
Arjun Nair,
Loïc Le Folgoc,
Sujal Desai,
Ben Glocker,
Julia A. Schnabel
Abstract:
GANs are able to model accurately the distribution of complex, high-dimensional datasets, e.g. images. This makes high-quality GANs useful for unsupervised anomaly detection in medical imaging. However, differences in training datasets such as output image dimensionality and appearance of semantically meaningful features mean that GAN models from the natural image domain may not work `out-of-the-b…
▽ More
GANs are able to model accurately the distribution of complex, high-dimensional datasets, e.g. images. This makes high-quality GANs useful for unsupervised anomaly detection in medical imaging. However, differences in training datasets such as output image dimensionality and appearance of semantically meaningful features mean that GAN models from the natural image domain may not work `out-of-the-box' for medical imaging, necessitating re-implementation and re-evaluation. In this work we adapt and evaluate three GAN models to the task of modelling 3D healthy image patches for pulmonary CT. To the best of our knowledge, this is the first time that such an evaluation has been performed. The DCGAN, styleGAN and the bigGAN architectures were investigated due to their ubiquity and high performance in natural image processing. We train different variants of these methods and assess their performance using the FID score. In addition, the quality of the generated images was evaluated by a human observer study, the ability of the networks to model 3D domain-specific features was investigated, and the structure of the GAN latent spaces was analysed. Results show that the 3D styleGAN produces realistic-looking images with meaningful 3D structure, but suffer from mode collapse which must be addressed during training to obtain samples diversity. Conversely, the 3D DCGAN models show a greater capacity for image variability, but at the cost of poor-quality images. The 3D bigGAN models provide an intermediate level of image quality, but most accurately model the distribution of selected semantically meaningful features. The results suggest that future development is required to realise a 3D GAN with sufficient capacity for patch-based lung CT anomaly detection and we offer recommendations for future areas of research, such as experimenting with other architectures and incorporation of position-encoding.
△ Less
Submitted 17 August, 2022;
originally announced August 2022.
-
Placenta Segmentation in Ultrasound Imaging: Addressing Sources of Uncertainty and Limited Field-of-View
Authors:
Veronika A. Zimmer,
Alberto Gomez,
Emily Skelton,
Robert Wright,
Gavin Wheeler,
Shujie Deng,
Nooshin Ghavami,
Karen Lloyd,
Jacqueline Matthew,
Bernhard Kainz,
Daniel Rueckert,
Joseph V. Hajnal,
Julia A. Schnabel
Abstract:
Automatic segmentation of the placenta in fetal ultrasound (US) is challenging due to the (i) high diversity of placenta appearance, (ii) the restricted quality in US resulting in highly variable reference annotations, and (iii) the limited field-of-view of US prohibiting whole placenta assessment at late gestation. In this work, we address these three challenges with a multi-task learning approac…
▽ More
Automatic segmentation of the placenta in fetal ultrasound (US) is challenging due to the (i) high diversity of placenta appearance, (ii) the restricted quality in US resulting in highly variable reference annotations, and (iii) the limited field-of-view of US prohibiting whole placenta assessment at late gestation. In this work, we address these three challenges with a multi-task learning approach that combines the classification of placental location (e.g., anterior, posterior) and semantic placenta segmentation in a single convolutional neural network. Through the classification task the model can learn from larger and more diverse datasets while improving the accuracy of the segmentation task in particular in limited training set conditions. With this approach we investigate the variability in annotations from multiple raters and show that our automatic segmentations (Dice of 0.86 for anterior and 0.83 for posterior placentas) achieve human-level performance as compared to intra- and inter-observer variability. Lastly, our approach can deliver whole placenta segmentation using a multi-view US acquisition pipeline consisting of three stages: multi-probe image acquisition, image fusion and image segmentation. This results in high quality segmentation of larger structures such as the placenta in US with reduced image artifacts which are beyond the field-of-view of single probes.
△ Less
Submitted 29 June, 2022;
originally announced June 2022.
-
High-accuracy Rb$_{2}^+$ interaction potentials based on coupled cluster calculations
Authors:
Jan Schnabel,
Lan Cheng,
Andreas Köhn
Abstract:
This work discusses a protocol for constructing highly accurate potential energy curves (PECs) for the lowest two states of Rb$_{2}^+$, i.e. $X\,{}^2Σ{_g^+}$ and $(1) {}^2Σ{_u^+}$, using an additivity scheme based on coupled-cluster theory. The approach exploits the findings of our previous work [J. Schnabel, L. Cheng and A. Köhn, J. Chem. Phys. 155, 124101 (2021)] to avoid the unphysical repulsiv…
▽ More
This work discusses a protocol for constructing highly accurate potential energy curves (PECs) for the lowest two states of Rb$_{2}^+$, i.e. $X\,{}^2Σ{_g^+}$ and $(1) {}^2Σ{_u^+}$, using an additivity scheme based on coupled-cluster theory. The approach exploits the findings of our previous work [J. Schnabel, L. Cheng and A. Köhn, J. Chem. Phys. 155, 124101 (2021)] to avoid the unphysical repulsive long-range barrier occurring for symmetric molecular ions when perturbative estimates of higher-order cluster operators are employed. Furthermore, care was taken to reproduce the physically correct exchange splitting of the $X {}^2Σ{_g^+}$ and $(1) {}^2Σ{_u^+}$ PECs. The accuracy of our computational approach is benchmarked for ionization energies of Rb and for spectroscopic constants as well as vibrational levels of the $a {}^3Σ{_u^+}$ triplet state of Rb\textsubscript{2}. We study high-level correlation contributions, high-level relativistic effects and inner-shell correlation contributions and find very good agreement with experimental reference values for the atomic ionization potential and the binding energy of Rb$_{2}$ in the $a\,{}^3Σ{_u^+}$ triplet state. Our final best estimate for the binding energy of the Rb$_{2}^+$ $X {}^2Σ{_g^+}$ state including zero-point vibrational contributions is $D_0 = 6179\,\mathrm{cm}^{-1}$ with an estimated error bound of $\mathcal{O}(\pm 30\,\mathrm{cm}^{-1})$. This value is smaller than the experimentally inferred lower bond of $D_0\ge 6307.5\,\mathrm{cm}^{-1}$ [Bellos et al., Phys. Rev. A 87, 012508 (2013)] and will require further investigation. For the $(1) {}^2Σ{_u^+}$ state a shallow potential with $D_0 = 78.4\,\mathrm{cm}^{-1}$ and an error bound of $\pm 9\,\mathrm{cm}^{-1}$ is computed.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
-
What do we learn? Debunking the Myth of Unsupervised Outlier Detection
Authors:
Cosmin I. Bercea,
Daniel Rueckert,
Julia A. Schnabel
Abstract:
Even though auto-encoders (AEs) have the desirable property of learning compact representations without labels and have been widely applied to out-of-distribution (OoD) detection, they are generally still poorly understood and are used incorrectly in detecting outliers where the normal and abnormal distributions are strongly overlap**. In general, the learned manifold is assumed to contain key i…
▽ More
Even though auto-encoders (AEs) have the desirable property of learning compact representations without labels and have been widely applied to out-of-distribution (OoD) detection, they are generally still poorly understood and are used incorrectly in detecting outliers where the normal and abnormal distributions are strongly overlap**. In general, the learned manifold is assumed to contain key information that is only important for describing samples within the training distribution, and that the reconstruction of outliers leads to high residual errors. However, recent work suggests that AEs are likely to be even better at reconstructing some types of OoD samples. In this work, we challenge this assumption and investigate what auto-encoders actually learn when they are posed to solve two different tasks. First, we propose two metrics based on the Fréchet inception distance (FID) and confidence scores of a trained classifier to assess whether AEs can learn the training distribution and reliably recognize samples from other domains. Second, we investigate whether AEs are able to synthesize normal images from samples with abnormal regions, on a more challenging lung pathology detection task. We have found that state-of-the-art (SOTA) AEs are either unable to constrain the latent manifold and allow reconstruction of abnormal patterns, or they are failing to accurately restore the inputs from their latent distribution, resulting in blurred or misaligned reconstructions. We propose novel deformable auto-encoders (MorphAEus) to learn perceptually aware global image priors and locally adapt their morphometry based on estimated dense deformation fields. We demonstrate superior performance over unsupervised methods in detecting OoD and pathology.
△ Less
Submitted 8 February, 2023; v1 submitted 8 June, 2022;
originally announced June 2022.
-
A Deep Learning-based Integrated Framework for Quality-aware Undersampled Cine Cardiac MRI Reconstruction and Analysis
Authors:
Inês P. Machado,
Esther Puyol-Antón,
Kerstin Hammernik,
Gastão Cruz,
Devran Ugurlu,
Ihsane Olakorede,
Ilkay Oksuz,
Bram Ruijsink,
Miguel Castelo-Branco,
Alistair A. Young,
Claudia Prieto,
Julia A. Schnabel,
Andrew P. King
Abstract:
Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this paper, we present a fully-automated, quality-controlled integrated framework…
▽ More
Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this paper, we present a fully-automated, quality-controlled integrated framework for reconstruction, segmentation and downstream analysis of undersampled cine CMR data. The framework enables active acquisition of radial k-space data, in which acquisition can be stopped as soon as acquired data are sufficient to produce high quality reconstructions and segmentations. This results in reduced scan times and automated analysis, enabling robust and accurate estimation of functional biomarkers. To demonstrate the feasibility of the proposed approach, we perform realistic simulations of radial k-space acquisitions on a dataset of subjects from the UK Biobank and present results on in-vivo cine CMR k-space data collected from healthy subjects. The results demonstrate that our method can produce quality-controlled images in a mean scan time reduced from 12 to 4 seconds per slice, and that image quality is sufficient to allow clinically relevant parameters to be automatically estimated to within 5% mean absolute difference.
△ Less
Submitted 2 May, 2022;
originally announced May 2022.
-
Search for secluded dark matter towards the Galactic Centre with the ANTARES neutrino telescope
Authors:
A. Albert,
S. Alves,
M. Andre,
M. Anghinolfi,
G. Anton,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Branzas,
R. Bruijn,
J. Brunner,
J. Busto,
B. Caiffi
, et al. (124 additional authors not shown)
Abstract:
Searches for dark matter (DM) have not provided any solid evidence for the existence of weakly interacting massive particles in the GeV-TeV mass range. Coincidentally, the scale of new physics is being pushed by collider searches well beyond the TeV domain. This situation strongly motivates the exploration of DM masses much larger than a TeV. Secluded scenarios contain a natural way around the uni…
▽ More
Searches for dark matter (DM) have not provided any solid evidence for the existence of weakly interacting massive particles in the GeV-TeV mass range. Coincidentally, the scale of new physics is being pushed by collider searches well beyond the TeV domain. This situation strongly motivates the exploration of DM masses much larger than a TeV. Secluded scenarios contain a natural way around the unitarity bound on the DM mass, via the early matter domination induced by the mediator of its interactions with the Standard Model. High-energy neutrinos constitute one of the very few direct accesses to energy scales above a few TeV. An indirect search for secluded DM signals has been performed with the ANTARES neutrino telescope using data from 2007 to 2015. Upper limits on the DM annihilation cross section for DM masses up to 6 PeV are presented and discussed.
△ Less
Submitted 11 March, 2022;
originally announced March 2022.
-
Search for Magnetic Monopoles with ten years of the ANTARES neutrino telescope
Authors:
ANTARES Collaboration,
A. Albert,
S. Alves,
M. André,
M. Anghinolfi,
G. Anton,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Brânzaş,
R. Bruijn,
J. Brunner,
J. Busto
, et al. (123 additional authors not shown)
Abstract:
This work presents a new search for magnetic monopoles using data taken with the ANTARES neutrino telescope over a period of 10 years (January 2008 to December 2017). Compared to previous ANTARES searches, this analysis uses a run-by-run simulation strategy, with a larger exposure as well as a new simulation of magnetic monopoles taking into account the Kasama, Yang and Goldhaber model for their i…
▽ More
This work presents a new search for magnetic monopoles using data taken with the ANTARES neutrino telescope over a period of 10 years (January 2008 to December 2017). Compared to previous ANTARES searches, this analysis uses a run-by-run simulation strategy, with a larger exposure as well as a new simulation of magnetic monopoles taking into account the Kasama, Yang and Goldhaber model for their interaction cross-section with matter. No signal compatible with the passage of relativistic magnetic monopoles is observed, and upper limits on the flux of magnetic monopoles with $β$ = v/c $\geq$ 0.55, are presented. For ultra-relativistic magnetic monopoles the flux limit is $\sim$ 7$\times$$10^{-18}$ $\rm cm^{-2} s^{-1} sr^{-1}$.
△ Less
Submitted 9 March, 2022; v1 submitted 28 February, 2022;
originally announced February 2022.
