Showing 1–50 of 97 results for author: Schnabel, A

Progressive Growing of Patch Size: Resource-Efficient Curriculum Learning for Dense Prediction Tasks

Authors: Stefan M. Fischer, Lina Felsner, Richard Osuala, Johannes Kiechle, Daniel M. Lang, Jan C. Peeken, Julia A. Schnabel

Abstract: In this work, we introduce Progressive Growing of Patch Size, a resource-efficient implicit curriculum learning approach for dense prediction tasks. Our curriculum approach is defined by growing the patch size during model training, which gradually increases the task's difficulty. We integrated our curriculum into the nnU-Net framework and evaluated the methodology on all 10 tasks of the Medical S… ▽ More In this work, we introduce Progressive Growing of Patch Size, a resource-efficient implicit curriculum learning approach for dense prediction tasks. Our curriculum approach is defined by growing the patch size during model training, which gradually increases the task's difficulty. We integrated our curriculum into the nnU-Net framework and evaluated the methodology on all 10 tasks of the Medical Segmentation Decathlon. With our approach, we are able to substantially reduce runtime, computational costs, and CO2 emissions of network training compared to classical constant patch size training. In our experiments, the curriculum approach resulted in improved convergence. We are able to outperform standard nnU-Net training, which is trained with constant patch size, in terms of Dice Score on 7 out of 10 MSD tasks while only spending roughly 50% of the original training runtime. To the best of our knowledge, our Progressive Growing of Patch Size is the first successful employment of a sample-length curriculum in the form of patch size in the field of computer vision. Our code is publicly available at https://github.com/compai-lab/2024-miccai-fischer. △ Less

Submitted 11 July, 2024; v1 submitted 10 July, 2024; originally announced July 2024.

Comments: Accepted at MICCAI2024; Changes for Camera-Ready-Version for MICCAI2024 (missing in this arxiv submission): Replaced T-Test with Wilcoxon Signed Ranked Test, as DSC samples are not normally distributed => now only significant improvements and no significant decreases in performance for PGPS/PGPS+

Machine Unlearning for Medical Imaging

Authors: Reza Nasirigerdeh, Nader Razmi, Julia A. Schnabel, Daniel Rueckert, Georgios Kaissis

Abstract: Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider their contribution in models including medical imaging models. In this study, we evaluate the effectiveness (performance) and computational efficiency of differ… ▽ More Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider their contribution in models including medical imaging models. In this study, we evaluate the effectiveness (performance) and computational efficiency of different unlearning algorithms in medical imaging domain. Our evaluations demonstrate that the considered unlearning algorithms perform well on the retain set (samples whose influence on the model is allowed to be retained) and forget set (samples whose contribution to the model should be eliminated), and show no bias against male or female samples. They, however, adversely impact the generalization of the model, especially for larger forget set sizes. Moreover, they might be biased against easy or hard samples, and need additional computational overhead for hyper-parameter tuning. In conclusion, machine unlearning seems promising for medical imaging, but the existing unlearning algorithms still needs further improvements to become more practical for medical applications. △ Less

Submitted 10 July, 2024; originally announced July 2024.

Data-Driven Tissue- and Subject-Specific Elastic Regularization for Medical Image Registration

Authors: Anna Reithmeir, Lina Felsner, Rickmer Braren, Julia A. Schnabel, Veronika A. Zimmer

Abstract: Physics-inspired regularization is desired for intra-patient image registration since it can effectively capture the biomechanical characteristics of anatomical structures. However, a major challenge lies in the reliance on physical parameters: Parameter estimations vary widely across the literature, and the physical properties themselves are inherently subject-specific. In this work, we introduce… ▽ More Physics-inspired regularization is desired for intra-patient image registration since it can effectively capture the biomechanical characteristics of anatomical structures. However, a major challenge lies in the reliance on physical parameters: Parameter estimations vary widely across the literature, and the physical properties themselves are inherently subject-specific. In this work, we introduce a novel data-driven method that leverages hypernetworks to learn the tissue-dependent elasticity parameters of an elastic regularizer. Notably, our approach facilitates the estimation of patient-specific parameters without the need to retrain the network. We evaluate our method on three publicly available 2D and 3D lung CT and cardiac MR datasets. We find that with our proposed subject-specific tissue-dependent regularization, a higher registration quality is achieved across all datasets compared to using a global regularizer. The code is available at https://github.com/compai-lab/2024-miccai-reithmeir. △ Less

Submitted 5 July, 2024; originally announced July 2024.

Comments: Accepted at MICCAI 2024

Unsupervised Analysis of Alzheimer's Disease Signatures using 3D Deformable Autoencoders

Authors: Mehmet Yigit Avci, Emily Chan, Veronika Zimmer, Daniel Rueckert, Benedikt Wiestler, Julia A. Schnabel, Cosmin I. Bercea

Abstract: With the increasing incidence of neurodegenerative diseases such as Alzheimer's Disease (AD), there is a need for further research that enhances detection and monitoring of the diseases. We present MORPHADE (Morphological Autoencoders for Alzheimer's Disease Detection), a novel unsupervised learning approach which uses deformations to allow the analysis of 3D T1-weighted brain images. To the best… ▽ More With the increasing incidence of neurodegenerative diseases such as Alzheimer's Disease (AD), there is a need for further research that enhances detection and monitoring of the diseases. We present MORPHADE (Morphological Autoencoders for Alzheimer's Disease Detection), a novel unsupervised learning approach which uses deformations to allow the analysis of 3D T1-weighted brain images. To the best of our knowledge, this is the first use of deformations with deep unsupervised learning to not only detect, but also localize and assess the severity of structural changes in the brain due to AD. We obtain markedly higher anomaly scores in clinically important areas of the brain in subjects with AD compared to healthy controls, showcasing that our method is able to effectively locate AD-related atrophy. We additionally observe a visual correlation between the severity of atrophy highlighted in our anomaly maps and medial temporal lobe atrophy scores evaluated by a clinical expert. Finally, our method achieves an AUROC of 0.80 in detecting AD, out-performing several supervised and unsupervised baselines. We believe our framework shows promise as a tool towards improved understanding, monitoring and detection of AD. To support further research and application, we have made our code publicly available at github.com/ci-ber/MORPHADE. △ Less

Submitted 4 July, 2024; originally announced July 2024.

Comments: 11 pages, 5 figures

Robustness Testing of Black-Box Models Against CT Degradation Through Test-Time Augmentation

Authors: Jack Highton, Quok Zong Chong, Samuel Finestone, Arian Beqiri, Julia A. Schnabel, Kanwal K. Bhatia

Abstract: Deep learning models for medical image segmentation and object detection are becoming increasingly available as clinical products. However, as details are rarely provided about the training data, models may unexpectedly fail when cases differ from those in the training distribution. An approach allowing potential users to independently test the robustness of a model, treating it as a black box and… ▽ More Deep learning models for medical image segmentation and object detection are becoming increasingly available as clinical products. However, as details are rarely provided about the training data, models may unexpectedly fail when cases differ from those in the training distribution. An approach allowing potential users to independently test the robustness of a model, treating it as a black box and using only a few cases from their own site, is key for adoption. To address this, a method to test the robustness of these models against CT image quality variation is presented. In this work we present this framework by demonstrating that given the same training data, the model architecture and data pre processing greatly affect the robustness of several frequently used segmentation and object detection methods to simulated CT imaging artifacts and degradation. Our framework also addresses the concern about the sustainability of deep learning models in clinical use, by considering future shifts in image quality due to scanner deterioration or imaging protocol changes which are not reflected in a limited local test dataset. △ Less

Submitted 27 June, 2024; originally announced June 2024.

Mask the Unknown: Assessing Different Strategies to Handle Weak Annotations in the MICCAI2023 Mediastinal Lymph Node Quantification Challenge

Authors: Stefan M. Fischer, Johannes Kiechle, Daniel M. Lang, Jan C. Peeken, Julia A. Schnabel

Abstract: Pathological lymph node delineation is crucial in cancer diagnosis, progression assessment, and treatment planning. The MICCAI 2023 Lymph Node Quantification Challenge published the first public dataset for pathological lymph node segmentation in the mediastinum. As lymph node annotations are expensive, the challenge was formed as a weakly supervised learning task, where only a subset of all lymph… ▽ More Pathological lymph node delineation is crucial in cancer diagnosis, progression assessment, and treatment planning. The MICCAI 2023 Lymph Node Quantification Challenge published the first public dataset for pathological lymph node segmentation in the mediastinum. As lymph node annotations are expensive, the challenge was formed as a weakly supervised learning task, where only a subset of all lymph nodes in the training set have been annotated. For the challenge submission, multiple methods for training on these weakly supervised data were explored, including noisy label training, loss masking of unlabeled data, and an approach that integrated the TotalSegmentator toolbox as a form of pseudo labeling in order to reduce the number of unknown voxels. Furthermore, multiple public TCIA datasets were incorporated into the training to improve the performance of the deep learning model. Our submitted model achieved a Dice score of 0.628 and an average symmetric surface distance of 5.8~mm on the challenge test set. With our submitted model, we accomplished third rank in the MICCAI2023 LNQ challenge. A finding of our analysis was that the integration of all visible, including non-pathological, lymph nodes improved the overall segmentation performance on pathological lymph nodes of the test set. Furthermore, segmentation models trained only on clinically enlarged lymph nodes, as given in the challenge scenario, could not generalize to smaller pathological lymph nodes. The code and model for the challenge submission are available at \url{https://gitlab.lrz.de/compai/MediastinalLymphNodeSegmentation}. △ Less

Submitted 20 June, 2024; originally announced June 2024.

Comments: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://melba-journal.org/2024:008

Journal ref: Machine.Learning.for.Biomedical.Imaging. 2 (2024)

Interpretable Representation Learning of Cardiac MRI via Attribute Regularization

Authors: Maxime Di Folco, Cosmin I. Bercea, Emily Chan, Julia A. Schnabel

Abstract: Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. Several approaches have been recently considered to encode attributes in the latent space to enhance its interpretability. Notably, attribute regularization aims to encode a set of attributes along the dimensions of a latent representation. However, this approach is b… ▽ More Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. Several approaches have been recently considered to encode attributes in the latent space to enhance its interpretability. Notably, attribute regularization aims to encode a set of attributes along the dimensions of a latent representation. However, this approach is based on Variational AutoEncoder and suffers from blurry reconstruction. In this paper, we propose an Attributed-regularized Soft Introspective Variational Autoencoder that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder. We demonstrate on short-axis cardiac Magnetic Resonance images of the UK Biobank the ability of the proposed method to address blurry reconstruction issues of variational autoencoder methods while preserving the latent space interpretability. △ Less

Submitted 5 July, 2024; v1 submitted 12 June, 2024; originally announced June 2024.

Comments: arXiv admin note: substantial text overlap with arXiv:2312.08915

Self-Supervised k-Space Regularization for Motion-Resolved Abdominal MRI Using Neural Implicit k-Space Representation

Authors: Veronika Spieker, Hannah Eichhorn, Jonathan K. Stelter, Wenqi Huang, Rickmer F. Braren, Daniel Rückert, Francisco Sahli Costabal, Kerstin Hammernik, Claudia Prieto, Dimitrios C. Karampinos, Julia A. Schnabel

Abstract: Neural implicit k-space representations have shown promising results for dynamic MRI at high temporal resolutions. Yet, their exclusive training in k-space limits the application of common image regularization methods to improve the final reconstruction. In this work, we introduce the concept of parallel imaging-inspired self-consistency (PISCO), which we incorporate as novel self-supervised k-spa… ▽ More Neural implicit k-space representations have shown promising results for dynamic MRI at high temporal resolutions. Yet, their exclusive training in k-space limits the application of common image regularization methods to improve the final reconstruction. In this work, we introduce the concept of parallel imaging-inspired self-consistency (PISCO), which we incorporate as novel self-supervised k-space regularization enforcing a consistent neighborhood relationship. At no additional data cost, the proposed regularization significantly improves neural implicit k-space reconstructions on simulated data. Abdominal in-vivo reconstructions using PISCO result in enhanced spatio-temporal image quality compared to state-of-the-art methods. Code is available at https://github.com/vjspi/PISCO-NIK. △ Less

Submitted 12 April, 2024; originally announced April 2024.

Comments: Under Review

Multi-Image Visual Question Answering for Unsupervised Anomaly Detection

Authors: Jun Li, Cosmin I. Bercea, Philip Müller, Lina Felsner, Suhwan Kim, Daniel Rueckert, Benedikt Wiestler, Julia A. Schnabel

Abstract: Unsupervised anomaly detection enables the identification of potential pathological areas by juxtaposing original images with their pseudo-healthy reconstructions generated by models trained exclusively on normal images. However, the clinical interpretation of resultant anomaly maps presents a challenge due to a lack of detailed, understandable explanations. Recent advancements in language models… ▽ More Unsupervised anomaly detection enables the identification of potential pathological areas by juxtaposing original images with their pseudo-healthy reconstructions generated by models trained exclusively on normal images. However, the clinical interpretation of resultant anomaly maps presents a challenge due to a lack of detailed, understandable explanations. Recent advancements in language models have shown the capability of mimicking human-like understanding and providing detailed descriptions. This raises an interesting question: \textit{How can language models be employed to make the anomaly maps more explainable?} To the best of our knowledge, we are the first to leverage a language model for unsupervised anomaly detection, for which we construct a dataset with different questions and answers. Additionally, we present a novel multi-image visual question answering framework tailored for anomaly detection, incorporating diverse feature fusion strategies to enhance visual knowledge extraction. Our experiments reveal that the framework, augmented by our new Knowledge Q-Former module, adeptly answers questions on the anomaly detection dataset. Besides, integrating anomaly maps as inputs distinctly aids in improving the detection of unseen pathologies. △ Less

Submitted 11 April, 2024; originally announced April 2024.

Comments: 13 pages, 8 figures

Diffusion Models with Implicit Guidance for Medical Anomaly Detection

Authors: Cosmin I. Bercea, Benedikt Wiestler, Daniel Rueckert, Julia A. Schnabel

Abstract: Diffusion models have advanced unsupervised anomaly detection by improving the transformation of pathological images into pseudo-healthy equivalents. Nonetheless, standard approaches may compromise critical information during pathology removal, leading to restorations that do not align with unaffected regions in the original scans. Such discrepancies can inadvertently increase false positive rates… ▽ More Diffusion models have advanced unsupervised anomaly detection by improving the transformation of pathological images into pseudo-healthy equivalents. Nonetheless, standard approaches may compromise critical information during pathology removal, leading to restorations that do not align with unaffected regions in the original scans. Such discrepancies can inadvertently increase false positive rates and reduce specificity, complicating radiological evaluations. This paper introduces Temporal Harmonization for Optimal Restoration (THOR), which refines the de-noising process by integrating implicit guidance through temporal anomaly maps. THOR aims to preserve the integrity of healthy tissue in areas unaffected by pathology. Comparative evaluations show that THOR surpasses existing diffusion-based methods in detecting and segmenting anomalies in brain MRIs and wrist X-rays. Code: https://github.com/ci-ber/THOR_DDPM. △ Less

Submitted 13 March, 2024; originally announced March 2024.

Physics-Informed Deep Learning for Motion-Corrected Reconstruction of Quantitative Brain MRI

Authors: Hannah Eichhorn, Veronika Spieker, Kerstin Hammernik, Elisa Saks, Kilian Weiss, Christine Preibisch, Julia A. Schnabel

Abstract: We propose PHIMO, a physics-informed learning-based motion correction method tailored to quantitative MRI. PHIMO leverages information from the signal evolution to exclude motion-corrupted k-space lines from a data-consistent reconstruction. We demonstrate the potential of PHIMO for the application of T2* quantification from gradient echo MRI, which is particularly sensitive to motion due to its s… ▽ More We propose PHIMO, a physics-informed learning-based motion correction method tailored to quantitative MRI. PHIMO leverages information from the signal evolution to exclude motion-corrupted k-space lines from a data-consistent reconstruction. We demonstrate the potential of PHIMO for the application of T2* quantification from gradient echo MRI, which is particularly sensitive to motion due to its sensitivity to magnetic field inhomogeneities. A state-of-the-art technique for motion correction requires redundant acquisition of the k-space center, prolonging the acquisition. We show that PHIMO can detect and exclude intra-scan motion events and, thus, correct for severe motion artifacts. PHIMO approaches the performance of the state-of-the-art motion correction method, while substantially reducing the acquisition time by over 40%, facilitating clinical applicability. Our code is available at https://github.com/HannahEichhorn/PHIMO. △ Less

Submitted 24 June, 2024; v1 submitted 13 March, 2024; originally announced March 2024.

Comments: Accepted at MICCAI 2024

Towards Universal Unsupervised Anomaly Detection in Medical Imaging

Authors: Cosmin I. Bercea, Benedikt Wiestler, Daniel Rueckert, Julia A. Schnabel

Abstract: The increasing complexity of medical imaging data underscores the need for advanced anomaly detection methods to automatically identify diverse pathologies. Current methods face challenges in capturing the broad spectrum of anomalies, often limiting their use to specific lesion types in brain scans. To address this challenge, we introduce a novel unsupervised approach, termed \textit{Reversed Auto… ▽ More The increasing complexity of medical imaging data underscores the need for advanced anomaly detection methods to automatically identify diverse pathologies. Current methods face challenges in capturing the broad spectrum of anomalies, often limiting their use to specific lesion types in brain scans. To address this challenge, we introduce a novel unsupervised approach, termed \textit{Reversed Auto-Encoders (RA)}, designed to create realistic pseudo-healthy reconstructions that enable the detection of a wider range of pathologies. We evaluate the proposed method across various imaging modalities, including magnetic resonance imaging (MRI) of the brain, pediatric wrist X-ray, and chest X-ray, and demonstrate superior performance in detecting anomalies compared to existing state-of-the-art methods. Our unsupervised anomaly detection approach may enhance diagnostic accuracy in medical imaging by identifying a broader range of unknown pathologies. Our code is publicly available at: \url{https://github.com/ci-ber/RA}. △ Less

Submitted 19 January, 2024; originally announced January 2024.

Low-resource finetuning of foundation models beats state-of-the-art in histopathology

Authors: Benedikt Roth, Valentin Koch, Sophia J. Wagner, Julia A. Schnabel, Carsten Marr, Tingying Peng

Abstract: To handle the large scale of whole slide images in computational pathology, most approaches first tessellate the images into smaller patches, extract features from these patches, and finally aggregate the feature vectors with weakly-supervised learning. The performance of this workflow strongly depends on the quality of the extracted features. Recently, foundation models in computer vision showed… ▽ More To handle the large scale of whole slide images in computational pathology, most approaches first tessellate the images into smaller patches, extract features from these patches, and finally aggregate the feature vectors with weakly-supervised learning. The performance of this workflow strongly depends on the quality of the extracted features. Recently, foundation models in computer vision showed that leveraging huge amounts of data through supervised or self-supervised learning improves feature quality and generalizability for a variety of tasks. In this study, we benchmark the most popular vision foundation models as feature extractors for histopathology data. We evaluate the models in two settings: slide-level classification and patch-level classification. We show that foundation models are a strong baseline. Our experiments demonstrate that by finetuning a foundation model on a single GPU for only two hours or three days depending on the dataset, we can match or outperform state-of-the-art feature extractors for computational pathology. These findings imply that even with little resources one can finetune a feature extractor tailored towards a specific downstream task and dataset. This is a considerable shift from the current state, where only few institutions with large amounts of resources and datasets are able to train a feature extractor. We publish all code used for training and evaluation as well as the finetuned models. △ Less

Submitted 9 January, 2024; originally announced January 2024.

Influence of Prompting Strategies on Segment Anything Model (SAM) for Short-axis Cardiac MRI segmentation

Authors: Josh Stein, Maxime Di Folco, Julia A. Schnabel

Abstract: The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits limitations in handling specific medical imaging tasks that require fine-structure segmentation or precise boundaries. In this paper, we focus on the task of cardi… ▽ More The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits limitations in handling specific medical imaging tasks that require fine-structure segmentation or precise boundaries. In this paper, we focus on the task of cardiac magnetic resonance imaging (cMRI) short-axis view segmentation using the SAM foundation model. We conduct a comprehensive investigation of the impact of different prompting strategies (including bounding boxes, positive points, negative points, and their combinations) on segmentation performance. We evaluate on two public datasets using the baseline model and models fine-tuned with varying amounts of annotated data, ranging from a limited number of volumes to a fully annotated dataset. Our findings indicate that prompting strategies significantly influence segmentation performance. Combining positive points with either bounding boxes or negative points shows substantial benefits, but little to no benefit when combined simultaneously. We further observe that fine-tuning SAM with a few annotated volumes improves segmentation performance when properly prompted. Specifically, fine-tuning with bounding boxes has a positive impact, while fine-tuning without bounding boxes leads to worse results compared to baseline. △ Less

Submitted 14 December, 2023; originally announced December 2023.

Attribute Regularized Soft Introspective Variational Autoencoder for Interpretable Cardiac Disease Classification

Authors: Maxime Di Folco, Cosmin I. Bercea, Julia A. Schnabel

Abstract: Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. In this paper, we propose a novel interpretable approach that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder. Comparative experiments on a cardiac MRI dataset demonstrate the ability of th… ▽ More Interpretability is essential in medical imaging to ensure that clinicians can comprehend and trust artificial intelligence models. In this paper, we propose a novel interpretable approach that combines attribute regularization of the latent space within the framework of an adversarially trained variational autoencoder. Comparative experiments on a cardiac MRI dataset demonstrate the ability of the proposed method to address blurry reconstruction issues of variational autoencoder methods and improve latent space interpretability. Additionally, our analysis of a downstream task reveals that the classification of cardiac disease using the regularized latent space heavily relies on attribute regularized dimensions, demonstrating great interpretability by connecting the used attributes for prediction with clinical observations. △ Less

Submitted 14 December, 2023; originally announced December 2023.

Learning Physics-Inspired Regularization for Medical Image Registration with Hypernetworks

Authors: Anna Reithmeir, Julia A. Schnabel, Veronika A. Zimmer

Abstract: Medical image registration aims at identifying the spatial deformation between images of the same anatomical region and is fundamental to image-based diagnostics and therapy. To date, the majority of the deep learning-based registration methods employ regularizers that enforce global spatial smoothness, e.g., the diffusion regularizer. However, such regularizers are not tailored to the data and mi… ▽ More Medical image registration aims at identifying the spatial deformation between images of the same anatomical region and is fundamental to image-based diagnostics and therapy. To date, the majority of the deep learning-based registration methods employ regularizers that enforce global spatial smoothness, e.g., the diffusion regularizer. However, such regularizers are not tailored to the data and might not be capable of reflecting the complex underlying deformation. In contrast, physics-inspired regularizers promote physically plausible deformations. One such regularizer is the linear elastic regularizer which models the deformation of elastic material. These regularizers are driven by parameters that define the material's physical properties. For biological tissue, a wide range of estimations of such parameters can be found in the literature and it remains an open challenge to identify suitable parameter values for successful registration. To overcome this problem and to incorporate physical properties into learning-based registration, we propose to use a hypernetwork that learns the effect of the physical parameters of a physics-inspired regularizer on the resulting spatial deformation field. In particular, we adapt the HyperMorph framework to learn the effect of the two elasticity parameters of the linear elastic regularizer. Our approach enables the efficient discovery of suitable, data-specific physical parameters at test time. △ Less

Submitted 4 December, 2023; v1 submitted 14 November, 2023; originally announced November 2023.

Comments: Manuscript accepted at SPIE Medical Imaging 2024

Achieving ultra-low and -uniform residual magnetic fields in a very large magnetically shielded room for fundamental physics experiments

Authors: N. J. Ayres, G. Ban, G. Bison, K. Bodek, V. Bondar, T. Bouillaud, D. Bowles, E. Chanel, W. Chen, P. -J. Chiu, C. B. Crawford, O. Naviliat-Cuncic, C. B. Doorenbos, S. Emmenegger, M. Fertl, A. Fratangelo, W. C. Griffith, Z. D. Grujic, P. G. Harris, K. Kirch, V. Kletzl, J. Krempel, B. Lauss, T. Lefort, A. Lejuez , et al. (25 additional authors not shown)

Abstract: High-precision searches for an electric dipole moment of the neutron (nEDM) require stable and uniform magnetic field environments. We present the recent achievements of degaussing and equilibrating the magnetically shielded room (MSR) for the n2EDM experiment at the Paul Scherrer Institute. We present the final degaussing configuration that will be used for n2EDM after numerous studies. The optim… ▽ More High-precision searches for an electric dipole moment of the neutron (nEDM) require stable and uniform magnetic field environments. We present the recent achievements of degaussing and equilibrating the magnetically shielded room (MSR) for the n2EDM experiment at the Paul Scherrer Institute. We present the final degaussing configuration that will be used for n2EDM after numerous studies. The optimized procedure results in a residual magnetic field that has been reduced by a factor of two. The ultra-low field is achieved with the full magnetic-field-coil system, and a large vacuum vessel installed, both in the MSR. In the inner volume of ~1.4 m^3, the field is now more uniform and below 300 pT. In addition, the procedure is faster and dissipates less heat into the magnetic environment, which in turn, reduces its thermal relaxation time from 12 h down to ~1.5 h. △ Less

Submitted 28 September, 2023; originally announced September 2023.

FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare

Authors: Karim Lekadir, Aasa Feragen, Abdul Joseph Fofanah, Alejandro F Frangi, Alena Buyx, Anais Emelie, Andrea Lara, Antonio R Porras, An-Wen Chan, Arcadi Navarro, Ben Glocker, Benard O Botwe, Bishesh Khanal, Brigit Beger, Carol C Wu, Celia Cintas, Curtis P Langlotz, Daniel Rueckert, Deogratias Mzurikwao, Dimitrios I Fotiadis, Doszhan Zhussupov, Enzo Ferrante, Erik Meijering, Eva Weicken, Fabio A González , et al. (95 additional authors not shown)

Abstract: Despite major advances in artificial intelligence (AI) for medicine and healthcare, the deployment and adoption of AI technologies remain limited in real-world clinical practice. In recent years, concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. To increase real world adoption, it is essential that medical AI tools are trusted and accepted… ▽ More Despite major advances in artificial intelligence (AI) for medicine and healthcare, the deployment and adoption of AI technologies remain limited in real-world clinical practice. In recent years, concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. To increase real world adoption, it is essential that medical AI tools are trusted and accepted by patients, clinicians, health organisations and authorities. This work describes the FUTURE-AI guideline as the first international consensus framework for guiding the development and deployment of trustworthy AI tools in healthcare. The FUTURE-AI consortium was founded in 2021 and currently comprises 118 inter-disciplinary experts from 51 countries representing all continents, including AI scientists, clinicians, ethicists, and social scientists. Over a two-year period, the consortium defined guiding principles and best practices for trustworthy AI through an iterative process comprising an in-depth literature review, a modified Delphi survey, and online consensus meetings. The FUTURE-AI framework was established based on 6 guiding principles for trustworthy AI in healthcare, i.e. Fairness, Universality, Traceability, Usability, Robustness and Explainability. Through consensus, a set of 28 best practices were defined, addressing technical, clinical, legal and socio-ethical dimensions. The recommendations cover the entire lifecycle of medical AI, from design, development and validation to regulation, deployment, and monitoring. FUTURE-AI is a risk-informed, assumption-free guideline which provides a structured approach for constructing medical AI tools that will be trusted, deployed and adopted in real-world practice. Researchers are encouraged to take the recommendations into account in proof-of-concept stages to facilitate future translation towards clinical practice of medical AI. △ Less

Submitted 8 July, 2024; v1 submitted 11 August, 2023; originally announced September 2023.

ACM Class: I.2.0; I.4.0; I.5.0

A skeletonization algorithm for gradient-based optimization

Authors: Martin J. Menten, Johannes C. Paetzold, Veronika A. Zimmer, Suprosanna Shit, Ivan Ezhov, Robbie Holland, Monika Probst, Julia A. Schnabel, Daniel Rueckert

Abstract: The skeleton of a digital image is a compact representation of its topology, geometry, and scale. It has utility in many computer vision applications, such as image description, segmentation, and registration. However, skeletonization has only seen limited use in contemporary deep learning solutions. Most existing skeletonization algorithms are not differentiable, making it impossible to integrate… ▽ More The skeleton of a digital image is a compact representation of its topology, geometry, and scale. It has utility in many computer vision applications, such as image description, segmentation, and registration. However, skeletonization has only seen limited use in contemporary deep learning solutions. Most existing skeletonization algorithms are not differentiable, making it impossible to integrate them with gradient-based optimization. Compatible algorithms based on morphological operations and neural networks have been proposed, but their results often deviate from the geometry and topology of the true medial axis. This work introduces the first three-dimensional skeletonization algorithm that is both compatible with gradient-based optimization and preserves an object's topology. Our method is exclusively based on matrix additions and multiplications, convolutional operations, basic non-linear functions, and sampling from a uniform probability distribution, allowing it to be easily implemented in any major deep learning library. In benchmarking experiments, we prove the advantages of our skeletonization algorithm compared to non-differentiable, morphological, and neural-network-based baselines. Finally, we demonstrate the utility of our algorithm by integrating it with two medical image processing applications that use gradient-based optimization: deep-learning-based blood vessel segmentation, and multimodal registration of the mandible in computed tomography and magnetic resonance images. △ Less

Submitted 5 September, 2023; originally announced September 2023.

Comments: Accepted at ICCV 2023

Bias in Unsupervised Anomaly Detection in Brain MRI

Authors: Cosmin I. Bercea, Esther Puyol-Antón, Benedikt Wiestler, Daniel Rueckert, Julia A. Schnabel, Andrew P. King

Abstract: Unsupervised anomaly detection methods offer a promising and flexible alternative to supervised approaches, holding the potential to revolutionize medical scan analysis and enhance diagnostic performance. In the current landscape, it is commonly assumed that differences between a test case and the training distribution are attributed solely to pathological conditions, implying that any disparity… ▽ More Unsupervised anomaly detection methods offer a promising and flexible alternative to supervised approaches, holding the potential to revolutionize medical scan analysis and enhance diagnostic performance. In the current landscape, it is commonly assumed that differences between a test case and the training distribution are attributed solely to pathological conditions, implying that any disparity indicates an anomaly. However, the presence of other potential sources of distributional shift, including scanner, age, sex, or race, is frequently overlooked. These shifts can significantly impact the accuracy of the anomaly detection task. Prominent instances of such failures have sparked concerns regarding the bias, credibility, and fairness of anomaly detection. This work presents a novel analysis of biases in unsupervised anomaly detection. By examining potential non-pathological distributional shifts between the training and testing distributions, we shed light on the extent of these biases and their influence on anomaly detection results. Moreover, this study examines the algorithmic limitations that arise due to biases, providing valuable insights into the challenges encountered by anomaly detection algorithms in accurately learning and capturing the entire range of variability present in the normative distribution. Through this analysis, we aim to enhance the understanding of these biases and pave the way for future improvements in the field. Here, we specifically investigate Alzheimer's disease detection from brain MR imaging as a case study, revealing significant biases related to sex, race, and scanner variations that substantially impact the results. These findings align with the broader goal of improving the reliability, fairness, and effectiveness of anomaly detection in medical imaging. △ Less

Submitted 26 August, 2023; originally announced August 2023.

ICoNIK: Generating Respiratory-Resolved Abdominal MR Reconstructions Using Neural Implicit Representations in k-Space

Authors: Veronika Spieker, Wenqi Huang, Hannah Eichhorn, Jonathan Stelter, Kilian Weiss, Veronika A. Zimmer, Rickmer F. Braren, Dimitrios C. Karampinos, Kerstin Hammernik, Julia A. Schnabel

Abstract: Motion-resolved reconstruction for abdominal magnetic resonance imaging (MRI) remains a challenge due to the trade-off between residual motion blurring caused by discretized motion states and undersampling artefacts. In this work, we propose to generate blurring-free motion-resolved abdominal reconstructions by learning a neural implicit representation directly in k-space (NIK). Using measured sam… ▽ More Motion-resolved reconstruction for abdominal magnetic resonance imaging (MRI) remains a challenge due to the trade-off between residual motion blurring caused by discretized motion states and undersampling artefacts. In this work, we propose to generate blurring-free motion-resolved abdominal reconstructions by learning a neural implicit representation directly in k-space (NIK). Using measured sampling points and a data-derived respiratory navigator signal, we train a network to generate continuous signal values. To aid the regularization of sparsely sampled regions, we introduce an additional informed correction layer (ICo), which leverages information from neighboring regions to correct NIK's prediction. Our proposed generative reconstruction methods, NIK and ICoNIK, outperform standard motion-resolved reconstruction techniques and provide a promising solution to address motion artefacts in abdominal MRI. △ Less

Submitted 17 August, 2023; originally announced August 2023.

Attribute Regularized Soft Introspective VAE: Towards Cardiac Attribute Regularization Through MRI Domains

Authors: Maxime Di Folco, Cosmin Bercea, Julia A. Schnabel

Abstract: Deep generative models have emerged as influential instruments for data generation and manipulation. Enhancing the controllability of these models by selectively modifying data attributes has been a recent focus. Variational Autoencoders (VAEs) have shown promise in capturing hidden attributes but often produce blurry reconstructions. Controlling these attributes through different imaging domains… ▽ More Deep generative models have emerged as influential instruments for data generation and manipulation. Enhancing the controllability of these models by selectively modifying data attributes has been a recent focus. Variational Autoencoders (VAEs) have shown promise in capturing hidden attributes but often produce blurry reconstructions. Controlling these attributes through different imaging domains is difficult in medical imaging. Recently, Soft Introspective VAE leverage the benefits of both VAEs and Generative Adversarial Networks (GANs), which have demonstrated impressive image synthesis capabilities, by incorporating an adversarial loss into VAE training. In this work, we propose the Attributed Soft Introspective VAE (Attri-SIVAE) by incorporating an attribute regularized loss, into the Soft-Intro VAE framework. We evaluate experimentally the proposed method on cardiac MRI data from different domains, such as various scanner vendors and acquisition centers. The proposed method achieves similar performance in terms of reconstruction and regularization compared to the state-of-the-art Attributed regularized VAE but additionally also succeeds in kee** the same regularization level when tested on a different dataset, unlike the compared method. △ Less

Submitted 14 December, 2023; v1 submitted 24 July, 2023; originally announced July 2023.

Comments: Not accepted and outdated results

A large 'Active Magnetic Shield' for a high-precision experiment

Authors: C. Abel, N. J. Ayres, G. Ban, G. Bison, K. Bodek, V. Bondar, T. Bouillaud, E. Chanel, J. Chen, W. Chen, P. -J. Chiu, C. B. Crawford, M. Daum, C. B. Doorenbos, S. Emmenegger, L. Ferraris-Bouchez, M. Fertl, A. Fratangelo, W. C. Griffith, Z. D. Grujic, P. Harris, K. Kirch, V. Kletzl, P. A. Koss, J. Krempel , et al. (26 additional authors not shown)

Abstract: We present a novel Active Magnetic Shield (AMS), designed and implemented for the n2EDM experiment at the Paul Scherrer Institute. The experiment will perform a high-sensitivity search for the electric dipole moment of the neutron. Magnetic-field stability and control is of key importance for n2EDM. A large, cubic, 5m side length, magnetically shielded room (MSR) provides a passive, quasi-static s… ▽ More We present a novel Active Magnetic Shield (AMS), designed and implemented for the n2EDM experiment at the Paul Scherrer Institute. The experiment will perform a high-sensitivity search for the electric dipole moment of the neutron. Magnetic-field stability and control is of key importance for n2EDM. A large, cubic, 5m side length, magnetically shielded room (MSR) provides a passive, quasi-static shielding-factor of about 10^5 for its inner sensitive volume. The AMS consists of a system of eight complex, feedback-controlled compensation coils constructed on an irregular grid spanned on a volume of less than 1000m^3 around the MSR. The AMS is designed to provide a stable and uniform magnetic-field environment around the MSR, while being reasonably compact. The system can compensate static and variable magnetic fields up to +-50muT (homogeneous components) and +-5muT (first-order gradients), suppressing them to a few muT in the sub-Hertz frequency range. The presented design concept and implementation of the AMS fulfills the requirements of the n2EDM experiment and can be useful for other applications, where magnetically silent environments are important and spatial constraints inhibit simpler geometrical solutions. △ Less

Submitted 14 July, 2023; originally announced July 2023.

Mask, Stitch, and Re-Sample: Enhancing Robustness and Generalizability in Anomaly Detection through Automatic Diffusion Models

Authors: Cosmin I. Bercea, Michael Neumayr, Daniel Rueckert, Julia A. Schnabel

Abstract: The introduction of diffusion models in anomaly detection has paved the way for more effective and accurate image reconstruction in pathologies. However, the current limitations in controlling noise granularity hinder diffusion models' ability to generalize across diverse anomaly types and compromise the restoration of healthy tissues. To overcome these challenges, we propose AutoDDPM, a novel app… ▽ More The introduction of diffusion models in anomaly detection has paved the way for more effective and accurate image reconstruction in pathologies. However, the current limitations in controlling noise granularity hinder diffusion models' ability to generalize across diverse anomaly types and compromise the restoration of healthy tissues. To overcome these challenges, we propose AutoDDPM, a novel approach that enhances the robustness of diffusion models. AutoDDPM utilizes diffusion models to generate initial likelihood maps of potential anomalies and seamlessly integrates them with the original image. Through joint noised distribution re-sampling, AutoDDPM achieves harmonization and in-painting effects. Our study demonstrates the efficacy of AutoDDPM in replacing anomalous regions while preserving healthy tissues, considerably surpassing diffusion models' limitations. It also contributes valuable insights and analysis on the limitations of current diffusion models, promoting robust and interpretable anomaly detection in medical imaging - an essential aspect of building autonomous clinical decision systems with higher interpretability. △ Less

Submitted 31 May, 2023; originally announced May 2023.

Deep Learning for Retrospective Motion Correction in MRI: A Comprehensive Review

Authors: Veronika Spieker, Hannah Eichhorn, Kerstin Hammernik, Daniel Rueckert, Christine Preibisch, Dimitrios C. Karampinos, Julia A. Schnabel

Abstract: Motion represents one of the major challenges in magnetic resonance imaging (MRI). Since the MR signal is acquired in frequency space, any motion of the imaged object leads to complex artefacts in the reconstructed image in addition to other MR imaging artefacts. Deep learning has been frequently proposed for motion correction at several stages of the reconstruction process. The wide range of MR a… ▽ More Motion represents one of the major challenges in magnetic resonance imaging (MRI). Since the MR signal is acquired in frequency space, any motion of the imaged object leads to complex artefacts in the reconstructed image in addition to other MR imaging artefacts. Deep learning has been frequently proposed for motion correction at several stages of the reconstruction process. The wide range of MR acquisition sequences, anatomies and pathologies of interest, and motion patterns (rigid vs. deformable and random vs. regular) makes a comprehensive solution unlikely. To facilitate the transfer of ideas between different applications, this review provides a detailed overview of proposed methods for learning-based motion correction in MRI together with their common challenges and potentials. This review identifies differences and synergies in underlying data usage, architectures, training and evaluation strategies. We critically discuss general trends and outline future directions, with the aim to enhance interaction between different application areas and research fields. △ Less

Submitted 25 September, 2023; v1 submitted 11 May, 2023; originally announced May 2023.

Physics-Aware Motion Simulation for T2*-Weighted Brain MRI

Authors: Hannah Eichhorn, Kerstin Hammernik, Veronika Spieker, Samira M. Epp, Daniel Rueckert, Christine Preibisch, Julia A. Schnabel

Abstract: In this work, we propose a realistic, physics-aware motion simulation procedure for T2*-weighted magnetic resonance imaging (MRI) to improve learning-based motion correction. As T2*-weighted MRI is highly sensitive to motion-related changes in magnetic field inhomogeneities, it is of utmost importance to include physics information in the simulation. Additionally, current motion simulations often… ▽ More In this work, we propose a realistic, physics-aware motion simulation procedure for T2*-weighted magnetic resonance imaging (MRI) to improve learning-based motion correction. As T2*-weighted MRI is highly sensitive to motion-related changes in magnetic field inhomogeneities, it is of utmost importance to include physics information in the simulation. Additionally, current motion simulations often only assume simplified motion patterns. Our simulations, on the other hand, include real recorded subject motion and realistic effects of motion-induced magnetic field inhomogeneity changes. We demonstrate the use of such simulated data by training a convolutional neural network to detect the presence of motion in affected k-space lines. The network accurately detects motion-affected k-space lines for simulated displacements down to $\geq$ 0.5mm (accuracy on test set: 92.5%). Finally, our results demonstrate exciting opportunities of simulation-based k-space line detection combined with more powerful reconstruction methods. △ Less

Submitted 30 August, 2023; v1 submitted 20 March, 2023; originally announced March 2023.

Comments: Submitted to SASHIMI: Simulation and Synthesis in Medical Imaging Workshop, associated with MICCAI 2023

Reversing the Abnormal: Pseudo-Healthy Generative Networks for Anomaly Detection

Authors: Cosmin I Bercea, Benedikt Wiestler, Daniel Rueckert, Julia A Schnabel

Abstract: Early and accurate disease detection is crucial for patient management and successful treatment outcomes. However, the automatic identification of anomalies in medical images can be challenging. Conventional methods rely on large labeled datasets which are difficult to obtain. To overcome these limitations, we introduce a novel unsupervised approach, called PHANES (Pseudo Healthy generative networ… ▽ More Early and accurate disease detection is crucial for patient management and successful treatment outcomes. However, the automatic identification of anomalies in medical images can be challenging. Conventional methods rely on large labeled datasets which are difficult to obtain. To overcome these limitations, we introduce a novel unsupervised approach, called PHANES (Pseudo Healthy generative networks for ANomaly Segmentation). Our method has the capability of reversing anomalies, i.e., preserving healthy tissue and replacing anomalous regions with pseudo-healthy (PH) reconstructions. Unlike recent diffusion models, our method does not rely on a learned noise distribution nor does it introduce random alterations to the entire image. Instead, we use latent generative networks to create masks around possible anomalies, which are refined using inpainting generative networks. We demonstrate the effectiveness of PHANES in detecting stroke lesions in T1w brain MRI datasets and show significant improvements over state-of-the-art (SOTA) methods. We believe that our proposed framework will open new avenues for interpretable, fast, and accurate anomaly segmentation with the potential to support various clinical-oriented downstream tasks. △ Less

Submitted 15 March, 2023; originally announced March 2023.

3D Masked Autoencoders with Application to Anomaly Detection in Non-Contrast Enhanced Breast MRI

Authors: Daniel M. Lang, Eli Schwartz, Cosmin I. Bercea, Raja Giryes, Julia A. Schnabel

Abstract: Self-supervised models allow (pre-)training on unlabeled data and therefore have the potential to overcome the need for large annotated cohorts. One leading self-supervised model is the masked autoencoder (MAE) which was developed on natural imaging data. The MAE is masking out a high fraction of visual transformer (ViT) input patches, to then recover the uncorrupted images as a pretraining task.… ▽ More Self-supervised models allow (pre-)training on unlabeled data and therefore have the potential to overcome the need for large annotated cohorts. One leading self-supervised model is the masked autoencoder (MAE) which was developed on natural imaging data. The MAE is masking out a high fraction of visual transformer (ViT) input patches, to then recover the uncorrupted images as a pretraining task. In this work, we extend MAE to perform anomaly detection on breast magnetic resonance imaging (MRI). This new model, coined masked autoencoder for medical imaging (MAEMI) is trained on two non-contrast enhanced MRI sequences, aiming at lesion detection without the need for intravenous injection of contrast media and temporal image acquisition. During training, only non-cancerous images are presented to the model, with the purpose of localizing anomalous tumor regions during test time. We use a public dataset for model development. Performance of the architecture is evaluated in reference to subtraction images created from dynamic contrast enhanced (DCE)-MRI. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Fully transformer-based biomarker prediction from colorectal cancer histology: a large-scale multicentric study

Authors: Sophia J. Wagner, Daniel Reisenbüchler, Nicholas P. West, Jan Moritz Niehues, Gregory Patrick Veldhuizen, Philip Quirke, Heike I. Grabsch, Piet A. van den Brandt, Gordon G. A. Hutchins, Susan D. Richman, Tanwei Yuan, Rupert Langer, Josien Christina Anna Jenniskens, Kelly Offermans, Wolfram Mueller, Richard Gray, Stephen B. Gruber, Joel K. Greenson, Gad Rennert, Joseph D. Bonner, Daniel Schmolze, Jacqueline A. James, Maurice B. Loughrey, Manuel Salto-Tellez, Hermann Brenner , et al. (6 additional authors not shown)

Abstract: Background: Deep learning (DL) can extract predictive and prognostic biomarkers from routine pathology slides in colorectal cancer. For example, a DL test for the diagnosis of microsatellite instability (MSI) in CRC has been approved in 2022. Current approaches rely on convolutional neural networks (CNNs). Transformer networks are outperforming CNNs and are replacing them in many applications, but… ▽ More Background: Deep learning (DL) can extract predictive and prognostic biomarkers from routine pathology slides in colorectal cancer. For example, a DL test for the diagnosis of microsatellite instability (MSI) in CRC has been approved in 2022. Current approaches rely on convolutional neural networks (CNNs). Transformer networks are outperforming CNNs and are replacing them in many applications, but have not been used for biomarker prediction in cancer at a large scale. In addition, most DL approaches have been trained on small patient cohorts, which limits their clinical utility. Methods: In this study, we developed a new fully transformer-based pipeline for end-to-end biomarker prediction from pathology slides. We combine a pre-trained transformer encoder and a transformer network for patch aggregation, capable of yielding single and multi-target prediction at patient level. We train our pipeline on over 9,000 patients from 10 colorectal cancer cohorts. Results: A fully transformer-based approach massively improves the performance, generalizability, data efficiency, and interpretability as compared with current state-of-the-art algorithms. After training on a large multicenter cohort, we achieve a sensitivity of 0.97 with a negative predictive value of 0.99 for MSI prediction on surgical resection specimens. We demonstrate for the first time that resection specimen-only training reaches clinical-grade performance on endoscopic biopsy tissue, solving a long-standing diagnostic problem. Interpretation: A fully transformer-based end-to-end pipeline trained on thousands of pathology slides yields clinical-grade performance for biomarker prediction on surgical resections and biopsies. Our new methods are freely available under an open source license. △ Less

Submitted 1 March, 2023; v1 submitted 23 January, 2023; originally announced January 2023.

Comments: Updated Figure 2 and Table A.5

Automated Quality Controlled Analysis of 2D Phase Contrast Cardiovascular Magnetic Resonance Imaging

Authors: Emily Chan, Ciaran O'Hanlon, Carlota Asegurado Marquez, Marwenie Petalcorin, Jorge Mariscal-Harana, Haotian Gu, Raymond J. Kim, Robert M. Judd, Phil Chowienczyk, Julia A. Schnabel, Reza Razavi, Andrew P. King, Bram Ruijsink, Esther Puyol-Antón

Abstract: Flow analysis carried out using phase contrast cardiac magnetic resonance imaging (PC-CMR) enables the quantification of important parameters that are used in the assessment of cardiovascular function. An essential part of this analysis is the identification of the correct CMR views and quality control (QC) to detect artefacts that could affect the flow quantification. We propose a novel deep lear… ▽ More Flow analysis carried out using phase contrast cardiac magnetic resonance imaging (PC-CMR) enables the quantification of important parameters that are used in the assessment of cardiovascular function. An essential part of this analysis is the identification of the correct CMR views and quality control (QC) to detect artefacts that could affect the flow quantification. We propose a novel deep learning based framework for the fully-automated analysis of flow from full CMR scans that first carries out these view selection and QC steps using two sequential convolutional neural networks, followed by automatic aorta and pulmonary artery segmentation to enable the quantification of key flow parameters. Accuracy values of 0.958 and 0.914 were obtained for view classification and QC, respectively. For segmentation, Dice scores were $>$0.969 and the Bland-Altman plots indicated excellent agreement between manual and automatic peak flow values. In addition, we tested our pipeline on an external validation data set, with results indicating good robustness of the pipeline. This work was carried out using multivendor clinical data consisting of 986 cases, indicating the potential for the use of this pipeline in a clinical setting. △ Less

Submitted 28 September, 2022; originally announced September 2022.

Comments: STACOM 2022 workshop

Evaluation of 3D GANs for Lung Tissue Modelling in Pulmonary CT

Authors: Sam Ellis, Octavio E. Martinez Manzanera, Vasileios Baltatzis, Ibrahim Nawaz, Arjun Nair, Loïc Le Folgoc, Sujal Desai, Ben Glocker, Julia A. Schnabel

Abstract: GANs are able to model accurately the distribution of complex, high-dimensional datasets, e.g. images. This makes high-quality GANs useful for unsupervised anomaly detection in medical imaging. However, differences in training datasets such as output image dimensionality and appearance of semantically meaningful features mean that GAN models from the natural image domain may not work `out-of-the-b… ▽ More GANs are able to model accurately the distribution of complex, high-dimensional datasets, e.g. images. This makes high-quality GANs useful for unsupervised anomaly detection in medical imaging. However, differences in training datasets such as output image dimensionality and appearance of semantically meaningful features mean that GAN models from the natural image domain may not work `out-of-the-box' for medical imaging, necessitating re-implementation and re-evaluation. In this work we adapt and evaluate three GAN models to the task of modelling 3D healthy image patches for pulmonary CT. To the best of our knowledge, this is the first time that such an evaluation has been performed. The DCGAN, styleGAN and the bigGAN architectures were investigated due to their ubiquity and high performance in natural image processing. We train different variants of these methods and assess their performance using the FID score. In addition, the quality of the generated images was evaluated by a human observer study, the ability of the networks to model 3D domain-specific features was investigated, and the structure of the GAN latent spaces was analysed. Results show that the 3D styleGAN produces realistic-looking images with meaningful 3D structure, but suffer from mode collapse which must be addressed during training to obtain samples diversity. Conversely, the 3D DCGAN models show a greater capacity for image variability, but at the cost of poor-quality images. The 3D bigGAN models provide an intermediate level of image quality, but most accurately model the distribution of selected semantically meaningful features. The results suggest that future development is required to realise a 3D GAN with sufficient capacity for patch-based lung CT anomaly detection and we offer recommendations for future areas of research, such as experimenting with other architectures and incorporation of position-encoding. △ Less

Submitted 17 August, 2022; originally announced August 2022.

Comments: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://www.melba-journal.org/papers/2022:024.html

Placenta Segmentation in Ultrasound Imaging: Addressing Sources of Uncertainty and Limited Field-of-View

Authors: Veronika A. Zimmer, Alberto Gomez, Emily Skelton, Robert Wright, Gavin Wheeler, Shujie Deng, Nooshin Ghavami, Karen Lloyd, Jacqueline Matthew, Bernhard Kainz, Daniel Rueckert, Joseph V. Hajnal, Julia A. Schnabel

Abstract: Automatic segmentation of the placenta in fetal ultrasound (US) is challenging due to the (i) high diversity of placenta appearance, (ii) the restricted quality in US resulting in highly variable reference annotations, and (iii) the limited field-of-view of US prohibiting whole placenta assessment at late gestation. In this work, we address these three challenges with a multi-task learning approac… ▽ More Automatic segmentation of the placenta in fetal ultrasound (US) is challenging due to the (i) high diversity of placenta appearance, (ii) the restricted quality in US resulting in highly variable reference annotations, and (iii) the limited field-of-view of US prohibiting whole placenta assessment at late gestation. In this work, we address these three challenges with a multi-task learning approach that combines the classification of placental location (e.g., anterior, posterior) and semantic placenta segmentation in a single convolutional neural network. Through the classification task the model can learn from larger and more diverse datasets while improving the accuracy of the segmentation task in particular in limited training set conditions. With this approach we investigate the variability in annotations from multiple raters and show that our automatic segmentations (Dice of 0.86 for anterior and 0.83 for posterior placentas) achieve human-level performance as compared to intra- and inter-observer variability. Lastly, our approach can deliver whole placenta segmentation using a multi-view US acquisition pipeline consisting of three stages: multi-probe image acquisition, image fusion and image segmentation. This results in high quality segmentation of larger structures such as the placenta in US with reduced image artifacts which are beyond the field-of-view of single probes. △ Less

Submitted 29 June, 2022; originally announced June 2022.

Comments: 21 pages (18 + appendix), 13 figures (9 + appendix)

The `n2EDM MSR' -- a very large magnetically shielded room with an exceptional performance for fundamental physics measurements

Authors: N. J. Ayres, G. Ban, G. Bison, K. Bodek, V. Bondar, T. Bouillaud, B. Clement, E. Chanel, P. -J. Chiu, C. B. Crawford, M. Daum, C. B. Doorenbos, S. Emmenegger, A. Fratangelo, M. Fertl, W. C. Griffith, Z. D. Grujic, P. G. Harris, K. Kirch, J. Krempel, B. Lauss, T. Lefort, O. Naviliat-Cuncic, D. Pais, F. M. Piegsa , et al. (19 additional authors not shown)

Abstract: We present the magnetically shielded room (MSR) for the n2EDM experiment at the Paul Scherrer Institute which features an interior cubic volume with each side of length 2.92m, thus providing an accessible space of 25m3. The MSR has 87 openings up to 220mm diameter to operate the experimental apparatus inside, and an intermediate space between the layers for sensitive signal processing electronics.… ▽ More We present the magnetically shielded room (MSR) for the n2EDM experiment at the Paul Scherrer Institute which features an interior cubic volume with each side of length 2.92m, thus providing an accessible space of 25m3. The MSR has 87 openings up to 220mm diameter to operate the experimental apparatus inside, and an intermediate space between the layers for sensitive signal processing electronics. The characterization measurements show a remanent magnetic field in the central 1m3 below 100pT, and a field below 600pT in the entire inner volume, up to 4\,cm to the walls. The quasi-static shielding factor at 0.01\,Hz measured with a sinusoidal 2muT peak-to-peak signal is about 100,000 in all three spatial directions and rises fast with frequency to reach 10^8 above 1Hz. △ Less

Submitted 21 June, 2022; originally announced June 2022.

Comments: 10 pages, 15 Figures, submitted to Review of Scientific Instruments

What do we learn? Debunking the Myth of Unsupervised Outlier Detection

Authors: Cosmin I. Bercea, Daniel Rueckert, Julia A. Schnabel

Abstract: Even though auto-encoders (AEs) have the desirable property of learning compact representations without labels and have been widely applied to out-of-distribution (OoD) detection, they are generally still poorly understood and are used incorrectly in detecting outliers where the normal and abnormal distributions are strongly overlap**. In general, the learned manifold is assumed to contain key i… ▽ More Even though auto-encoders (AEs) have the desirable property of learning compact representations without labels and have been widely applied to out-of-distribution (OoD) detection, they are generally still poorly understood and are used incorrectly in detecting outliers where the normal and abnormal distributions are strongly overlap**. In general, the learned manifold is assumed to contain key information that is only important for describing samples within the training distribution, and that the reconstruction of outliers leads to high residual errors. However, recent work suggests that AEs are likely to be even better at reconstructing some types of OoD samples. In this work, we challenge this assumption and investigate what auto-encoders actually learn when they are posed to solve two different tasks. First, we propose two metrics based on the Fréchet inception distance (FID) and confidence scores of a trained classifier to assess whether AEs can learn the training distribution and reliably recognize samples from other domains. Second, we investigate whether AEs are able to synthesize normal images from samples with abnormal regions, on a more challenging lung pathology detection task. We have found that state-of-the-art (SOTA) AEs are either unable to constrain the latent manifold and allow reconstruction of abnormal patterns, or they are failing to accurately restore the inputs from their latent distribution, resulting in blurred or misaligned reconstructions. We propose novel deformable auto-encoders (MorphAEus) to learn perceptually aware global image priors and locally adapt their morphometry based on estimated dense deformation fields. We demonstrate superior performance over unsupervised methods in detecting OoD and pathology. △ Less

Submitted 8 February, 2023; v1 submitted 8 June, 2022; originally announced June 2022.

A Deep Learning-based Integrated Framework for Quality-aware Undersampled Cine Cardiac MRI Reconstruction and Analysis

Authors: Inês P. Machado, Esther Puyol-Antón, Kerstin Hammernik, Gastão Cruz, Devran Ugurlu, Ihsane Olakorede, Ilkay Oksuz, Bram Ruijsink, Miguel Castelo-Branco, Alistair A. Young, Claudia Prieto, Julia A. Schnabel, Andrew P. King

Abstract: Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this paper, we present a fully-automated, quality-controlled integrated framework… ▽ More Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this paper, we present a fully-automated, quality-controlled integrated framework for reconstruction, segmentation and downstream analysis of undersampled cine CMR data. The framework enables active acquisition of radial k-space data, in which acquisition can be stopped as soon as acquired data are sufficient to produce high quality reconstructions and segmentations. This results in reduced scan times and automated analysis, enabling robust and accurate estimation of functional biomarkers. To demonstrate the feasibility of the proposed approach, we perform realistic simulations of radial k-space acquisitions on a dataset of subjects from the UK Biobank and present results on in-vivo cine CMR k-space data collected from healthy subjects. The results demonstrate that our method can produce quality-controlled images in a mean scan time reduced from 12 to 4 seconds per slice, and that image quality is sufficient to allow clinically relevant parameters to be automatically estimated to within 5% mean absolute difference. △ Less

Submitted 2 May, 2022; originally announced May 2022.

The Impact of Domain Shift on Left and Right Ventricle Segmentation in Short Axis Cardiac MR Images

Authors: Devran Ugurlu, Esther Puyol-Anton, Bram Ruijsink, Alistair Young, Ines Machado, Kerstin Hammernik, Andrew P. King, Julia A. Schnabel

Abstract: Domain shift refers to the difference in the data distribution of two datasets, normally between the training set and the test set for machine learning algorithms. Domain shift is a serious problem for generalization of machine learning models and it is well-established that a domain shift between the training and test sets may cause a drastic drop in the model's performance. In medical imaging, t… ▽ More Domain shift refers to the difference in the data distribution of two datasets, normally between the training set and the test set for machine learning algorithms. Domain shift is a serious problem for generalization of machine learning models and it is well-established that a domain shift between the training and test sets may cause a drastic drop in the model's performance. In medical imaging, there can be many sources of domain shift such as different scanners or scan protocols, different pathologies in the patient population, anatomical differences in the patient population (e.g. men vs women) etc. Therefore, in order to train models that have good generalization performance, it is important to be aware of the domain shift problem, its potential causes and to devise ways to address it. In this paper, we study the effect of domain shift on left and right ventricle blood pool segmentation in short axis cardiac MR images. Our dataset contains short axis images from 4 different MR scanners and 3 different pathology groups. The training is performed with nnUNet. The results show that scanner differences cause a greater drop in performance compared to changing the pathology group, and that the impact of domain shift is greater on right ventricle segmentation compared to left ventricle segmentation. Increasing the number of training subjects increased cross-scanner performance more than in-scanner performance at small training set sizes, but this difference in improvement decreased with larger training set sizes. Training models using data from multiple scanners improved cross-domain performance. △ Less

Submitted 22 September, 2021; originally announced September 2021.

Comments: Accepted to STACOM 2021

Quality-aware Cine Cardiac MRI Reconstruction and Analysis from Undersampled k-space Data

Authors: Ines Machado, Esther Puyol-Anton, Kerstin Hammernik, Gastao Cruz, Devran Ugurlu, Bram Ruijsink, Miguel Castelo-Branco, Alistair Young, Claudia Prieto, Julia A. Schnabel, Andrew P. King

Abstract: Cine cardiac MRI is routinely acquired for the assessment of cardiac health, but the imaging process is slow and typically requires several breath-holds to acquire sufficient k-space profiles to ensure good image quality. Several undersampling-based reconstruction techniques have been proposed during the last decades to speed up cine cardiac MRI acquisition. However, the undersampling factor is co… ▽ More Cine cardiac MRI is routinely acquired for the assessment of cardiac health, but the imaging process is slow and typically requires several breath-holds to acquire sufficient k-space profiles to ensure good image quality. Several undersampling-based reconstruction techniques have been proposed during the last decades to speed up cine cardiac MRI acquisition. However, the undersampling factor is commonly fixed to conservative values before acquisition to ensure diagnostic image quality, potentially leading to unnecessarily long scan times. In this paper, we propose an end-to-end quality-aware cine short-axis cardiac MRI framework that combines image acquisition and reconstruction with downstream tasks such as segmentation, volume curve analysis and estimation of cardiac functional parameters. The goal is to reduce scan time by acquiring only a fraction of k-space data to enable the reconstruction of images that can pass quality control checks and produce reliable estimates of cardiac functional parameters. The framework consists of a deep learning model for the reconstruction of 2D+t cardiac cine MRI images from undersampled data, an image quality-control step to detect good quality reconstructions, followed by a deep learning model for bi-ventricular segmentation, a quality-control step to detect good quality segmentations and automated calculation of cardiac functional parameters. To demonstrate the feasibility of the proposed approach, we perform simulations using a cohort of selected participants from the UK Biobank (n=270), 200 healthy subjects and 70 patients with cardiomyopathies. Our results show that we can produce quality-controlled images in a scan time reduced from 12 to 4 seconds per slice, enabling reliable estimates of cardiac functional parameters such as ejection fraction within 5% mean absolute error. △ Less

Submitted 16 September, 2021; originally announced September 2021.

The Pitfalls of Sample Selection: A Case Study on Lung Nodule Classification

Authors: Vasileios Baltatzis, Kyriaki-Margarita Bintsi, Loic Le Folgoc, Octavio E. Martinez Manzanera, Sam Ellis, Arjun Nair, Sujal Desai, Ben Glocker, Julia A. Schnabel

Abstract: Using publicly available data to determine the performance of methodological contributions is important as it facilitates reproducibility and allows scrutiny of the published results. In lung nodule classification, for example, many works report results on the publicly available LIDC dataset. In theory, this should allow a direct comparison of the performance of proposed methods and assess the imp… ▽ More Using publicly available data to determine the performance of methodological contributions is important as it facilitates reproducibility and allows scrutiny of the published results. In lung nodule classification, for example, many works report results on the publicly available LIDC dataset. In theory, this should allow a direct comparison of the performance of proposed methods and assess the impact of individual contributions. When analyzing seven recent works, however, we find that each employs a different data selection process, leading to largely varying total number of samples and ratios between benign and malignant cases. As each subset will have different characteristics with varying difficulty for classification, a direct comparison between the proposed methods is thus not always possible, nor fair. We study the particular effect of truthing when aggregating labels from multiple experts. We show that specific choices can have severe impact on the data distribution where it may be possible to achieve superior performance on one sample distribution but not on another. While we show that we can further improve on the state-of-the-art on one sample selection, we also find that on a more challenging sample selection, on the same database, the more advanced models underperform with respect to very simple baseline methods, highlighting that the selected data distribution may play an even more important role than the model architecture. This raises concerns about the validity of claimed methodological contributions. We believe the community should be aware of these pitfalls and make recommendations on how these can be avoided in future work. △ Less

Submitted 11 August, 2021; originally announced August 2021.

Comments: Accepted at PRIME, MICCAI 2021

The Effect of the Loss on Generalization: Empirical Study on Synthetic Lung Nodule Data

Authors: Vasileios Baltatzis, Loic Le Folgoc, Sam Ellis, Octavio E. Martinez Manzanera, Kyriaki-Margarita Bintsi, Arjun Nair, Sujal Desai, Ben Glocker, Julia A. Schnabel

Abstract: Convolutional Neural Networks (CNNs) are widely used for image classification in a variety of fields, including medical imaging. While most studies deploy cross-entropy as the loss function in such tasks, a growing number of approaches have turned to a family of contrastive learning-based losses. Even though performance metrics such as accuracy, sensitivity and specificity are regularly used for t… ▽ More Convolutional Neural Networks (CNNs) are widely used for image classification in a variety of fields, including medical imaging. While most studies deploy cross-entropy as the loss function in such tasks, a growing number of approaches have turned to a family of contrastive learning-based losses. Even though performance metrics such as accuracy, sensitivity and specificity are regularly used for the evaluation of CNN classifiers, the features that these classifiers actually learn are rarely identified and their effect on the classification performance on out-of-distribution test samples is insufficiently explored. In this paper, motivated by the real-world task of lung nodule classification, we investigate the features that a CNN learns when trained and tested on different distributions of a synthetic dataset with controlled modes of variation. We show that different loss functions lead to different features being learned and consequently affect the generalization ability of the classifier on unseen data. This study provides some important insights into the design of deep learning solutions for medical imaging tasks. △ Less

Submitted 10 August, 2021; originally announced August 2021.

Comments: Accepted at iMIMIC, MICCAI 2021

Medical Image Analysis on Left Atrial LGE MRI for Atrial Fibrillation Studies: A Review

Authors: Lei Li, Veronika A. Zimmer, Julia A. Schnabel, Xiahai Zhuang

Abstract: Late gadolinium enhancement magnetic resonance imaging (LGE MRI) is commonly used to visualize and quantify left atrial (LA) scars. The position and extent of scars provide important information of the pathophysiology and progression of atrial fibrillation (AF). Hence, LA scar segmentation and quantification from LGE MRI can be useful in computer-assisted diagnosis and treatment stratification of… ▽ More Late gadolinium enhancement magnetic resonance imaging (LGE MRI) is commonly used to visualize and quantify left atrial (LA) scars. The position and extent of scars provide important information of the pathophysiology and progression of atrial fibrillation (AF). Hence, LA scar segmentation and quantification from LGE MRI can be useful in computer-assisted diagnosis and treatment stratification of AF patients. Since manual delineation can be time-consuming and subject to intra- and inter-expert variability, automating this computing is highly desired, which nevertheless is still challenging and under-researched. This paper aims to provide a systematic review on computing methods for LA cavity, wall, scar and ablation gap segmentation and quantification from LGE MRI, and the related literature for AF studies. Specifically, we first summarize AF-related imaging techniques, particularly LGE MRI. Then, we review the methodologies of the four computing tasks in detail, and summarize the validation strategies applied in each task. Finally, the possible future developments are outlined, with a brief survey on the potential clinical applications of the aforementioned methods. The review shows that the research into this topic is still in early stages. Although several methods have been proposed, especially for LA segmentation, there is still large scope for further algorithmic developments due to performance issues related to the high variability of enhancement appearance and differences in image acquisition. △ Less

Submitted 10 January, 2022; v1 submitted 17 June, 2021; originally announced June 2021.

Comments: 30 pages

AtrialGeneral: Domain Generalization for Left Atrial Segmentation of Multi-Center LGE MRIs

Authors: Lei Li, Veronika A. Zimmer, Julia A. Schnabel, Xiahai Zhuang

Abstract: Left atrial (LA) segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is a crucial step needed for planning the treatment of atrial fibrillation. However, automatic LA segmentation from LGE MRI is still challenging, due to the poor image quality, high variability in LA shapes, and unclear LA boundary. Though deep learning-based methods can provide promising LA segmentati… ▽ More Left atrial (LA) segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is a crucial step needed for planning the treatment of atrial fibrillation. However, automatic LA segmentation from LGE MRI is still challenging, due to the poor image quality, high variability in LA shapes, and unclear LA boundary. Though deep learning-based methods can provide promising LA segmentation results, they often generalize poorly to unseen domains, such as data from different scanners and/or sites. In this work, we collect 210 LGE MRIs from different centers with different levels of image quality. To evaluate the domain generalization ability of models on the LA segmentation task, we employ four commonly used semantic segmentation networks for the LA segmentation from multi-center LGE MRIs. Besides, we investigate three domain generalization strategies, i.e., histogram matching, mutual information based disentangled representation, and random style transfer, where a simple histogram matching is proved to be most effective. △ Less

Submitted 4 July, 2021; v1 submitted 16 June, 2021; originally announced June 2021.

Comments: 10 pages, 4 figures, MICCAI2021

Map** of the magnetic field to correct systematic effects in a neutron electric dipole moment experiment

Authors: C. Abel, N. J. Ayres, G. Ban, G. Bison, K. Bodek, V. Bondar, E. Chanel, P. -J. Chiu, B. Clément, C. B. Crawford, M. Daum, S. Emmenegger, L. Ferraris-Bouchez, M. Fertl, P. Flaux, A. Fratangelo, W. C. Griffith, Z. D. Grujić, P. G. Harris, L. Hayen, N. Hild, M. Kasprzak, K. Kirch, P. Knowles, H. -C. Koch , et al. (28 additional authors not shown)

Abstract: Experiments dedicated to the measurement of the electric dipole moment of the neutron require outstanding control of the magnetic field uniformity. The neutron electric dipole moment (nEDM) experiment at the Paul Scherrer Institute uses a 199Hg co-magnetometer to precisely monitor magnetic field variations. This co-magnetometer, in the presence of field non-uniformity, is responsible for the large… ▽ More Experiments dedicated to the measurement of the electric dipole moment of the neutron require outstanding control of the magnetic field uniformity. The neutron electric dipole moment (nEDM) experiment at the Paul Scherrer Institute uses a 199Hg co-magnetometer to precisely monitor magnetic field variations. This co-magnetometer, in the presence of field non-uniformity, is responsible for the largest systematic effect of this measurement. To evaluate and correct that effect, offline measurements of the field non-uniformity were performed during map** campaigns in 2013, 2014 and 2017. We present the results of these campaigns, and the improvement the correction of this effect brings to the neutron electric dipole moment measurement. △ Less

Submitted 3 May, 2022; v1 submitted 16 March, 2021; originally announced March 2021.

Johnson-Nyquist Noise Effects in Neutron Electric-Dipole-Moment Experiments

Authors: N. J. Ayres, G. Ban, G. Bison, K. Bodek, V. Bondar, P. -J. Chiu, B. Clement, C. B. Crawford, M. Daum, S. Emmenegger, M. Fertl, A. Fratangelo, W. C. Griffith, Z. D. Grujić, P. G. Harris, K. Kirch, P. A. Koss, B. Lauss, T. Lefort, P. Mohanmurthy, O. Naviliat-Cuncic, D. Pais, F. M. Piegsa, G. Pignol, D. Rebreyend , et al. (15 additional authors not shown)

Abstract: Magnetic Johnson-Nyquist noise (JNN) originating from metal electrodes, used to create a static electric field in neutron electric-dipole-moment (nEDM) experiments, may limit the sensitivity of measurements. We present here the first dedicated study on JNN applied to a large-scale long-measurement-time experiment with the implementation of a co-magnetometry. In this study, we derive surface- and v… ▽ More Magnetic Johnson-Nyquist noise (JNN) originating from metal electrodes, used to create a static electric field in neutron electric-dipole-moment (nEDM) experiments, may limit the sensitivity of measurements. We present here the first dedicated study on JNN applied to a large-scale long-measurement-time experiment with the implementation of a co-magnetometry. In this study, we derive surface- and volume-averaged root-mean-square normal noise amplitudes at a certain frequency bandwidth for a cylindrical geometry. In addition, we model the source of noise as a finite number of current dipoles and demonstrate a method to simulate temporal and three-dimensional spatial dependencies of JNN. The calculations are applied to estimate the impact of JNN on measurements with the new apparatus, n2EDM, at the Paul Scherrer Institute. We demonstrate that the performances of the optically pumped $^{133}$Cs magnetometers and $^{199}$Hg co-magnetometers, which will be used in the apparatus, are not limited by JNN. Further, we find that in measurements deploying a co-magnetometer system, the impact of JNN is negligible for nEDM searches down to a sensitivity of $4\,\times\,10^{-28}\,e\cdot{\rm cm}$ in a single measurement; therefore, the use of economically and mechanically favored solid aluminum electrodes is possible. △ Less

Submitted 9 July, 2021; v1 submitted 2 February, 2021; originally announced February 2021.

Journal ref: Phys. Rev. A 103, 062801 (2021)

The design of the n2EDM experiment

Authors: N. J. Ayres, G. Ban, L. Bienstman, G. Bison, K. Bodek, V. Bondar, T. Bouillaud, E. Chanel, J. Chen, P. -J. Chiu, B. Clément, C. Crawford, M. Daum, B. Dechenaux, C. B. Doorenbos, S. Emmenegger, L. Ferraris-Bouchez, M. Fertl, A. Fratangelo, P. Flaux, D. Goupillière, W. C. Griffith, Z. D. Grujic, P. G. Harris, K. Kirch , et al. (36 additional authors not shown)

Abstract: We present the design of a next-generation experiment, n2EDM, currently under construction at the ultracold neutron source at the Paul Scherrer Institute (PSI) with the aim of carrying out a high-precision search for an electric dipole moment of the neutron. The project builds on experience gained with the previous apparatus operated at PSI until 2017, and is expected to deliver an order of magnit… ▽ More We present the design of a next-generation experiment, n2EDM, currently under construction at the ultracold neutron source at the Paul Scherrer Institute (PSI) with the aim of carrying out a high-precision search for an electric dipole moment of the neutron. The project builds on experience gained with the previous apparatus operated at PSI until 2017, and is expected to deliver an order of magnitude better sensitivity with provision for further substantial improvements. An overview is given of the experimental method and setup, the sensitivity requirements for the apparatus are derived, and its technical design is described. △ Less

Submitted 22 January, 2021; v1 submitted 21 January, 2021; originally announced January 2021.

Journal ref: Eur. Phys. J. C 81, 512 (2021)

Characterization of magnetic field noise in the ARIADNE source mass rotor

Authors: Nancy Aggarwal, Allard Schnabel, Jens Voigt, Alex Brown, Josh C Long, L. Trahms, A. Fang, Andrew Geraci, A. Kapitulnik, D. Kim, Y. Kim, I. Lee, Y. H. Lee, C. Y. Liu, C. Lohmeyer, A. Reid, Y. Semertzidis, Y. Shin, J. Shortino, E. Smith, W. M. Snow, E. Weisman

Abstract: ARIADNE is a nuclear-magnetic-resonance-based experiment that will search for novel axion-induced spin-dependent interactions between an unpolarized source mass rotor and a nearby sample of spin-polarized $^3$He gas. To detect feeble axion signals at the sub-atto-Tesla level, the experiment relies on low magnetic background and noise. We measure and characterize the magnetic field background from… ▽ More ARIADNE is a nuclear-magnetic-resonance-based experiment that will search for novel axion-induced spin-dependent interactions between an unpolarized source mass rotor and a nearby sample of spin-polarized $^3$He gas. To detect feeble axion signals at the sub-atto-Tesla level, the experiment relies on low magnetic background and noise. We measure and characterize the magnetic field background from a prototype tungsten rotor. We show that the requirement is met with our current level of tungsten purity and demagnetization process. We further show that the noise is dominantly caused by a few discrete dipoles, likely due to a few impurities trapped inside the rotor during manufacturing. This is done via a numerical optimization pipeline which fits for the locations and magnetic moments of each dipole. We find that under the current demagnetization, the magnetic moment of trapped impurities is bounded at $10^{-9} \mathrm{A}\mathrm{m}^2$. △ Less

Submitted 25 November, 2020; originally announced November 2020.

Comments: 6 pages, 5 figures

Source mass characterization in the ARIADNE axion experiment

Authors: Chloe Lohmeyer, Nancy Aggarwal, Asimina Arvanitaki, Alex Brown, Alan Fang, Andrew A Geraci, Aharon Kapitulnik, Dongok Kim, Younggeun Kim, Inbum Lee, Yong Ho Lee, Eli Levenson-Falk, Chen Yu Liu, Josh C Long, Sam Mumford, Austin Reid, Allard Schnabel, Yannis Semertzidis, Yun Shin, Justin Shortino, Eric Smith, William M Snow, Lutz Trahms, Jens Voigt, Evan Weisman

Abstract: The Axion Resonant InterAction Detection Experiment (ARIADNE) is a collaborative effort to search for the QCD axion using nuclear magnetic resonance (NMR), where the axion acts as a mediator of spin-dependent forces between an unpolarized tungsten source mass and a sample of polarized helium-3 gas. Since the experiment involves precision measurement of a small magnetization, it relies on limiting… ▽ More The Axion Resonant InterAction Detection Experiment (ARIADNE) is a collaborative effort to search for the QCD axion using nuclear magnetic resonance (NMR), where the axion acts as a mediator of spin-dependent forces between an unpolarized tungsten source mass and a sample of polarized helium-3 gas. Since the experiment involves precision measurement of a small magnetization, it relies on limiting ordinary magnetic noise with superconducting magnetic shielding. In addition to the shielding, proper characterization of the noise level from other sources is crucial. We investigate one such noise source in detail: the magnetic noise due to impurities and Johnson noise in the tungsten source mass. △ Less

Submitted 19 November, 2020; originally announced November 2020.

Comments: ARIADNE Collaboration

Journal ref: Proceedings of the 3rd International Workshop on Microwave Cavities and Detectors for Axion Research 2020

Random Style Transfer based Domain Generalization Networks Integrating Shape and Spatial Information

Authors: Lei Li, Veronika A. Zimmer, Wangbin Ding, Fu** Wu, Liqin Huang, Julia A. Schnabel, Xiahai Zhuang

Abstract: Deep learning (DL)-based models have demonstrated good performance in medical image segmentation. However, the models trained on a known dataset often fail when performed on an unseen dataset collected from different centers, vendors and disease populations. In this work, we present a random style transfer network to tackle the domain generalization problem for multi-vendor and center cardiac imag… ▽ More Deep learning (DL)-based models have demonstrated good performance in medical image segmentation. However, the models trained on a known dataset often fail when performed on an unseen dataset collected from different centers, vendors and disease populations. In this work, we present a random style transfer network to tackle the domain generalization problem for multi-vendor and center cardiac image segmentation. Style transfer is used to generate training data with a wider distribution/ heterogeneity, namely domain augmentation. As the target domain could be unknown, we randomly generate a modality vector for the target modality in the style transfer stage, to simulate the domain shift for unknown domains. The model can be trained in a semi-supervised manner by simultaneously optimizing a supervised segmentation and an unsupervised style translation objective. Besides, the framework incorporates the spatial information and shape prior of the target by introducing two regularization terms. We evaluated the proposed framework on 40 subjects from the M\&Ms challenge2020, and obtained promising performance in the segmentation for data from unknown vendors and centers. △ Less

Submitted 3 September, 2020; v1 submitted 27 August, 2020; originally announced August 2020.

Comments: 11 pages

A Three-step Model for Optimizing Coil Spacings Inside Cuboid-shaped Magnetic Shields

Authors: Tianhao Liu, Allard Schnabel, Jens Voigt, Zhiyin Sun, Liyi Li

Abstract: A three-step model for calculating the magnetic field generated by coils inside cuboid-shaped shields like magnetically shielded rooms (MSRs) is presented. The shield is modelled as two parallel plates of infinite width and one tube of infinite height. We propose an improved mirror method which considers the effect of the parallel plates of finite thickness. A reaction factor is introduced to desc… ▽ More A three-step model for calculating the magnetic field generated by coils inside cuboid-shaped shields like magnetically shielded rooms (MSRs) is presented. The shield is modelled as two parallel plates of infinite width and one tube of infinite height. We propose an improved mirror method which considers the effect of the parallel plates of finite thickness. A reaction factor is introduced to describe the influence of the vertical tube, which is obtained from finite element method (FEM) simulations. By applying the improved mirror method and then multiplying the result with the reaction factor, the magnetic flux density within the shielded volume can be determined in a fast computation. The three-step model is verified both with FEM and measurements of the field of a Helmholtz coil inside an MSR with a superconducting quantum interference device. The model allows a fast optimization of shield-coupled coil spacings compared to repetitive time-consuming FEM calculations. As an example, we optimize the distance between two parallel square coils attached to the MSR walls. Measurements of a coil prototype of 2.75~m in side length show a magnetic field change of 18~pT over the central 5~cm at the field strength of 2.7~\textmu T. This obtained relative field change of 6~ppm is a factor of 5.4 smaller than our previously used Helmholtz coil. △ Less

Submitted 25 August, 2020; originally announced August 2020.

Journal ref: AIP Advances,2020

Revisiting $^{129}$Xe electric dipole moment measurements applying a new global phase fitting approach

Authors: T. Liu, K. Rolfs, I. Fan, S. Haude, W. Kilian, L. Li, A. Schnabel, J. Voigt, L. Trahms

Abstract: By measuring the nuclear magnetic spin precession frequencies of polarized $^{129}$Xe and $^{3}$He, a new upper limit on the $^{129}$Xe atomic electric dipole moment (EDM) $ d_\mathrm{A} (^{129}\mathrm{Xe})$ was reported in Phys. Rev. Lett. 123, 143003 (2019). Here, we propose a new evaluation method based on global phase fitting (GPF) for analyzing the continuous phase development of the $^{3}$He… ▽ More By measuring the nuclear magnetic spin precession frequencies of polarized $^{129}$Xe and $^{3}$He, a new upper limit on the $^{129}$Xe atomic electric dipole moment (EDM) $ d_\mathrm{A} (^{129}\mathrm{Xe})$ was reported in Phys. Rev. Lett. 123, 143003 (2019). Here, we propose a new evaluation method based on global phase fitting (GPF) for analyzing the continuous phase development of the $^{3}$He-$^{129}$Xe comagnetometer signal. The Cramer-Rao Lower Bound on the $^{129}$Xe EDM for the GPF method is theoretically derived and shows the potential benefit of our new approach. The robustness of the GPF method is verified with Monte-Carlo studies. By optimizing the analysis parameters and adding data that could not be analyzed with the former method, we obtain a result of $d_\mathrm{A} (^{129}\mathrm{Xe}) = 1.1 \pm 3.6~\mathrm{(stat)} \pm 2.0~\mathrm{(syst)} \times 10^{-28}~ e~\mathrm{cm}$ in an unblinded analysis. For the systematic uncertainty analyses, we adopted all methods from the aforementioned PRL publication except the comagnetometer phase drift, which can be omitted using the GPF method. The updated null result can be interpreted as a new upper limit of $| d_\mathrm{A} (^{129}\mathrm{Xe}) | < 8.3 \times 10^{-28}~e~\mathrm{cm}$ at the 95\% C.L. △ Less

Submitted 15 November, 2020; v1 submitted 18 August, 2020; originally announced August 2020.

Comments: Acknowledgement changed; Format changed and several wordings are modified to avoid potential confusions

AtrialJSQnet: A New Framework for Joint Segmentation and Quantification of Left Atrium and Scars Incorporating Spatial and Shape Information

Authors: Lei Li, Veronika A. Zimmer, Julia A. Schnabel, Xiahai Zhuang

Abstract: Left atrial (LA) and atrial scar segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is an important task in clinical practice. %, to guide ablation therapy and predict treatment results for atrial fibrillation (AF) patients. The automatic segmentation is however still challenging, due to the poor image quality, the various LA shapes, the thin wall, and the surrounding… ▽ More Left atrial (LA) and atrial scar segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is an important task in clinical practice. %, to guide ablation therapy and predict treatment results for atrial fibrillation (AF) patients. The automatic segmentation is however still challenging, due to the poor image quality, the various LA shapes, the thin wall, and the surrounding enhanced regions. Previous methods normally solved the two tasks independently and ignored the intrinsic spatial relationship between LA and scars. In this work, we develop a new framework, namely AtrialJSQnet, where LA segmentation, scar projection onto the LA surface, and scar quantification are performed simultaneously in an end-to-end style. We propose a mechanism of shape attention (SA) via an explicit surface projection, to utilize the inherent correlation between LA and LA scars. In specific, the SA scheme is embedded into a multi-task architecture to perform joint LA segmentation and scar quantification. Besides, a spatial encoding (SE) loss is introduced to incorporate continuous spatial information of the target, in order to reduce noisy patches in the predicted segmentation. We evaluated the proposed framework on 60 LGE MRIs from the MICCAI2018 LA challenge. Extensive experiments on a public dataset demonstrated the effect of the proposed AtrialJSQnet, which achieved competitive performance over the state-of-the-art. The relatedness between LA segmentation and scar quantification was explicitly explored and has shown significant performance improvements for both tasks. The code and results will be released publicly once the manuscript is accepted for publication via https://zmiclab.github.io/projects.html. △ Less

Submitted 12 November, 2021; v1 submitted 11 August, 2020; originally announced August 2020.

Comments: 12 pages