Showing 1–50 of 118 results for author: Petersen, J

The role of electronic excited states in the spin-lattice relaxation of spin-1/2 molecules

Authors: Lorenzo A. Mariano, Vu Ha Anh Nguyen, Jonatan B. Petersen, Magnus Bjørnsson, Jesper Bendix, Gareth R. Eaton, Sandra S. Eaton, Alessandro Lunghi

Abstract: Magnetic resonance is a prime method for the study of chemical and biological structures and their dynamical processes. The interpretation of these experiments relies on considering the spin of electrons as the sole relevant degree of freedom. By applying ab inito open quantum systems theory to the full electronic wavefunction, here we show that contrary to this widespread framework the thermaliza… ▽ More Magnetic resonance is a prime method for the study of chemical and biological structures and their dynamical processes. The interpretation of these experiments relies on considering the spin of electrons as the sole relevant degree of freedom. By applying ab inito open quantum systems theory to the full electronic wavefunction, here we show that contrary to this widespread framework the thermalization of the unpaired electron spin of two Cr(V) coordination compounds is driven by virtual transitions to excited states with energy higher than 20,000 1/cm instead of solely involving low-energy spin interactions such as Zeeman and hyperfine ones. Moreover, we found that a window of low-energy THz phonons contributes to thermalization, rather than a small number of high-energy vibrations. This work provides a drastic reinterpretation of relaxation in spin-1/2 systems and its chemical control strategies, and ultimately exemplifies the urgency of further advancing an ab initio approach to relaxometry. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Enhancing predictive imaging biomarker discovery through treatment effect analysis

Authors: Shuhan Xiao, Lukas Klein, Jens Petersen, Philipp Vollmuth, Paul F. Jaeger, Klaus H. Maier-Hein

Abstract: Identifying predictive biomarkers, which forecast individual treatment effectiveness, is crucial for personalized medicine and informs decision-making across diverse disciplines. These biomarkers are extracted from pre-treatment data, often within randomized controlled trials, and have to be distinguished from prognostic biomarkers, which are independent of treatment assignment. Our study focuses… ▽ More Identifying predictive biomarkers, which forecast individual treatment effectiveness, is crucial for personalized medicine and informs decision-making across diverse disciplines. These biomarkers are extracted from pre-treatment data, often within randomized controlled trials, and have to be distinguished from prognostic biomarkers, which are independent of treatment assignment. Our study focuses on the discovery of predictive imaging biomarkers, aiming to leverage pre-treatment images to unveil new causal relationships. Previous approaches relied on labor-intensive handcrafted or manually derived features, which may introduce biases. In response, we present a new task of discovering predictive imaging biomarkers directly from the pre-treatment images to learn relevant image features. We propose an evaluation protocol for this task to assess a model's ability to identify predictive imaging biomarkers and differentiate them from prognostic ones. It employs statistical testing and a comprehensive analysis of image feature attribution. We explore the suitability of deep learning models originally designed for estimating the conditional average treatment effect (CATE) for this task, which previously have been primarily assessed for the precision of CATE estimation, overlooking the evaluation of imaging biomarker discovery. Our proof-of-concept analysis demonstrates promising results in discovering and validating predictive imaging biomarkers from synthetic outcomes and real-world image datasets. △ Less

Submitted 4 June, 2024; originally announced June 2024.

Comments: 19 pages, 12 figures

Probing Electrical Properties of A Silicon Nanocrystal Thin Film Using X-ray Photoelectron Spectroscopy

Authors: Amrit Laudari, Sameera Pathiranage, Salim A. Thomas, Reed J. Petersen, Kenneth J. Anderson, Todd A. Pringle, Erik K. Hobbie, Nuri Oncel

Abstract: We performed X-ray photoelectron spectroscopy (XPS) measurements on a thin film of Si nanocrystals (SiNCs) while applying DC or AC external biases to extract the resistance and the capacitance of the thin film. The measurement consists of the application of 10 V DC or square wave pulses of 10 V amplitude to the sample at various frequencies ranging from 0.01 Hz to 1 MHz while recording X-ray photo… ▽ More We performed X-ray photoelectron spectroscopy (XPS) measurements on a thin film of Si nanocrystals (SiNCs) while applying DC or AC external biases to extract the resistance and the capacitance of the thin film. The measurement consists of the application of 10 V DC or square wave pulses of 10 V amplitude to the sample at various frequencies ranging from 0.01 Hz to 1 MHz while recording X-ray photoemission data. To analyze the data, we propose three different models with varying degrees of accuracy. The calculated capacitance of SiNCs agrees with the experimental value in the literature. △ Less

Submitted 21 March, 2024; originally announced March 2024.

Journal ref: Rev. Sci. Instrum. 93, 083906 (2022)

Demonstrating Mobile Manipulation in the Wild: A Metrics-Driven Approach

Authors: Max Bajracharya, James Borders, Richard Cheng, Dan Helmick, Lukas Kaul, Dan Kruse, John Leichty, Jeremy Ma, Carolyn Matl, Frank Michel, Chavdar Papazov, Josh Petersen, Krishna Shankar, Mark Tjersland

Abstract: We present our general-purpose mobile manipulation system consisting of a custom robot platform and key algorithms spanning perception and planning. To extensively test the system in the wild and benchmark its performance, we choose a grocery shop** scenario in an actual, unmodified grocery store. We derive key performance metrics from detailed robot log data collected during six week-long field… ▽ More We present our general-purpose mobile manipulation system consisting of a custom robot platform and key algorithms spanning perception and planning. To extensively test the system in the wild and benchmark its performance, we choose a grocery shop** scenario in an actual, unmodified grocery store. We derive key performance metrics from detailed robot log data collected during six week-long field tests, spread across 18 months. These objective metrics, gained from complex yet repeatable tests, drive the direction of our research efforts and let us continuously improve our system's performance. We find that thorough end-to-end system-level testing of a complex mobile manipulation system can serve as a reality-check for state-of-the-art methods in robotics. This effectively grounds robotics research efforts in real world needs and challenges, which we deem highly useful for the advancement of the field. To this end, we share our key insights and takeaways to inspire and accelerate similar system-level research projects. △ Less

Submitted 2 January, 2024; originally announced January 2024.

Comments: Presented at RSS 2023 [Best Demo Paper Award]

Clockwork Diffusion: Efficient Generation With Model-Step Distillation

Authors: Amirhossein Habibian, Amir Ghodrati, Noor Fathima, Guillaume Sautiere, Risheek Garrepalli, Fatih Porikli, Jens Petersen

Abstract: This work aims to improve the efficiency of text-to-image diffusion models. While diffusion models use computationally expensive UNet-based denoising operations in every generation step, we identify that not all operations are equally relevant for the final output quality. In particular, we observe that UNet layers operating on high-res feature maps are relatively sensitive to small perturbations.… ▽ More This work aims to improve the efficiency of text-to-image diffusion models. While diffusion models use computationally expensive UNet-based denoising operations in every generation step, we identify that not all operations are equally relevant for the final output quality. In particular, we observe that UNet layers operating on high-res feature maps are relatively sensitive to small perturbations. In contrast, low-res feature maps influence the semantic layout of the final image and can often be perturbed with no noticeable change in the output. Based on this observation, we propose Clockwork Diffusion, a method that periodically reuses computation from preceding denoising steps to approximate low-res feature maps at one or more subsequent steps. For multiple baselines, and for both text-to-image generation and image editing, we demonstrate that Clockwork leads to comparable or improved perceptual scores with drastically reduced computational complexity. As an example, for Stable Diffusion v1.5 with 8 DPM++ steps we save 32% of FLOPs with negligible FID and CLIP change. △ Less

Submitted 20 February, 2024; v1 submitted 13 December, 2023; originally announced December 2023.

Towards a lattice-Fokker-Planck-Boltzmann method for simulating thermal noise in compressible phase-changing fluids

Authors: K. J. Petersen, J. R. Brinkerhoff

Abstract: Molecular fluctuations are known to affect the macroscopic and spatio-temporal evolution of a host of physical phenomena central to the study of biological systems, turbulence, and reactive mixtures, among others. In phase-changing fluids metastability and nucleation rates of embryos are known to be non-trivially affected by thermal noise stemming from molecules random velocity fluctuations, which… ▽ More Molecular fluctuations are known to affect the macroscopic and spatio-temporal evolution of a host of physical phenomena central to the study of biological systems, turbulence, and reactive mixtures, among others. In phase-changing fluids metastability and nucleation rates of embryos are known to be non-trivially affected by thermal noise stemming from molecules random velocity fluctuations, which ultimately determine the long-term growth, morphology, and decay of macroscopic bubbles in cavitation and boiling. We herein present the mathematical groundwork for a lattice-based solution of the combined stochastic Fokker-Planck and Boltzmann equations that by proxy solve the compressible fluctuating Navier-Stokes-Fourier equations. We present the derivation of the kinetic lattice-Fokker-Planck-Boltzmann equations facilitated by means of Gauss-Hermite quadrature, and show by multi-scale asymptotic analysis that the non-equilibrium dynamics in velocity space inherent to the Fokker-Planck equation manifest as fluctuating stresses analogous to the conventional viscous stress tensor. The key implication of this analysis is a direct correlation between the thermal white noise of the Fokker-Planck equation and the effective viscosities $μ, ζ$ that in concert with a cubic equation of state enable simulations of phase-changing fluids perturbed by stochastic thermal fluctuations. △ Less

Submitted 11 October, 2023; originally announced October 2023.

Prediction of post-radiotherapy recurrence volumes in head and neck squamous cell carcinoma using 3D U-Net segmentation

Authors: Denis Kutnár, Ivan R Vogelius, Katrin Elisabet Håkansson, Jens Petersen, Jeppe Friborg, Lena Specht, Mogens Bernsdorf, Anita Gothelf, Claus Kristensen, Abraham George Smith

Abstract: Locoregional recurrences (LRR) are still a frequent site of treatment failure for head and neck squamous cell carcinoma (HNSCC) patients. Identification of high risk subvolumes based on pretreatment imaging is key to biologically targeted radiation therapy. We investigated the extent to which a Convolutional neural network (CNN) is able to predict LRR volumes based on pre-treatment 18F-fluorodeo… ▽ More Locoregional recurrences (LRR) are still a frequent site of treatment failure for head and neck squamous cell carcinoma (HNSCC) patients. Identification of high risk subvolumes based on pretreatment imaging is key to biologically targeted radiation therapy. We investigated the extent to which a Convolutional neural network (CNN) is able to predict LRR volumes based on pre-treatment 18F-fluorodeoxyglucose positron emission tomography (FDG-PET)/computed tomography (CT) scans in HNSCC patients and thus the potential to identify biological high risk volumes using CNNs. For 37 patients who had undergone primary radiotherapy for oropharyngeal squamous cell carcinoma, five oncologists contoured the relapse volumes on recurrence CT scans. Datasets of pre-treatment FDG-PET/CT, gross tumour volume (GTV) and contoured relapse for each of the patients were randomly divided into training (n=23), validation (n=7) and test (n=7) datasets. We compared a CNN trained from scratch, a pre-trained CNN, a SUVmax threshold approach, and using the GTV directly. The SUVmax threshold method included 5 out of the 7 relapse origin points within a volume of median 4.6 cubic centimetres (cc). Both the GTV contour and best CNN segmentations included the relapse origin 6 out of 7 times with median volumes of 28 and 18 cc respectively. The CNN included the same or greater number of relapse volume POs, with significantly smaller relapse volumes. Our novel findings indicate that CNNs may predict LRR, yet further work on dataset development is required to attain clinically useful prediction accuracy. △ Less

Submitted 16 August, 2023; originally announced August 2023.

HORTENSIA, a program package for the simulation of nonadiabatic autoionization dynamics in molecules

Authors: Kevin Issler, Roland Mitrić, Jens Petersen

Abstract: We present a program package for the simulation of ultrafast vibration-induced autoionization dynamics in molecular anions in the manifold of the adiabatic anionic states and the discretized ionization continuum. This program, called HORTENSIA ($\underline{Ho}$p** $\underline{r}$eal-time $\underline{t}$rajectories for $\underline{e}$lectron-ejection by $\underline{n}$onadiabatic $\underline{s}$e… ▽ More We present a program package for the simulation of ultrafast vibration-induced autoionization dynamics in molecular anions in the manifold of the adiabatic anionic states and the discretized ionization continuum. This program, called HORTENSIA ($\underline{Ho}$p** $\underline{r}$eal-time $\underline{t}$rajectories for $\underline{e}$lectron-ejection by $\underline{n}$onadiabatic $\underline{s}$elf-$\underline{i}$onization in $\underline{a}$nions), is based on the nonadiabatic surface-hop** methodology, wherein nuclei are propagated as an ensemble along classical trajectories in the quantum-mechanical potential created by the electronic density of the molecular system. The electronic Schrödinger equation is numerically integrated along the trajectory, providing the time evolution of electronic state coefficients, from which switching probabilities into discrete electronic states are determined. In the case of a discretized continuum state, this hop** event is interpreted as the ejection on an electron. The derived diabatic and nonadiabatic couplings in the time-dependent electronic Schrödinger equation are calculated from anionic and neutral wavefunctions obtained from quantum chemical calculations with commercially available program packages interfaced with our program. Based on this methodology, we demonstrate the simulation of autoionization electron kinetic energy spectra that are both time- and angle-resolved. In addition, the program yields data that can be interpreted easily with respect to geometric characteristics such as bonding distances and angles, which facilitates the detection of molecular configurations important for the autoionization process. Moreover, useful extensions are included, namely generation tools for initial conditions and input files as well as for the evaluation of output files both through console commands and a graphical user interface. △ Less

Submitted 13 July, 2023; v1 submitted 10 July, 2023; originally announced July 2023.

Coronal Heating as Determined by the Solar Flare Frequency Distribution Obtained by Aggregating Case Studies

Authors: James Paul Mason, Alexandra Werth, Colin G. West, Allison A. Youngblood, Donald L. Woodraska, Courtney Peck, Kevin Lacjak, Florian G. Frick, Moutamen Gabir, Reema A. Alsinan, Thomas Jacobsen, Mohammad Alrubaie, Kayla M. Chizmar, Benjamin P. Lau, Lizbeth Montoya Dominguez, David Price, Dylan R. Butler, Connor J. Biron, Nikita Feoktistov, Kai Dewey, N. E. Loomis, Michal Bodzianowski, Connor Kuybus, Henry Dietrick, Aubrey M. Wolfe , et al. (977 additional authors not shown)

Abstract: Flare frequency distributions represent a key approach to addressing one of the largest problems in solar and stellar physics: determining the mechanism that counter-intuitively heats coronae to temperatures that are orders of magnitude hotter than the corresponding photospheres. It is widely accepted that the magnetic field is responsible for the heating, but there are two competing mechanisms th… ▽ More Flare frequency distributions represent a key approach to addressing one of the largest problems in solar and stellar physics: determining the mechanism that counter-intuitively heats coronae to temperatures that are orders of magnitude hotter than the corresponding photospheres. It is widely accepted that the magnetic field is responsible for the heating, but there are two competing mechanisms that could explain it: nanoflares or Alfvén waves. To date, neither can be directly observed. Nanoflares are, by definition, extremely small, but their aggregate energy release could represent a substantial heating mechanism, presuming they are sufficiently abundant. One way to test this presumption is via the flare frequency distribution, which describes how often flares of various energies occur. If the slope of the power law fitting the flare frequency distribution is above a critical threshold, $α=2$ as established in prior literature, then there should be a sufficient abundance of nanoflares to explain coronal heating. We performed $>$600 case studies of solar flares, made possible by an unprecedented number of data analysts via three semesters of an undergraduate physics laboratory course. This allowed us to include two crucial, but nontrivial, analysis methods: pre-flare baseline subtraction and computation of the flare energy, which requires determining flare start and stop times. We aggregated the results of these analyses into a statistical study to determine that $α= 1.63 \pm 0.03$. This is below the critical threshold, suggesting that Alfvén waves are an important driver of coronal heating. △ Less

Submitted 9 May, 2023; originally announced May 2023.

Comments: 1,002 authors, 14 pages, 4 figures, 3 tables, published by The Astrophysical Journal on 2023-05-09, volume 948, page 71

Localise to segment: crop to improve organ at risk segmentation accuracy

Authors: Abraham George Smith, Denis Kutnár, Ivan Richter Vogelius, Sune Darkner, Jens Petersen

Abstract: Increased organ at risk segmentation accuracy is required to reduce cost and complications for patients receiving radiotherapy treatment. Some deep learning methods for the segmentation of organs at risk use a two stage process where a localisation network first crops an image to the relevant region and then a locally specialised network segments the cropped organ of interest. We investigate the a… ▽ More Increased organ at risk segmentation accuracy is required to reduce cost and complications for patients receiving radiotherapy treatment. Some deep learning methods for the segmentation of organs at risk use a two stage process where a localisation network first crops an image to the relevant region and then a locally specialised network segments the cropped organ of interest. We investigate the accuracy improvements brought about by such a localisation stage by comparing to a single-stage baseline network trained on full resolution images. We find that localisation approaches can improve both training time and stability and a two stage process involving both a localisation and organ segmentation network provides a significant increase in segmentation accuracy for the spleen, pancreas and heart from the Medical Segmentation Decathlon dataset. We also observe increased benefits of localisation for smaller organs. Source code that recreates the main results is available at \href{https://github.com/Abe404/localise_to_segment}{this https URL}. △ Less

Submitted 10 April, 2023; originally announced April 2023.

Transformer Utilization in Medical Image Segmentation Networks

Authors: Saikat Roy, Gregor Koehler, Michael Baumgartner, Constantin Ulrich, Jens Petersen, Fabian Isensee, Klaus Maier-Hein

Abstract: Owing to success in the data-rich domain of natural images, Transformers have recently become popular in medical image segmentation. However, the pairing of Transformers with convolutional blocks in varying architectural permutations leaves their relative effectiveness to open interpretation. We introduce Transformer Ablations that replace the Transformer blocks with plain linear operators to quan… ▽ More Owing to success in the data-rich domain of natural images, Transformers have recently become popular in medical image segmentation. However, the pairing of Transformers with convolutional blocks in varying architectural permutations leaves their relative effectiveness to open interpretation. We introduce Transformer Ablations that replace the Transformer blocks with plain linear operators to quantify this effectiveness. With experiments on 8 models on 2 medical image segmentation tasks, we explore -- 1) the replaceable nature of Transformer-learnt representations, 2) Transformer capacity alone cannot prevent representational replaceability and works in tandem with effective design, 3) The mere existence of explicit feature hierarchies in transformer blocks is more beneficial than accompanying self-attention modules, 4) Major spatial downsampling before Transformer modules should be used with caution. △ Less

Submitted 9 April, 2023; originally announced April 2023.

Comments: Accepted in NeurIPS 2022 workshop, Medical Imaging Meets NeurIPS (MedNeurIPS)

MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentation

Authors: Saikat Roy, Gregor Koehler, Constantin Ulrich, Michael Baumgartner, Jens Petersen, Fabian Isensee, Paul F. Jaeger, Klaus Maier-Hein

Abstract: There has been exploding interest in embracing Transformer-based architectures for medical image segmentation. However, the lack of large-scale annotated medical datasets make achieving performances equivalent to those in natural images challenging. Convolutional networks, in contrast, have higher inductive biases and consequently, are easily trainable to high performance. Recently, the ConvNeXt a… ▽ More There has been exploding interest in embracing Transformer-based architectures for medical image segmentation. However, the lack of large-scale annotated medical datasets make achieving performances equivalent to those in natural images challenging. Convolutional networks, in contrast, have higher inductive biases and consequently, are easily trainable to high performance. Recently, the ConvNeXt architecture attempted to modernize the standard ConvNet by mirroring Transformer blocks. In this work, we improve upon this to design a modernized and scalable convolutional architecture customized to challenges of data-scarce medical settings. We introduce MedNeXt, a Transformer-inspired large kernel segmentation network which introduces - 1) A fully ConvNeXt 3D Encoder-Decoder Network for medical image segmentation, 2) Residual ConvNeXt up and downsampling blocks to preserve semantic richness across scales, 3) A novel technique to iteratively increase kernel sizes by upsampling small kernel networks, to prevent performance saturation on limited medical data, 4) Compound scaling at multiple levels (depth, width, kernel size) of MedNeXt. This leads to state-of-the-art performance on 4 tasks on CT and MRI modalities and varying dataset sizes, representing a modernized deep architecture for medical image segmentation. Our code is made publicly available at: https://github.com/MIC-DKFZ/MedNeXt. △ Less

Submitted 2 June, 2024; v1 submitted 17 March, 2023; originally announced March 2023.

Comments: Accepted at MICCAI 2023

Understanding metric-related pitfalls in image analysis validation

Authors: Annika Reinke, Minu D. Tizabi, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, A. Emre Kavur, Tim Rädsch, Carole H. Sudre, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arriel Benis, Matthew Blaschko, Florian Buettner, M. Jorge Cardoso, Veronika Cheplygina, Jianxu Chen, Evangelia Christodoulou, Beth A. Cimini, Gary S. Collins, Keyvan Farahani, Luciana Ferrer, Adrian Galdran, Bram van Ginneken , et al. (53 additional authors not shown)

Abstract: Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately in relation to the underlying research problem. This could be attributed to a lack of accessibilit… ▽ More Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately in relation to the underlying research problem. This could be attributed to a lack of accessibility of metric-related knowledge: While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Focusing on biomedical image analysis but with the potential of transfer to other fields, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. To facilitate comprehension, illustrations and specific examples accompany each pitfall. As a structured body of information accessible to researchers of all levels of expertise, this work enhances global comprehension of a key topic in image analysis validation. △ Less

Submitted 23 February, 2024; v1 submitted 3 February, 2023; originally announced February 2023.

Comments: Shared first authors: Annika Reinke and Minu D. Tizabi; shared senior authors: Lena Maier-Hein and Paul F. Jäger. Published in Nature Methods. arXiv admin note: text overlap with arXiv:2206.01653

Journal ref: Nature methods, 1-13 (2024)

A Residual Diffusion Model for High Perceptual Quality Codec Augmentation

Authors: Noor Fathima Ghouse, Jens Petersen, Auke Wiggers, Tianlin Xu, Guillaume Sautière

Abstract: Diffusion probabilistic models have recently achieved remarkable success in generating high quality image and video data. In this work, we build on this class of generative models and introduce a method for lossy compression of high resolution images. The resulting codec, which we call DIffuson-based Residual Augmentation Codec (DIRAC), is the first neural codec to allow smooth traversal of the ra… ▽ More Diffusion probabilistic models have recently achieved remarkable success in generating high quality image and video data. In this work, we build on this class of generative models and introduce a method for lossy compression of high resolution images. The resulting codec, which we call DIffuson-based Residual Augmentation Codec (DIRAC), is the first neural codec to allow smooth traversal of the rate-distortion-perception tradeoff at test time, while obtaining competitive performance with GAN-based methods in perceptual quality. Furthermore, while sampling from diffusion probabilistic models is notoriously expensive, we show that in the compression setting the number of steps can be drastically reduced. △ Less

Submitted 29 March, 2023; v1 submitted 13 January, 2023; originally announced January 2023.

Comments: v1: 26 pages, 13 figures v2: corrected typo in first author name in arxiv metadata v3: major paper update to add base codecs and lpips loss

Explicit Temporal Embedding in Deep Generative Latent Models for Longitudinal Medical Image Synthesis

Authors: Julian Schön, Raghavendra Selvan, Lotte Nygård, Ivan Richter Vogelius, Jens Petersen

Abstract: Medical imaging plays a vital role in modern diagnostics and treatment. The temporal nature of disease or treatment progression often results in longitudinal data. Due to the cost and potential harm, acquiring large medical datasets necessary for deep learning can be difficult. Medical image synthesis could help mitigate this problem. However, until now, the availability of GANs capable of synthes… ▽ More Medical imaging plays a vital role in modern diagnostics and treatment. The temporal nature of disease or treatment progression often results in longitudinal data. Due to the cost and potential harm, acquiring large medical datasets necessary for deep learning can be difficult. Medical image synthesis could help mitigate this problem. However, until now, the availability of GANs capable of synthesizing longitudinal volumetric data has been limited. To address this, we use the recent advances in latent space-based image editing to propose a novel joint learning scheme to explicitly embed temporal dependencies in the latent space of GANs. This, in contrast to previous methods, allows us to synthesize continuous, smooth, and high-quality longitudinal volumetric data with limited supervision. We show the effectiveness of our approach on three datasets containing different longitudinal dependencies. Namely, modeling a simple image transformation, breathing motion, and tumor regression, all while showing minimal disentanglement. The implementation is made available online at https://github.com/julschoen/Temp-GAN. △ Less

Submitted 13 January, 2023; originally announced January 2023.

CRADL: Contrastive Representations for Unsupervised Anomaly Detection and Localization

Authors: Carsten T. Lüth, David Zimmerer, Gregor Koehler, Paul F. Jaeger, Fabian Isensee, Jens Petersen, Klaus H. Maier-Hein

Abstract: Unsupervised anomaly detection in medical imaging aims to detect and localize arbitrary anomalies without requiring annotated anomalous data during training. Often, this is achieved by learning a data distribution of normal samples and detecting anomalies as regions in the image which deviate from this distribution. Most current state-of-the-art methods use latent variable generative models operat… ▽ More Unsupervised anomaly detection in medical imaging aims to detect and localize arbitrary anomalies without requiring annotated anomalous data during training. Often, this is achieved by learning a data distribution of normal samples and detecting anomalies as regions in the image which deviate from this distribution. Most current state-of-the-art methods use latent variable generative models operating directly on the images. However, generative models have been shown to mostly capture low-level features, s.a. pixel-intensities, instead of rich semantic features, which also applies to their representations. We circumvent this problem by proposing CRADL whose core idea is to model the distribution of normal samples directly in the low-dimensional representation space of an encoder trained with a contrastive pretext-task. By utilizing the representations of contrastive learning, we aim to fix the over-fixation on low-level features and learn more semantic-rich representations. Our experiments on anomaly detection and localization tasks using three distinct evaluation datasets show that 1) contrastive representations are superior to representations of generative latent variable models and 2) the CRADL framework shows competitive or superior performance to state-of-the-art. △ Less

Submitted 5 January, 2023; originally announced January 2023.

Quantum-classical Dynamics of Vibration-Induced Autoionization in Molecules

Authors: Kevin Issler, Roland Mitric, Jens Petersen

Abstract: We present a novel method for the simulation of the vibration-induced autoionization dynamics in molecular anions in the framework of the quantum-classical surface hop** approach. Classical trajectories starting from quantum initial conditions are propagated on a quantum-mechanical potential energy surface while allowing for autoionization through transitions into discretized continuum states. T… ▽ More We present a novel method for the simulation of the vibration-induced autoionization dynamics in molecular anions in the framework of the quantum-classical surface hop** approach. Classical trajectories starting from quantum initial conditions are propagated on a quantum-mechanical potential energy surface while allowing for autoionization through transitions into discretized continuum states. These transitions are induced by the couplings between the electronic states of the bound anionic system and the electron-detached system composed of the neutral molecule and the free electron. A discretization scheme for the detached system is introduced and a set of formulae is derived which enables the approximate calculation of couplings between the bound and free-electron states. We demonstrate our method on the example of the anion of vinylidene, a high-energy isomer of acetylene, for which detailed experimental data is available. Our results provide information on the time scale of the autoionization process and give an insight into the energetic and angular distribution of the ejected electrons as well as into the associated changes of the molecular geometry. We identify the formation of structures with reduced C-C bond lengths and T-like conformations through bending of the CH$_2$ group with respect to the C-C axis and point out the role of autoionization as a driving process for the isomerization to acetylene. △ Less

Submitted 18 November, 2022; originally announced November 2022.

CEERS Key Paper III: The Diversity of Galaxy Structure and Morphology at z=3-9 with JWST

Authors: Jeyhan S. Kartaltepe, Caitlin Rose, Brittany N. Vanderhoof, Elizabeth J. McGrath, Luca Costantin, Isabella G. Cox, L. Y. Aaron Yung, Dale D. Kocevski, Stijn Wuyts, Henry C. Ferguson Brett H. Andrews, Micaela B. Bagley, Steven L. Finkelstein, Ricardo O. Amorin, Pablo Arrabal Haro, Bren E. Backhaus, Peter Behroozi, Laura Bisigello, Antonello Calabro, Caitlin M. Casey, Rosemary T. Coogan, Darren Croton, Alexander de la Vega, Mark Dickinson, M. C. Cooper, Adriano Fontana , et al. (36 additional authors not shown)

Abstract: We present a comprehensive analysis of the evolution of the morphological and structural properties of a large sample of galaxies at z=3-9 using early JWST CEERS NIRCam observations. Our sample consists of 850 galaxies at z>3 detected in both CANDELS HST imaging and JWST CEERS NIRCam images to enable a comparison of HST and JWST morphologies. Our team conducted a set of visual classifications, wit… ▽ More We present a comprehensive analysis of the evolution of the morphological and structural properties of a large sample of galaxies at z=3-9 using early JWST CEERS NIRCam observations. Our sample consists of 850 galaxies at z>3 detected in both CANDELS HST imaging and JWST CEERS NIRCam images to enable a comparison of HST and JWST morphologies. Our team conducted a set of visual classifications, with each galaxy in the sample classified by three different individuals. We also measure quantitative morphologies using the publicly available codes across all seven NIRCam filters. Using these measurements, we present the fraction of galaxies of each morphological type as a function of redshift. Overall, we find that galaxies at z>3 have a wide diversity of morphologies. Galaxies with disks make up a total of 60\% of galaxies at z=3 and this fraction drops to ~30% at z=6-9, while galaxies with spheroids make up ~30-40% across the whole redshift range and pure spheroids with no evidence for disks or irregular features make up ~20%. The fraction of galaxies with irregular features is roughly constant at all redshifts (~40-50%), while those that are purely irregular increases from ~12% to ~20% at z>4.5. We note that these are apparent fractions as many selection effects impact the visibility of morphological features at high redshift. The distributions of Sérsic index, size, and axis ratios show significant differences between the morphological groups. Spheroid Only galaxies have a higher Sérsic index, smaller size, and higher axis ratio than Disk/Irregular galaxies. Across all redshifts, smaller spheroid and disk galaxies tend to be rounder. Overall, these trends suggest that galaxies with established disks and spheroids exist across the full redshift range of this study and further work with large samples at higher redshift is needed to quantify when these features first formed. △ Less

Submitted 13 January, 2023; v1 submitted 26 October, 2022; originally announced October 2022.

Comments: Accepted for publication to ApJL, 24 pages, 14 figures

Interpreting Latent Spaces of Generative Models for Medical Images using Unsupervised Methods

Authors: Julian Schön, Raghavendra Selvan, Jens Petersen

Abstract: Generative models such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) play an increasingly important role in medical image analysis. The latent spaces of these models often show semantically meaningful directions corresponding to human-interpretable image transformations. However, until now, their exploration for medical images has been limited due to the requirement… ▽ More Generative models such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) play an increasingly important role in medical image analysis. The latent spaces of these models often show semantically meaningful directions corresponding to human-interpretable image transformations. However, until now, their exploration for medical images has been limited due to the requirement of supervised data. Several methods for unsupervised discovery of interpretable directions in GAN latent spaces have shown interesting results on natural images. This work explores the potential of applying these techniques on medical images by training a GAN and a VAE on thoracic CT scans and using an unsupervised method to discover interpretable directions in the resulting latent space. We find several directions corresponding to non-trivial image transformations, such as rotation or breast size. Furthermore, the directions show that the generative models capture 3D structure despite being presented only with 2D data. The results show that unsupervised methods to discover interpretable directions in GANs generalize to VAEs and can be applied to medical images. This opens a wide array of future work using these methods in medical image analysis. △ Less

Submitted 20 July, 2022; originally announced July 2022.

Comments: Accepted for presentation at DGM4MICCAI 2022

Metrics reloaded: Recommendations for image analysis validation

Authors: Lena Maier-Hein, Annika Reinke, Patrick Godau, Minu D. Tizabi, Florian Buettner, Evangelia Christodoulou, Ben Glocker, Fabian Isensee, Jens Kleesiek, Michal Kozubek, Mauricio Reyes, Michael A. Riegler, Manuel Wiesenfarth, A. Emre Kavur, Carole H. Sudre, Michael Baumgartner, Matthias Eisenmann, Doreen Heckmann-Nötzel, Tim Rädsch, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Arriel Benis, Matthew Blaschko , et al. (49 additional authors not shown)

Abstract: Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, our large international ex… ▽ More Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, our large international expert consortium created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. The framework was developed in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint - a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), data set and algorithm output. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as a classification task at image, object or pixel level, namely image-level classification, object detection, semantic segmentation, and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool, which also provides a point of access to explore weaknesses, strengths and specific recommendations for the most common validation metrics. The broad applicability of our framework across domains is demonstrated by an instantiation for various biological and medical image analysis use cases. △ Less

Submitted 23 February, 2024; v1 submitted 3 June, 2022; originally announced June 2022.

Comments: Shared first authors: Lena Maier-Hein, Annika Reinke. arXiv admin note: substantial text overlap with arXiv:2104.05642 Published in Nature Methods

Journal ref: Nature methods, 1-18 (2024)

The history of the observatory library at Østervold in Copenhagen, Denmark

Authors: S. B. F. Dorch, J. O. Petersen

Abstract: About fifty years after the work that astronomer Tycho Brahe carried out while living on the island of Hven had made him world famous, King Christian IV of Denmark built the Trinity Buildings in Copenhagen. The Tower observatory was opened in 1642, and it housed the astronomers from the University of Copenhagen until 1861 when a new, modern observatory was built at Østervold in the eastern part of… ▽ More About fifty years after the work that astronomer Tycho Brahe carried out while living on the island of Hven had made him world famous, King Christian IV of Denmark built the Trinity Buildings in Copenhagen. The Tower observatory was opened in 1642, and it housed the astronomers from the University of Copenhagen until 1861 when a new, modern observatory was built at Østervold in the eastern part of the city. In 1996, all the University astronomers from the observatories at Østervold and the small town of Brorfelde were relocated to the Rockefeller Buildings at Østerbro, and the two observatories were closed. In this paper we focus on the library at the observatory in Østervold, and its subsequent fate following the close-down of that observatory. △ Less

Submitted 4 January, 2022; originally announced January 2022.

Comments: 13 pages, 17 figures

Journal ref: Journal of Astronomical History and Heritage (2021), 24(4), 1090

Patch-based Medical Image Segmentation using Matrix Product State Tensor Networks

Authors: Raghavendra Selvan, Erik B Dam, Søren Alexander Flensborg, Jens Petersen

Abstract: Tensor networks are efficient factorisations of high-dimensional tensors into a network of lower-order tensors. They have been most commonly used to model entanglement in quantum many-body systems and more recently are witnessing increased applications in supervised machine learning. In this work, we formulate image segmentation in a supervised setting with tensor networks. The key idea is to firs… ▽ More Tensor networks are efficient factorisations of high-dimensional tensors into a network of lower-order tensors. They have been most commonly used to model entanglement in quantum many-body systems and more recently are witnessing increased applications in supervised machine learning. In this work, we formulate image segmentation in a supervised setting with tensor networks. The key idea is to first lift the pixels in image patches to exponentially high-dimensional feature spaces and using a linear decision hyper-plane to classify the input pixels into foreground and background classes. The high-dimensional linear model itself is approximated using the matrix product state (MPS) tensor network. The MPS is weight-shared between the non-overlap** image patches resulting in our strided tensor network model. The performance of the proposed model is evaluated on three 2D- and one 3D- biomedical imaging datasets. The performance of the proposed tensor network segmentation model is compared with relevant baseline methods. In the 2D experiments, the tensor network model yields competitive performance compared to the baseline methods while being more resource efficient. △ Less

Submitted 23 February, 2022; v1 submitted 15 September, 2021; originally announced September 2021.

Comments: Journal extension of our preliminary conference work "Segmenting two-dimensional structures with strided tensor networks", Selvan et al. 2021, available at arXiv:2102.06900. 24 pages, 12 figures. Accepted to be published at the Journal of Machine Learning for Biomedical Imaging, to be updated at https://www.melba-journal.org/papers/2022:005.html

Journal ref: Journal of Machine Learning for Biomedical Imaging. 2022:005. pp 1-24

Continuous-Time Deep Glioma Growth Models

Authors: Jens Petersen, Fabian Isensee, Gregor Köhler, Paul F. Jäger, David Zimmerer, Ulf Neuberger, Wolfgang Wick, Jürgen Debus, Sabine Heiland, Martin Bendszus, Philipp Vollmuth, Klaus H. Maier-Hein

Abstract: The ability to estimate how a tumor might evolve in the future could have tremendous clinical benefits, from improved treatment decisions to better dose distribution in radiation therapy. Recent work has approached the glioma growth modeling problem via deep learning and variational inference, thus learning growth dynamics entirely from a real patient data distribution. So far, this approach was c… ▽ More The ability to estimate how a tumor might evolve in the future could have tremendous clinical benefits, from improved treatment decisions to better dose distribution in radiation therapy. Recent work has approached the glioma growth modeling problem via deep learning and variational inference, thus learning growth dynamics entirely from a real patient data distribution. So far, this approach was constrained to predefined image acquisition intervals and sequences of fixed length, which limits its applicability in more realistic scenarios. We overcome these limitations by extending Neural Processes, a class of conditional generative models for stochastic time series, with a hierarchical multi-scale representation encoding including a spatio-temporal attention mechanism. The result is a learned growth model that can be conditioned on an arbitrary number of observations, and that can produce a distribution of temporally consistent growth trajectories on a continuous time axis. On a dataset of 379 patients, the approach successfully captures both global and finer-grained variations in the images, exhibiting superior performance compared to other learned growth models. △ Less

Submitted 2 July, 2021; v1 submitted 23 June, 2021; originally announced June 2021.

Comments: MICCAI 2021

RootPainter3D: Interactive-machine-learning enables rapid and accurate contouring for radiotherapy

Authors: Abraham George Smith, Jens Petersen, Cynthia Terrones-Campos, Anne Kiil Berthelsen, Nora Jarrett Forbes, Sune Darkner, Lena Specht, Ivan Richter Vogelius

Abstract: Organ-at-risk contouring is still a bottleneck in radiotherapy, with many deep learning methods falling short of promised results when evaluated on clinical data. We investigate the accuracy and time-savings resulting from the use of an interactive-machine-learning method for an organ-at-risk contouring task. We compare the method to the Eclipse contouring software and find strong agreement with m… ▽ More Organ-at-risk contouring is still a bottleneck in radiotherapy, with many deep learning methods falling short of promised results when evaluated on clinical data. We investigate the accuracy and time-savings resulting from the use of an interactive-machine-learning method for an organ-at-risk contouring task. We compare the method to the Eclipse contouring software and find strong agreement with manual delineations, with a dice score of 0.95. The annotations created using corrective-annotation also take less time to create as more images are annotated, resulting in substantial time savings compared to manual methods, with hearts that take 2 minutes and 2 seconds to delineate on average, after 923 images have been delineated, compared to 7 minutes and 1 seconds when delineating manually. Our experiment demonstrates that interactive-machine-learning with corrective-annotation provides a fast and accessible way for non computer-scientists to train deep-learning models to segment their own structures of interest as part of routine clinical workflows. Source code is available at \href{https://github.com/Abe404/RootPainter3D}{this HTTPS URL}. △ Less

Submitted 22 June, 2021; originally announced June 2021.

GP-ConvCNP: Better Generalization for Convolutional Conditional Neural Processes on Time Series Data

Authors: Jens Petersen, Gregor Köhler, David Zimmerer, Fabian Isensee, Paul F. Jäger, Klaus H. Maier-Hein

Abstract: Neural Processes (NPs) are a family of conditional generative models that are able to model a distribution over functions, in a way that allows them to perform predictions at test time conditioned on a number of context points. A recent addition to this family, Convolutional Conditional Neural Processes (ConvCNP), have shown remarkable improvement in performance over prior art, but we find that th… ▽ More Neural Processes (NPs) are a family of conditional generative models that are able to model a distribution over functions, in a way that allows them to perform predictions at test time conditioned on a number of context points. A recent addition to this family, Convolutional Conditional Neural Processes (ConvCNP), have shown remarkable improvement in performance over prior art, but we find that they sometimes struggle to generalize when applied to time series data. In particular, they are not robust to distribution shifts and fail to extrapolate observed patterns into the future. By incorporating a Gaussian Process into the model, we are able to remedy this and at the same time improve performance within distribution. As an added benefit, the Gaussian Process reintroduces the possibility to sample from the model, a key feature of other members in the NP family. △ Less

Submitted 11 June, 2021; v1 submitted 9 June, 2021; originally announced June 2021.

Comments: UAI 2021

Common Limitations of Image Processing Metrics: A Picture Story

Authors: Annika Reinke, Minu D. Tizabi, Carole H. Sudre, Matthias Eisenmann, Tim Rädsch, Michael Baumgartner, Laura Acion, Michela Antonelli, Tal Arbel, Spyridon Bakas, Peter Bankhead, Arriel Benis, Matthew Blaschko, Florian Buettner, M. Jorge Cardoso, Jianxu Chen, Veronika Cheplygina, Evangelia Christodoulou, Beth Cimini, Gary S. Collins, Sandy Engelhardt, Keyvan Farahani, Luciana Ferrer, Adrian Galdran, Bram van Ginneken , et al. (68 additional authors not shown)

Abstract: While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are particularly key for meaningful, objective, and transparent performance assessment and validation of the used automatic algorithms, but relatively little attention has been given to the practical pitfalls when using spe… ▽ More While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are particularly key for meaningful, objective, and transparent performance assessment and validation of the used automatic algorithms, but relatively little attention has been given to the practical pitfalls when using specific metrics for a given image analysis task. These are typically related to (1) the disregard of inherent metric properties, such as the behaviour in the presence of class imbalance or small target structures, (2) the disregard of inherent data set properties, such as the non-independence of the test cases, and (3) the disregard of the actual biomedical domain interest that the metrics should reflect. This living dynamically document has the purpose to illustrate important limitations of performance metrics commonly applied in the field of image analysis. In this context, it focuses on biomedical image analysis problems that can be phrased as image-level classification, semantic segmentation, instance segmentation, or object detection task. The current version is based on a Delphi process on metrics conducted by an international consortium of image analysis experts from more than 60 institutions worldwide. △ Less

Submitted 6 December, 2023; v1 submitted 12 April, 2021; originally announced April 2021.

Comments: Shared first authors: Annika Reinke and Minu D. Tizabi. This is a dynamic paper on limitations of commonly used metrics. It discusses metrics for image-level classification, semantic and instance segmentation, and object detection. For missing use cases, comments or questions, please contact [email protected]. Substantial contributions to this document will be acknowledged with a co-authorship

Segmenting two-dimensional structures with strided tensor networks

Authors: Raghavendra Selvan, Erik B Dam, Jens Petersen

Abstract: Tensor networks provide an efficient approximation of operations involving high dimensional tensors and have been extensively used in modelling quantum many-body systems. More recently, supervised learning has been attempted with tensor networks, primarily focused on tasks such as image classification. In this work, we propose a novel formulation of tensor networks for supervised image segmentatio… ▽ More Tensor networks provide an efficient approximation of operations involving high dimensional tensors and have been extensively used in modelling quantum many-body systems. More recently, supervised learning has been attempted with tensor networks, primarily focused on tasks such as image classification. In this work, we propose a novel formulation of tensor networks for supervised image segmentation which allows them to operate on high resolution medical images. We use the matrix product state (MPS) tensor network on non-overlap** patches of a given input image to predict the segmentation mask by learning a pixel-wise linear classification rule in a high dimensional space. The proposed model is end-to-end trainable using backpropagation. It is implemented as a Strided Tensor Network to reduce the parameter complexity. The performance of the proposed method is evaluated on two public medical imaging datasets and compared to relevant baselines. The evaluation shows that the strided tensor network yields competitive performance compared to CNN-based models while using fewer resources. Additionally, based on the experiments we discuss the feasibility of using fully linear models for segmentation tasks. △ Less

Submitted 30 June, 2021; v1 submitted 13 February, 2021; originally announced February 2021.

Comments: Accepted to be presented at the 27th international conference on Information Processing in Medical Imaging (IPMI-2021), Bornholm, Denmark. Source code at https://github.com/raghavian/strided-tenet. Version 2: Minor fixes to notation in Eq.1 and typos

PANDA Phase One

Authors: G. Barucca, F. Davì, G. Lancioni, P. Mengucci, L. Montalto, P. P. Natali, N. Paone, D. Rinaldi, L. Scalise, B. Krusche, M. Steinacher, Z. Liu, C. Liu, B. Liu, X. Shen, S. Sun, G. Zhao, J. Zhao, M. Albrecht, W. Alkakhi, S. Bökelmann, S. Coen, F. Feldbauer, M. Fink, J. Frech , et al. (399 additional authors not shown)

Abstract: The Facility for Antiproton and Ion Research (FAIR) in Darmstadt, Germany, provides unique possibilities for a new generation of hadron-, nuclear- and atomic physics experiments. The future antiProton ANnihilations at DArmstadt (PANDA or $\overline{\rm P}$ANDA) experiment at FAIR will offer a broad physics programme, covering different aspects of the strong interaction. Understanding the latter in… ▽ More The Facility for Antiproton and Ion Research (FAIR) in Darmstadt, Germany, provides unique possibilities for a new generation of hadron-, nuclear- and atomic physics experiments. The future antiProton ANnihilations at DArmstadt (PANDA or $\overline{\rm P}$ANDA) experiment at FAIR will offer a broad physics programme, covering different aspects of the strong interaction. Understanding the latter in the non-perturbative regime remains one of the greatest challenges in contemporary physics. The antiproton-nucleon interaction studied with PANDA provides crucial tests in this area. Furthermore, the high-intensity, low-energy domain of PANDA allows for searches for physics beyond the Standard Model, e.g. through high precision symmetry tests. This paper takes into account a staged approach for the detector setup and for the delivered luminosity from the accelerator. The available detector setup at the time of the delivery of the first antiproton beams in the HESR storage ring is referred to as the \textit{Phase One} setup. The physics programme that is achievable during Phase One is outlined in this paper. △ Less

Submitted 9 June, 2021; v1 submitted 28 January, 2021; originally announced January 2021.

Comments: 35 pages, 15 figures

Journal ref: European Physics Journal A57, 44 (2021)

A first attempt to differentiate between modified gravity and modified inertia with galaxy rotation curves

Authors: Jonas Petersen, Federico Lelli

Abstract: The phenomenology of modified Newtonian dynamics (MOND) on galaxy scales may point to more fundamental theories of either modified gravity (MG) or modified inertia (MI). In this paper, we test the applicability of the global deep-MOND parameter $Q$ which is predicted to vary at the $10\%$ level between MG and MI theories. Using mock-observed analytical models of disk galaxies, we investigate sever… ▽ More The phenomenology of modified Newtonian dynamics (MOND) on galaxy scales may point to more fundamental theories of either modified gravity (MG) or modified inertia (MI). In this paper, we test the applicability of the global deep-MOND parameter $Q$ which is predicted to vary at the $10\%$ level between MG and MI theories. Using mock-observed analytical models of disk galaxies, we investigate several observational uncertainties, establish a set of quality requirements for actual galaxies, and derive systematic corrections in the determination of $Q$. Implementing our quality requirements to the SPARC database yields $15$ galaxies, which are close enough to the deep-MOND regime as well as having rotation curves that are sufficiently extended and sampled. For these galaxies, the average and median values of $Q$ seem to favor MG theories, albeit both MG and MI predictions are in agreement with the data within $1.5σ$. Improved precision in the determination of $Q$ can be obtained by measuring extended and finely-sampled rotation curves for a significant sample of extremely low-surface-brightness galaxies. △ Less

Submitted 10 January, 2020; originally announced January 2020.

Comments: To be published in Astronomy & Astrophysics, 12 pages, 7 figures

Journal ref: A&A 636, A56 (2020)

A Case for the Score: Identifying Image Anomalies using Variational Autoencoder Gradients

Authors: David Zimmerer, Jens Petersen, Simon A. A. Kohl, Klaus H. Maier-Hein

Abstract: Through training on unlabeled data, anomaly detection has the potential to impact computer-aided diagnosis by outlining suspicious regions. Previous work on deep-learning-based anomaly detection has primarily focused on the reconstruction error. We argue instead, that pixel-wise anomaly ratings derived from a Variational Autoencoder based score approximation yield a theoretically better grounded a… ▽ More Through training on unlabeled data, anomaly detection has the potential to impact computer-aided diagnosis by outlining suspicious regions. Previous work on deep-learning-based anomaly detection has primarily focused on the reconstruction error. We argue instead, that pixel-wise anomaly ratings derived from a Variational Autoencoder based score approximation yield a theoretically better grounded and more faithful estimate. In our experiments, Variational Autoencoder gradient-based rating outperforms other approaches on unsupervised pixel-wise tumor detection on the BraTS-2017 dataset with a ROC-AUC of 0.94. △ Less

Submitted 28 November, 2019; originally announced December 2019.

High- and Low-level image component decomposition using VAEs for improved reconstruction and anomaly detection

Authors: David Zimmerer, Jens Petersen, Klaus Maier-Hein

Abstract: Variational Auto-Encoders have often been used for unsupervised pretraining, feature extraction and out-of-distribution and anomaly detection in the medical field. However, VAEs often lack the ability to produce sharp images and learn high-level features. We propose to alleviate these issues by adding a new branch to conditional hierarchical VAEs. This enforces a division between higher-level and… ▽ More Variational Auto-Encoders have often been used for unsupervised pretraining, feature extraction and out-of-distribution and anomaly detection in the medical field. However, VAEs often lack the ability to produce sharp images and learn high-level features. We propose to alleviate these issues by adding a new branch to conditional hierarchical VAEs. This enforces a division between higher-level and lower-level features. Despite the additional computational overhead compared to a normal VAE it results in sharper and better reconstructions and can capture the data distribution similarly well (indicated by a similar or slightly better OoD detection performance). △ Less

Submitted 27 November, 2019; originally announced November 2019.

Continuous-wave coherent Raman spectroscopy for improving the accuracy of Raman shifts

Authors: Hugo Kerdoncuff, Mikael Lassen, Jan C. Petersen

Abstract: Raman spectroscopy is an appealing technique that probes molecular vibrations in a wide variety of materials with virtually no sample preparation. However, accurate and reliable Raman measurements are still a challenge and require more robust and practical calibration methods. We demonstrate the implementation of a simple low-cost continuous-wave stimulated Raman spectroscopy scheme for accurate a… ▽ More Raman spectroscopy is an appealing technique that probes molecular vibrations in a wide variety of materials with virtually no sample preparation. However, accurate and reliable Raman measurements are still a challenge and require more robust and practical calibration methods. We demonstrate the implementation of a simple low-cost continuous-wave stimulated Raman spectroscopy scheme for accurate and high-resolution spectroscopy. We perform shot noise limited continuous-wave stimulated Raman scattering (cwSRS) as well as continuous-wave coherent anti-Stokes Raman scattering (cwCARS) on polystyrene samples. Our method enables accurate determination of Raman shifts with an uncertainty below 0.1 cm$^{-1}$. The setup is used for the characterization of reference materials required for the calibration of Raman spectrometers. Compared with existing standards, we provide an order of magnitude improvement of the uncertainty of Raman energy shifts in a polystyrene reference material. △ Less

Submitted 3 January, 2020; v1 submitted 1 October, 2019; originally announced October 2019.

Comments: 5 pages, 5 figures, 1 table

Journal ref: Opt. Lett. 44, 5057-5060 (2019)

A Mobile Manipulation System for One-Shot Teaching of Complex Tasks in Homes

Authors: Max Bajracharya, James Borders, Dan Helmick, Thomas Kollar, Michael Laskey, John Leichty, Jeremy Ma, Umashankar Nagarajan, Akiyoshi Ochiai, Josh Petersen, Krishna Shankar, Kevin Stone, Yutaka Takaoka

Abstract: We describe a mobile manipulation hardware and software system capable of autonomously performing complex human-level tasks in real homes, after being taught the task with a single demonstration from a person in virtual reality. This is enabled by a highly capable mobile manipulation robot, whole-body task space hybrid position/force control, teaching of parameterized primitives linked to a robust… ▽ More We describe a mobile manipulation hardware and software system capable of autonomously performing complex human-level tasks in real homes, after being taught the task with a single demonstration from a person in virtual reality. This is enabled by a highly capable mobile manipulation robot, whole-body task space hybrid position/force control, teaching of parameterized primitives linked to a robust learned dense visual embeddings representation of the scene, and a task graph of the taught behaviors. We demonstrate the robustness of the approach by presenting results for performing a variety of tasks, under different environmental conditions, in multiple real homes. Our approach achieves 85% overall success rate on three tasks that consist of an average of 45 behaviors each. △ Less

Submitted 3 March, 2020; v1 submitted 30 September, 2019; originally announced October 2019.

Comments: The video is available at: https://youtu.be/HSyAGMGikLk. 7 pages, 5 figures, accepted by IEEE 2020 Robotics International Conference on Robotics and Automation (ICRA)

Simple and robust speckle detection method for fire and heat detection in harsh environments

Authors: Charles N. Christensen, Yevgen Zainchkovskyy, Salvador Barrera-Figueroa, Antoni Torras-Rosell, Giorgio Marinelli, Kim Sommerlund-Thorsen, Jan Kleven, Kristian Kleven, Erlend Voll, Jan C. Petersen, Mikael Lassen

Abstract: Standard laser based fire detection systems are often based on measuring variation of optical signal amplitude. However, mechanical noise interference and loss from dust and steam can obscure the detection signal, resulting in faulty results or inability to detect a potential fire. The presented fire detection technology will allow the detection of fire in harsh and dusty areas, which are prone to… ▽ More Standard laser based fire detection systems are often based on measuring variation of optical signal amplitude. However, mechanical noise interference and loss from dust and steam can obscure the detection signal, resulting in faulty results or inability to detect a potential fire. The presented fire detection technology will allow the detection of fire in harsh and dusty areas, which are prone to fires, where current systems show limited performance or are unable to operate. It is not the amount of light nor its wavelength that is used for detecting fire, but how the refractive index randomly fluctuates due to the heat convection from the fire. In practical terms this means that light obstruction from ambient dust particles will not be a problem as long as a small fraction of the light is detected and that fires without visible flames can still be detected. The standalone laser system consists of a Linux-based Red Pitaya system, a cheap 650 nm laser diode, and a PIN photo-detector. Laser light propagates through the monitored area and reflects off a retroreflector generating a speckle pattern. Every 3 seconds time traces and frequency noise spectra are measured and 8 descriptors are deduced to identify a potential fire. Both laboratory and factory acceptance tests have been performed with success. △ Less

Submitted 12 August, 2019; originally announced September 2019.

Comments: 6 pages, 5 figures

Context-encoding Variational Autoencoder for Unsupervised Anomaly Detection -- Short Paper

Authors: David Zimmerer, Simon Kohl, Jens Petersen, Fabian Isensee, Klaus Maier-Hein

Abstract: Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially Variational Autoencoders (VAEs)often fail to capture the high-level structure in the data. We address these shortcomings by proposing the context-encoding Variational… ▽ More Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially Variational Autoencoders (VAEs)often fail to capture the high-level structure in the data. We address these shortcomings by proposing the context-encoding Variational Autoencoder (ceVAE), which improves both, the sample, as well as pixelwise results. In our experiments on the BraTS-2017 and ISLES-2015 segmentation benchmarks the ceVAE achieves unsupervised AUROCs of 0.95 and 0.89, respectively, thus outperforming other reported deep-learning based approaches. △ Less

Submitted 1 January, 2020; v1 submitted 29 July, 2019; originally announced July 2019.

Comments: MIDL 2019 [arXiv:1907.08612]

Report number: MIDL/2019/ExtendedAbstract/BylLiVXptV

Deep Probabilistic Modeling of Glioma Growth

Authors: Jens Petersen, Paul F. Jäger, Fabian Isensee, Simon A. A. Kohl, Ulf Neuberger, Wolfgang Wick, Jürgen Debus, Sabine Heiland, Martin Bendszus, Philipp Kickingereder, Klaus H. Maier-Hein

Abstract: Existing approaches to modeling the dynamics of brain tumor growth, specifically glioma, employ biologically inspired models of cell diffusion, using image data to estimate the associated parameters. In this work, we propose an alternative approach based on recent advances in probabilistic segmentation and representation learning that implicitly learns growth dynamics directly from data without an… ▽ More Existing approaches to modeling the dynamics of brain tumor growth, specifically glioma, employ biologically inspired models of cell diffusion, using image data to estimate the associated parameters. In this work, we propose an alternative approach based on recent advances in probabilistic segmentation and representation learning that implicitly learns growth dynamics directly from data without an underlying explicit model. We present evidence that our approach is able to learn a distribution of plausible future tumor appearances conditioned on past observations of the same tumor. △ Less

Submitted 9 July, 2019; originally announced July 2019.

Comments: MICCAI 2019

Unsupervised Anomaly Localization using Variational Auto-Encoders

Authors: David Zimmerer, Fabian Isensee, Jens Petersen, Simon Kohl, Klaus Maier-Hein

Abstract: An assumption-free automatic check of medical images for potentially overseen anomalies would be a valuable assistance for a radiologist. Deep learning and especially Variational Auto-Encoders (VAEs) have shown great potential in the unsupervised learning of data distributions. In principle, this allows for such a check and even the localization of parts in the image that are most suspicious. Curr… ▽ More An assumption-free automatic check of medical images for potentially overseen anomalies would be a valuable assistance for a radiologist. Deep learning and especially Variational Auto-Encoders (VAEs) have shown great potential in the unsupervised learning of data distributions. In principle, this allows for such a check and even the localization of parts in the image that are most suspicious. Currently, however, the reconstruction-based localization by design requires adjusting the model architecture to the specific problem looked at during evaluation. This contradicts the principle of building assumption-free models. We propose complementing the localization part with a term derived from the Kullback-Leibler (KL)-divergence. For validation, we perform a series of experiments on FashionMNIST as well as on a medical task including >1000 healthy and >250 brain tumor patients. Results show that the proposed formalism outperforms the state of the art VAE-based localization of anomalies across many hyperparameter settings and also shows a competitive max performance. △ Less

Submitted 11 July, 2019; v1 submitted 4 July, 2019; originally announced July 2019.

A Toy Model for the Dynamical Discrepancies on Galactic Scales

Authors: Jonas Petersen, Martin Rosenlyst

Abstract: In this study a simple toy model solution to the missing gravity problem on galactic scales is reverse engineered from galactic data via imposing broad assumptions. It is shown that the toy model solution can be written in terms of baryonic quantities, is highly similar to pseudo-isothermal dark matter on galactic scales and can accommodate the same observations. In this way, the toy model solutio… ▽ More In this study a simple toy model solution to the missing gravity problem on galactic scales is reverse engineered from galactic data via imposing broad assumptions. It is shown that the toy model solution can be written in terms of baryonic quantities, is highly similar to pseudo-isothermal dark matter on galactic scales and can accommodate the same observations. In this way, the toy model solution is similar to MOND modified gravity in the Bekenstein-Milgrom formulation. However, it differs in the similarity to pseudo-isothermal dark matter and in the functional form. In loose terms, it is shown that pseudo-isothermal dark matter can be written in terms of baryonic quantities. The required form suggests that it may be worth looking into a mechanism that can increase the magnitude of the post-Newtonian correction from general relativity for low accelerations. △ Less

Submitted 10 January, 2020; v1 submitted 25 June, 2019; originally announced June 2019.

Comments: 5 pages, 2 figures

Journal ref: Monthly Notices of the Royal Astronomical Society, Volume 490, Issue 3, December 2019, Pages 3493-3497

Investigating Dark Matter and MOND Models with Galactic Rotation Curve Data: Analysing the Gas-Dominated Galaxies

Authors: Jonas Petersen

Abstract: In this study the geometry of gas dominated galaxies in the SPARC database is analyzed in a normalized $(g_{bar},g_{obs})$-space ($g2$-space), where $g_{obs}$ is the observed centripetal acceleration and $g_{bar}$ is the centripetal acceleration as obtained from the observed baryonic matter via Newtonian dynamics. The normalization of $g2$-space significantly reduce the effect of both random and s… ▽ More In this study the geometry of gas dominated galaxies in the SPARC database is analyzed in a normalized $(g_{bar},g_{obs})$-space ($g2$-space), where $g_{obs}$ is the observed centripetal acceleration and $g_{bar}$ is the centripetal acceleration as obtained from the observed baryonic matter via Newtonian dynamics. The normalization of $g2$-space significantly reduce the effect of both random and systematic uncertainties as well as enable a comparison of the geometries of different galaxies. Analyzing the gas-dominated galaxies (as opposed to other galaxies) further suppress the impact of the mass to light ratios. It is found that the overall geometry of the gas dominated galaxies in SPARC is consistent with a rightward curving geometry in the normalized $g2$-space (characterized by $r_{obs}>r_{bar}$, where $r_{bar}=\arg \max_r[g_{bar}(r)]$ and $r_{obs}=\arg \max_r[g_{obs}(r)]$). This is in contrast to the overall geometry of all galaxies in SPARC which best approximates a geometry curing nowhere in normalized $g2$-space (characterized by $r_{obs}=r_{bar}$) with a slight inclination toward a rightward curving geometry. The geometry of the gas dominated galaxies not only indicate the true (independent of mass to light ratios to leading order) geometry of data in $g2$-space (which can be used to infer properties on the solution to the missing mass problem) but also - when compared to the geometry of all galaxies - indicate the underlying radial dependence of the disk mass to light ratio. △ Less

Submitted 24 June, 2019; originally announced June 2019.

Comments: 10 pages, 6 figures

Automated Design of Deep Learning Methods for Biomedical Image Segmentation

Authors: Fabian Isensee, Paul F. Jäger, Simon A. A. Kohl, Jens Petersen, Klaus H. Maier-Hein

Abstract: Biomedical imaging is a driver of scientific discovery and core component of medical care, currently stimulated by the field of deep learning. While semantic segmentation algorithms enable 3D image analysis and quantification in many applications, the design of respective specialised solutions is non-trivial and highly dependent on dataset properties and hardware conditions. We propose nnU-Net, a… ▽ More Biomedical imaging is a driver of scientific discovery and core component of medical care, currently stimulated by the field of deep learning. While semantic segmentation algorithms enable 3D image analysis and quantification in many applications, the design of respective specialised solutions is non-trivial and highly dependent on dataset properties and hardware conditions. We propose nnU-Net, a deep learning framework that condenses the current domain knowledge and autonomously takes the key decisions required to transfer a basic architecture to different datasets and segmentation tasks. Without manual tuning, nnU-Net surpasses most specialised deep learning pipelines in 19 public international competitions and sets a new state of the art in the majority of the 49 tasks. The results demonstrate a vast hidden potential in the systematic adaptation of deep learning methods to different datasets. We make nnU-Net publicly available as an open-source tool that can effectively be used out-of-the-box, rendering state of the art segmentation accessible to non-experts and catalyzing scientific progress as a framework for automated method design. △ Less

Submitted 2 April, 2020; v1 submitted 17 April, 2019; originally announced April 2019.

Comments: * Fabian Isensee and Paul F. Jäger share the first authorship

Journal ref: Nature Methods (2020)

A cross-center smoothness prior for variational Bayesian brain tissue segmentation

Authors: Wouter M. Kouw, Silas N. Ørting, Jens Petersen, Kim S. Pedersen, Marleen de Bruijne

Abstract: Suppose one is faced with the challenge of tissue segmentation in MR images, without annotators at their center to provide labeled training data. One option is to go to another medical center for a trained classifier. Sadly, tissue classifiers do not generalize well across centers due to voxel intensity shifts caused by center-specific acquisition protocols. However, certain aspects of segmentatio… ▽ More Suppose one is faced with the challenge of tissue segmentation in MR images, without annotators at their center to provide labeled training data. One option is to go to another medical center for a trained classifier. Sadly, tissue classifiers do not generalize well across centers due to voxel intensity shifts caused by center-specific acquisition protocols. However, certain aspects of segmentations, such as spatial smoothness, remain relatively consistent and can be learned separately. Here we present a smoothness prior that is fit to segmentations produced at another medical center. This informative prior is presented to an unsupervised Bayesian model. The model clusters the voxel intensities, such that it produces segmentations that are similarly smooth to those of the other medical center. In addition, the unsupervised Bayesian model is extended to a semi-supervised variant, which needs no visual interpretation of clusters into tissues. △ Less

Submitted 11 March, 2019; originally announced March 2019.

Comments: 12 pages, 2 figures, 1 table. Accepted to the International Conference on Information Processing in Medical Imaging (2019)

Journal ref: International Conference on Information Processing in Medical Imaging (IPMI), Hong Kong, 2019, pp. 360-371

Segmentation of Roots in Soil with U-Net

Authors: Abraham George Smith, Jens Petersen, Raghavendra Selvan, Camilla Ruø Rasmussen

Abstract: Plant root research can provide a way to attain stress-tolerant crops that produce greater yield in a diverse array of conditions. Phenoty** roots in soil is often challenging due to the roots being difficult to access and the use of time consuming manual methods. Rhizotrons allow visual inspection of root growth through transparent surfaces. Agronomists currently manually label photographs of r… ▽ More Plant root research can provide a way to attain stress-tolerant crops that produce greater yield in a diverse array of conditions. Phenoty** roots in soil is often challenging due to the roots being difficult to access and the use of time consuming manual methods. Rhizotrons allow visual inspection of root growth through transparent surfaces. Agronomists currently manually label photographs of roots obtained from rhizotrons using a line-intersect method to obtain root length density and rooting depth measurements which are essential for their experiments. We investigate the effectiveness of an automated image segmentation method based on the U-Net Convolutional Neural Network (CNN) architecture to enable such measurements. We design a data-set of 50 annotated Chicory (Cichorium intybus L.) root images which we use to train, validate and test the system and compare against a baseline built using the Frangi vesselness filter. We obtain metrics using manual annotations and line-intersect counts. Our results on the held out data show our proposed automated segmentation system to be a viable solution for detecting and quantifying roots. We evaluate our system using 867 images for which we have obtained line-intersect counts, attaining a Spearman rank correlation of 0.9748 and an $r^2$ of 0.9217. We also achieve an $F_1$ of 0.7 when comparing the automated segmentation to the manual annotations, with our automated segmentation system producing segmentations with higher quality than the manual annotations for large portions of the image. △ Less

Submitted 18 March, 2019; v1 submitted 28 February, 2019; originally announced February 2019.

The Liver Tumor Segmentation Benchmark (LiTS)

Authors: Patrick Bilic, Patrick Christ, Hongwei Bran Li, Eugene Vorontsov, Avi Ben-Cohen, Georgios Kaissis, Adi Szeskin, Colin Jacobs, Gabriel Efrain Humpire Mamani, Gabriel Chartrand, Fabian Lohöfer, Julian Walter Holch, Wieland Sommer, Felix Hofmann, Alexandre Hostettler, Naama Lev-Cohain, Michal Drozdzal, Michal Marianne Amitai, Refael Vivantik, Jacob Sosna, Ivan Ezhov, Anjany Sekuboyina, Fernando Navarro, Florian Kofler, Johannes C. Paetzold , et al. (84 additional authors not shown)

Abstract: In this work, we report the set-up and results of the Liver Tumor Segmentation Benchmark (LiTS), which was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 and the International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2017 and 2018. The image dataset is diverse and contains primary and secondary tumors with… ▽ More In this work, we report the set-up and results of the Liver Tumor Segmentation Benchmark (LiTS), which was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 and the International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2017 and 2018. The image dataset is diverse and contains primary and secondary tumors with varied sizes and appearances with various lesion-to-background levels (hyper-/hypo-dense), created in collaboration with seven hospitals and research institutions. Seventy-five submitted liver and liver tumor segmentation algorithms were trained on a set of 131 computed tomography (CT) volumes and were tested on 70 unseen test images acquired from different patients. We found that not a single algorithm performed best for both liver and liver tumors in the three events. The best liver segmentation algorithm achieved a Dice score of 0.963, whereas, for tumor segmentation, the best algorithms achieved Dices scores of 0.674 (ISBI 2017), 0.702 (MICCAI 2017), and 0.739 (MICCAI 2018). Retrospectively, we performed additional analysis on liver tumor detection and revealed that not all top-performing segmentation algorithms worked well for tumor detection. The best liver tumor detection method achieved a lesion-wise recall of 0.458 (ISBI 2017), 0.515 (MICCAI 2017), and 0.554 (MICCAI 2018), indicating the need for further research. LiTS remains an active benchmark and resource for research, e.g., contributing the liver-related segmentation tasks in \url{http://medicaldecathlon.com/}. In addition, both data and online evaluation are accessible via \url{www.lits-challenge.com}. △ Less

Submitted 25 November, 2022; v1 submitted 13 January, 2019; originally announced January 2019.

Comments: Patrick Bilic, Patrick Christ, Hongwei Bran Li, and Eugene Vorontsov made equal contributions to this work. Published in Medical Image Analysis

Journal ref: Medical Image Analysis (2022) Pg. 102680

Versatile photoacoustic spectrometer based on a mid-infrared pulsed optical parametric oscillator

Authors: Laurent Lamard, David Balslev-Harder, Andre Peremans, Jan C. Petersen, Mikael Lassen

Abstract: We demonstrate the usefulness of a nanosecond pulsed single-mode mid-infrared (MIR) optical parametric oscillator (OPO) for Photoacoustic (PA) spectroscopic measurements. The maximum wavelength ranges for the signal and idler are 1.4 um to 1.7 um and 2.8 um to 4.6 um, respectively, and with a MIR output power of up to 500 mW. Making the OPO useful for different spectroscopic PA trace-gas measureme… ▽ More We demonstrate the usefulness of a nanosecond pulsed single-mode mid-infrared (MIR) optical parametric oscillator (OPO) for Photoacoustic (PA) spectroscopic measurements. The maximum wavelength ranges for the signal and idler are 1.4 um to 1.7 um and 2.8 um to 4.6 um, respectively, and with a MIR output power of up to 500 mW. Making the OPO useful for different spectroscopic PA trace-gas measurements targeting the major market opportunity of environmental monitoring and breath gas analysis. We perform spectroscopic measurements of methane (CH4) nitrogen dioxide (NO2) and ammonia (NH3) in the 2.8 um to 3.7 um wavelength region. The measurements were conducted with a constant flow rate of 300 ml/min, thus demonstrating the suitability of the gas sensor for real time trace gas measurements. The acquired spectra are compared with data from the Hitran database and good agreement is found. Demonstrating a resolution bandwidth of 1.5 1/cm. An Allan deviation analysis shows that the detection limit for methane at optimum integration time for the PA sensor is 8 ppbV (nmol/mol) at 105 seconds of integration time. △ Less

Submitted 10 December, 2018; originally announced January 2019.

Comments: 6 pages, 7 figures. arXiv admin note: substantial text overlap with arXiv:1712.04547

Context-encoding Variational Autoencoder for Unsupervised Anomaly Detection

Authors: David Zimmerer, Simon A. A. Kohl, Jens Petersen, Fabian Isensee, Klaus H. Maier-Hein

Abstract: Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based auto encoders have shown great potential in detecting anomalies in medical images. However, state-of-the-art anomaly scores are still based on the reconstruction error, which lacks in two essential parts: it ignores the model-internal representation employed for recons… ▽ More Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based auto encoders have shown great potential in detecting anomalies in medical images. However, state-of-the-art anomaly scores are still based on the reconstruction error, which lacks in two essential parts: it ignores the model-internal representation employed for reconstruction, and it lacks formal assertions and comparability between samples. We address these shortcomings by proposing the Context-encoding Variational Autoencoder (ceVAE) which combines reconstruction- with density-based anomaly scoring. This improves the sample- as well as pixel-wise results. In our experiments on the BraTS-2017 and ISLES-2015 segmentation benchmarks, the ceVAE achieves unsupervised ROC-AUCs of 0.95 and 0.89, respectively, thus outperforming state-of-the-art methods by a considerable margin. △ Less

Submitted 14 December, 2018; originally announced December 2018.

Experimental study of inertial particles clustering and settling in homogeneous turbulence

Authors: Alec J. Petersen, Lucia Baker, Filippo Coletti

Abstract: We study experimentally the spatial distribution, settling, and interaction of sub-Kolmogorov inertial particles with homogeneous turbulence. Utilizing a zero-mean-flow air turbulence chamber, we drop size-selected solid particles and study their dynamics with particle imaging and tracking velocimetry at multiple resolutions. The carrier flow is simultaneously measured by particle image velocimetr… ▽ More We study experimentally the spatial distribution, settling, and interaction of sub-Kolmogorov inertial particles with homogeneous turbulence. Utilizing a zero-mean-flow air turbulence chamber, we drop size-selected solid particles and study their dynamics with particle imaging and tracking velocimetry at multiple resolutions. The carrier flow is simultaneously measured by particle image velocimetry of suspended tracers, allowing the characterization of the interplay between both the dispersed and continuous phases. The turbulence Reynolds number based on the Taylor microscale ranges from $Re_λ\approx 200$ - $500$, while the particle Stokes number based on the Kolmogorov scale varies between $St_η = O(1)$ and $O(10)$. Clustering is confirmed to be most intense for $St_η \approx 1$, but it extends over larger scales for heavier particles. Individual clusters form a hierarchy of self-similar, fractal-like objects, preferentially aligned with gravity and sizes that can reach the integral scale of the turbulence. Remarkably, the settling velocity of $St_η \approx 1$ particles can be several times larger than the still-air terminal velocity, and the clusters can fall even faster. This is caused by downward fluid fluctuations preferentially swee** the particles, and we propose that this mechanism is influenced by both large and small scales of the turbulence. The particle-fluid slip velocities show large variance, and both the instantaneous particle Reynolds number and drag coefficient can greatly differ from their nominal values. Finally, for sufficient loadings, the particles generally augment the small-scale fluid velocity fluctuations, which however may account for a limited fraction of the turbulent kinetic energy. △ Less

Submitted 10 December, 2018; originally announced December 2018.

Graph Refinement based Airway Extraction using Mean-Field Networks and Graph Neural Networks

Authors: Raghavendra Selvan, Thomas Kipf, Max Welling, Antonio Garcia-Uceda Juarez, Jesper H Pedersen, Jens Petersen, Marleen de Bruijne

Abstract: Graph refinement, or the task of obtaining subgraphs of interest from over-complete graphs, can have many varied applications. In this work, we extract trees or collection of sub-trees from image data by, first deriving a graph-based representation of the volumetric data and then, posing the tree extraction as a graph refinement task. We present two methods to perform graph refinement. First, we u… ▽ More Graph refinement, or the task of obtaining subgraphs of interest from over-complete graphs, can have many varied applications. In this work, we extract trees or collection of sub-trees from image data by, first deriving a graph-based representation of the volumetric data and then, posing the tree extraction as a graph refinement task. We present two methods to perform graph refinement. First, we use mean-field approximation (MFA) to approximate the posterior density over the subgraphs from which the optimal subgraph of interest can be estimated. Mean field networks (MFNs) are used for inference based on the interpretation that iterations of MFA can be seen as feed-forward operations in a neural network. This allows us to learn the model parameters using gradient descent. Second, we present a supervised learning approach using graph neural networks (GNNs) which can be seen as generalisations of MFNs. Subgraphs are obtained by training a GNN-based graph refinement model to directly predict edge probabilities. We discuss connections between the two classes of methods and compare them for the task of extracting airways from 3D, low-dose, chest CT data. We show that both the MFN and GNN models show significant improvement when compared to one baseline method, that is similar to a top performing method in the EXACT'09 Challenge, and a 3D U-Net based airway segmentation model, in detecting more branches with fewer false positives. △ Less

Submitted 2 June, 2020; v1 submitted 21 November, 2018; originally announced November 2018.

Comments: Accepted for publication at Medical Image Analysis. 14 pages

Learning to quantify emphysema extent: What labels do we need?

Authors: Silas Nyboe Ørting, Jens Petersen, Laura H. Thomsen, Mathilde M. W. Wille, Marleen de Bruijne

Abstract: Accurate assessment of pulmonary emphysema is crucial to assess disease severity and subtype, to monitor disease progression and to predict lung cancer risk. However, visual assessment is time-consuming and subject to substantial inter-rater variability and standard densitometry approaches to quantify emphysema remain inferior to visual scoring. We explore if machine learning methods that learn fr… ▽ More Accurate assessment of pulmonary emphysema is crucial to assess disease severity and subtype, to monitor disease progression and to predict lung cancer risk. However, visual assessment is time-consuming and subject to substantial inter-rater variability and standard densitometry approaches to quantify emphysema remain inferior to visual scoring. We explore if machine learning methods that learn from a large dataset of visually assessed CT scans can provide accurate estimates of emphysema extent. We further investigate if machine learning algorithms that learn from a scoring of emphysema extent can outperform algorithms that learn only from a scoring of emphysema presence. We compare four Multiple Instance Learning classifiers that are trained on emphysema presence labels, and five Learning with Label Proportions classifiers that are trained on emphysema extent labels. We evaluate performance on 600 low-dose CT scans from the Danish Lung Cancer Screening Trial and find that learning from emphysema presence labels, which are much easier to obtain, gives equally good performance to learning from emphysema extent labels. The best classifiers achieve intra-class correlation coefficients around 0.90 and average overall agreement with raters of 78% and 79% on six emphysema extent classes versus inter-rater agreement of 83%. △ Less

Submitted 17 October, 2018; originally announced October 2018.

nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation

Authors: Fabian Isensee, Jens Petersen, Andre Klein, David Zimmerer, Paul F. Jaeger, Simon Kohl, Jakob Wasserthal, Gregor Koehler, Tobias Norajitra, Sebastian Wirkert, Klaus H. Maier-Hein

Abstract: The U-Net was presented in 2015. With its straight-forward and successful architecture it quickly evolved to a commonly used benchmark in medical image segmentation. The adaptation of the U-Net to novel problems, however, comprises several degrees of freedom regarding the exact architecture, preprocessing, training and inference. These choices are not independent of each other and substantially im… ▽ More The U-Net was presented in 2015. With its straight-forward and successful architecture it quickly evolved to a commonly used benchmark in medical image segmentation. The adaptation of the U-Net to novel problems, however, comprises several degrees of freedom regarding the exact architecture, preprocessing, training and inference. These choices are not independent of each other and substantially impact the overall performance. The present paper introduces the nnU-Net ('no-new-Net'), which refers to a robust and self-adapting framework on the basis of 2D and 3D vanilla U-Nets. We argue the strong case for taking away superfluous bells and whistles of many proposed network designs and instead focus on the remaining aspects that make out the performance and generalizability of a method. We evaluate the nnU-Net in the context of the Medical Segmentation Decathlon challenge, which measures segmentation performance in ten disciplines comprising distinct entities, image modalities, image geometries and dataset sizes, with no manual adjustments between datasets allowed. At the time of manuscript submission, nnU-Net achieves the highest mean dice scores across all classes and seven phase 1 tasks (except class 1 in BrainTumour) in the online leaderboard of the challenge. △ Less

Submitted 27 September, 2018; originally announced September 2018.

Cryogen-Free dissolution Dynamic Nuclear Polarization polarizer operating at 3.35 T, 6.70 T and 10.1 T

Authors: Jan Henrik Ardenkjaer-Larsen, Sean Bowen, Jan Raagaard Petersen, Oleksandr Rybalko, Mads Sloth Vinding, Marcus Ullisch, Niels Chr. Nielsen

Abstract: Purpose: A novel dissolution dynamic nuclear polarization (dDNP) polarizer platform is presented. The polarizer meets a number of key requirements for in vitro, pre-clinical and clinical applications. Method: It uses no liquid cryogens, operates in continuous mode, accommodates a wide range of sample sizes up to and including those required for human studies, and is fully automated. Results: It of… ▽ More Purpose: A novel dissolution dynamic nuclear polarization (dDNP) polarizer platform is presented. The polarizer meets a number of key requirements for in vitro, pre-clinical and clinical applications. Method: It uses no liquid cryogens, operates in continuous mode, accommodates a wide range of sample sizes up to and including those required for human studies, and is fully automated. Results: It offers a wide operational window both in terms of magnetic field, up to 10.1 T, and temperature, from room temperature down to 1.3 K. The polarizer delivers a 13C liquid state polarization for [1-13C]pyruvate of 70%. The build-up time constant in the solid state is approx. 1200 s (20 min), allowing a sample throughput of at least one sample per hour including sample loading and dissolution. Conclusion: We confirm the previously reported strong field dependence in the range 3.35 to 6.7 T, but see no further increase in polarization when increasing the magnetic field strength to 10.1 T for [1-13C]pyruvate and trityl. Using a custom dry magnet, cold head and recondensing, closed-cycle cooling system, combined with a modular DNP probe, automation and fluid handling systems; we have designed a unique dDNP system with unrivalled flexibility and performance. △ Less

Submitted 27 August, 2018; v1 submitted 14 August, 2018; originally announced August 2018.

Comments: 16 pages, 8 figures