Showing 1–50 of 155 results for author: Heinrich, M

IM-MoCo: Self-supervised MRI Motion Correction using Motion-Guided Implicit Neural Representations

Authors: Ziad Al-Haj Hemidi, Christian Weihsbach, Mattias P. Heinrich

Abstract: Motion artifacts in Magnetic Resonance Imaging (MRI) arise due to relatively long acquisition times and can compromise the clinical utility of acquired images. Traditional motion correction methods often fail to address severe motion, leading to distorted and unreliable results. Deep Learning (DL) alleviated such pitfalls through generalization with the cost of vanishing structures and hallucinati… ▽ More Motion artifacts in Magnetic Resonance Imaging (MRI) arise due to relatively long acquisition times and can compromise the clinical utility of acquired images. Traditional motion correction methods often fail to address severe motion, leading to distorted and unreliable results. Deep Learning (DL) alleviated such pitfalls through generalization with the cost of vanishing structures and hallucinations, making it challenging to apply in the medical field where hallucinated structures can tremendously impact the diagnostic outcome. In this work, we present an instance-wise motion correction pipeline that leverages motion-guided Implicit Neural Representations (INRs) to mitigate the impact of motion artifacts while retaining anatomical structure. Our method is evaluated using the NYU fastMRI dataset with different degrees of simulated motion severity. For the correction alone, we can improve over state-of-the-art image reconstruction methods by $+5\%$ SSIM, $+5\:db$ PSNR, and $+14\%$ HaarPSI. Clinical relevance is demonstrated by a subsequent experiment, where our method improves classification outcomes by at least $+1.5$ accuracy percentage points compared to motion-corrupted images. △ Less

Submitted 3 July, 2024; originally announced July 2024.

Comments: Submitted to MICCAI 2024 (Before peer review version)

DenseSeg: Joint Learning for Semantic Segmentation and Landmark Detection Using Dense Image-to-Shape Representation

Authors: Ron Keuth, Lasse Hansen, Maren Balks, Ronja Jäger, Anne-Nele Schröder, Ludger Tüshaus, Mattias Heinrich

Abstract: Purpose: Semantic segmentation and landmark detection are fundamental tasks of medical image processing, facilitating further analysis of anatomical objects. Although deep learning-based pixel-wise classification has set a new-state-of-the-art for segmentation, it falls short in landmark detection, a strength of shape-based approaches. Methods: In this work, we propose a dense image-to-shape rep… ▽ More Purpose: Semantic segmentation and landmark detection are fundamental tasks of medical image processing, facilitating further analysis of anatomical objects. Although deep learning-based pixel-wise classification has set a new-state-of-the-art for segmentation, it falls short in landmark detection, a strength of shape-based approaches. Methods: In this work, we propose a dense image-to-shape representation that enables the joint learning of landmarks and semantic segmentation by employing a fully convolutional architecture. Our method intuitively allows the extraction of arbitrary landmarks due to its representation of anatomical correspondences. We benchmark our method against the state-of-the-art for semantic segmentation (nnUNet), a shape-based approach employing geometric deep learning and a CNN-based method for landmark detection. Results: We evaluate our method on two medical dataset: one common benchmark featuring the lungs, heart, and clavicle from thorax X-rays, and another with 17 different bones in the paediatric wrist. While our method is on pair with the landmark detection baseline in the thorax setting (error in mm of $2.6\pm0.9$ vs $2.7\pm0.9$), it substantially surpassed it in the more complex wrist setting ($1.1\pm0.6$ vs $1.9\pm0.5$). Conclusion: We demonstrate that dense geometric shape representation is beneficial for challenging landmark detection tasks and outperforms previous state-of-the-art using heatmap regression. While it does not require explicit training on the landmarks themselves, allowing for the addition of new landmarks without necessitating retraining.} △ Less

Submitted 30 May, 2024; originally announced May 2024.

CoCar NextGen: a Multi-Purpose Platform for Connected Autonomous Driving Research

Authors: Marc Heinrich, Maximilian Zipfl, Marc Uecker, Sven Ochs, Martin Gontscharow, Tobias Fleck, Jens Doll, Philip Schörner, Christian Hubschneider, Marc René Zofka, Alexander Viehl, J. Marius Zöllner

Abstract: Real world testing is of vital importance to the success of automated driving. While many players in the business design purpose build testing vehicles, we designed and build a modular platform that offers high flexibility for any kind of scenario. CoCar NextGen is equipped with next generation hardware that addresses all future use cases. Its extensive, redundant sensor setup allows to develop cr… ▽ More Real world testing is of vital importance to the success of automated driving. While many players in the business design purpose build testing vehicles, we designed and build a modular platform that offers high flexibility for any kind of scenario. CoCar NextGen is equipped with next generation hardware that addresses all future use cases. Its extensive, redundant sensor setup allows to develop cross-domain data driven approaches that manage the transfer to other sensor setups. Together with the possibility of being deployed on public roads, this creates a unique research platform that supports the road to automated driving on SAE Level 5. △ Less

Submitted 26 April, 2024; originally announced April 2024.

Deformable MRI Sequence Registration for AI-based Prostate Cancer Diagnosis

Authors: Alessa Hering, Sarah de Boer, Anindo Saha, Jasper J. Twilt, Mattias P. Heinrich, Derya Yakar, Maarten de Rooij, Henkjan Huisman, Joeran S. Bosma

Abstract: The PI-CAI (Prostate Imaging: Cancer AI) challenge led to expert-level diagnostic algorithms for clinically significant prostate cancer detection. The algorithms receive biparametric MRI scans as input, which consist of T2-weighted and diffusion-weighted scans. These scans can be misaligned due to multiple factors in the scanning process. Image registration can alleviate this issue by predicting t… ▽ More The PI-CAI (Prostate Imaging: Cancer AI) challenge led to expert-level diagnostic algorithms for clinically significant prostate cancer detection. The algorithms receive biparametric MRI scans as input, which consist of T2-weighted and diffusion-weighted scans. These scans can be misaligned due to multiple factors in the scanning process. Image registration can alleviate this issue by predicting the deformation between the sequences. We investigate the effect of image registration on the diagnostic performance of AI-based prostate cancer diagnosis. First, the image registration algorithm, developed in MeVisLab, is analyzed using a dataset with paired lesion annotations. Second, the effect on diagnosis is evaluated by comparing case-level cancer diagnosis performance between using the original dataset, rigidly aligned diffusion-weighted scans, or deformably aligned diffusion-weighted scans. Rigid registration showed no improvement. Deformable registration demonstrated a substantial improvement in lesion overlap (+10% median Dice score) and a positive yet non-significant improvement in diagnostic performance (+0.3% AUROC, p=0.18). Our investigation shows that a substantial improvement in lesion alignment does not directly lead to a significant improvement in diagnostic performance. Qualitative analysis indicated that jointly develo** image registration methods and diagnostic AI algorithms could enhance diagnostic accuracy and patient outcomes. △ Less

Submitted 28 June, 2024; v1 submitted 15 April, 2024; originally announced April 2024.

One Stack to Rule them All: To Drive Automated Vehicles, and Reach for the 4th level

Authors: Sven Ochs, Jens Doll, Daniel Grimm, Tobias Fleck, Marc Heinrich, Stefan Orf, Albert Schotschneider, Helen Gremmelmaier, Rupert Polley, Svetlana Pavlitska, Maximilian Zipfl, Helen Schneider, Ferdinand Mütsch, Daniel Bogdoll, Florian Kuhnt, Philip Schörner, Marc René Zofka, J. Marius Zöllner

Abstract: Most automated driving functions are designed for a specific task or vehicle. Most often, the underlying architecture is fixed to specific algorithms to increase performance. Therefore, it is not possible to deploy new modules and algorithms easily. In this paper, we present our automated driving stack which combines both scalability and adaptability. Due to the modular design, our stack allows fo… ▽ More Most automated driving functions are designed for a specific task or vehicle. Most often, the underlying architecture is fixed to specific algorithms to increase performance. Therefore, it is not possible to deploy new modules and algorithms easily. In this paper, we present our automated driving stack which combines both scalability and adaptability. Due to the modular design, our stack allows for a fast integration and testing of novel and state-of-the-art research approaches. Furthermore, it is flexible to be used for our different testing vehicles, including modified EasyMile EZ10 shuttles and different passenger cars. These vehicles differ in multiple ways, e.g. sensor setups, control systems, maximum speed, or steering angle limitations. Finally, our stack is deployed in real world environments, including passenger transport in urban areas. Our stack includes all components needed for operating an autonomous vehicle, including localization, perception, planning, controller, and additional safety modules. Our stack is developed, tested, and evaluated in real world traffic in multiple test sites, including the Test Area Autonomous Driving Baden-Württemberg. △ Less

Submitted 3 April, 2024; originally announced April 2024.

Leveraging Swarm Intelligence to Drive Autonomously: A Particle Swarm Optimization based Approach to Motion Planning

Authors: Sven Ochs, Jens Doll, Marc Heinrich, Philip Schörner, Sebastian Klemm, Marc René Zofka, J. Marius Zöllner

Abstract: Motion planning is an essential part of autonomous mobile platforms. A good pipeline should be modular enough to handle different vehicles, environments, and perception modules. The planning process has to cope with all the different modalities and has to have a modular and flexible design. But most importantly, it has to be safe and robust. In this paper, we want to present our motion planning pi… ▽ More Motion planning is an essential part of autonomous mobile platforms. A good pipeline should be modular enough to handle different vehicles, environments, and perception modules. The planning process has to cope with all the different modalities and has to have a modular and flexible design. But most importantly, it has to be safe and robust. In this paper, we want to present our motion planning pipeline with particle swarm optimization (PSO) at its core. This solution is independent of the vehicle type and has a clear and simple-to-implement interface for perception modules. Moreover, the approach stands out for being easily adaptable to new scenarios. Parallel calculation allows for fast planning cycles. Following the principles of PSO, the trajectory planer first generates a swarm of initial trajectories that are optimized afterward. We present the underlying control space and inner workings. Finally, the application to real-world automated driving is shown in the evaluation with a deeper look at the modeling of the cost function. The approach is used in our automated shuttles that have already driven more than 3.500 km safely and entirely autonomously in sub-urban everyday traffic. △ Less

Submitted 3 April, 2024; originally announced April 2024.

Orientation-Driven Large Magnetic Hysteresis of Er(III) Cyclooctatetraenide-Based Single-Ion Magnets Adsorbed on Ag(100)

Authors: Vladyslav Romankov, Moritz Bernhardt, Martin Heinrich, Diana Vaclavkova, Katie Harriman, Niéli Daffé, Bernard Delley, Maciej Damian Korzyński, Matthias Muntwiler, Christophe Copéret, Muralee Murugesu, Frithjof Nolting, Jan Dreiser

Abstract: The molecular self-assembly and the magnetic properties of two cyclooctatetraenide (COT) - based single-ion magnets (SIM) adsorbed on Ag(100) in the sub-monolayer range are reported. Our study combines scanning-tunneling microscopy, X-ray photoemission spectroscopy and polarized X-ray absorption spectroscopy to show that Cp*ErCOT (Cp* = 1,2,3,4,5-pentamethylcyclopentadienide anion) SIMs self-assem… ▽ More The molecular self-assembly and the magnetic properties of two cyclooctatetraenide (COT) - based single-ion magnets (SIM) adsorbed on Ag(100) in the sub-monolayer range are reported. Our study combines scanning-tunneling microscopy, X-ray photoemission spectroscopy and polarized X-ray absorption spectroscopy to show that Cp*ErCOT (Cp* = 1,2,3,4,5-pentamethylcyclopentadienide anion) SIMs self-assemble as alternating compact parallel rows including standing-up and lying-down conformations, following the main crystallographic directions of the substrate. Conversely, K[Er(COT)$_2$], obtained from subliming the [K(18-c-6)][Er(COT)$_2$]$\cdot$ 2THF salt, forms uniaxially ordered domains with the (COT)$^{2-}$ rings perpendicular to the substrate plane. The polarization-dependent X-ray absorption spectra reproduced by the multiX simulations suggest that the strong in-plane magnetic anisotropy of K[Er(COT)$_2$]/Ag(100) and the weak out-of-plane anisotropy of Cp*ErCOT/Ag(100) can be attributed to the strikingly different surface ordering of these two complexes. Compared to the bulk phase, surface-supported K[Er(COT)$_2$] exhibits a similarly large hysteresis opening, while the Cp*ErCOT shows a rather small opening. This result reveals that despite structural similarities, the two organometallic SMMs have strongly different magnetic properties when adsorbed on the metal substrate, attributed to the different orientations and the resulting interactions of the ligand rings with the surface. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Benchmarking Analytical Query Processing in Intel SGXv2

Authors: Adrian Lutsch, Muhammad El-Hindi, Matthias Heinrich, Daniel Ritter, Zsolt István, Carsten Binnig

Abstract: The recently introduced second generation of Intel SGX (SGXv2) lifts the memory size limitations of the first generation. Theoretically, this promises to enable secure and highly efficient analytical DBMSs in the cloud. To validate this promise, in this paper, we conduct the first in-depth evaluation study of running analytical query processing algorithms inside SGXv2. Our study reveals that state… ▽ More The recently introduced second generation of Intel SGX (SGXv2) lifts the memory size limitations of the first generation. Theoretically, this promises to enable secure and highly efficient analytical DBMSs in the cloud. To validate this promise, in this paper, we conduct the first in-depth evaluation study of running analytical query processing algorithms inside SGXv2. Our study reveals that state-of-the-art query operators like radix joins and SIMD-based scans can indeed achieve high performance inside SGXv2 enclaves. These operations are orders of magnitude faster than joins optimized for the discontinued SGXv1 hardware. However, substantial performance overheads are still caused by subtle hardware and software differences influencing code execution inside an SGX enclave. We investigate these differences and propose new optimizations to bring the performance inside the enclave on par with native code execution outside an enclave. △ Less

Submitted 16 May, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

Comments: 15 pages, 21 figures; changes: updated and extended section 4.2, removed VLDB placeholders, minor textual changes improving clarity

ACM Class: H.2; B.8

Self-organizing Nervous Systems for Robot Swarms

Authors: W. Zhu, S. Oguz, M. K. Heinrich, M. Allwright, M. Wahby, A. Lyhne Christensen, E. Garone, M. Dorigo

Abstract: The system architecture controlling a group of robots is generally set before deployment and can be either centralized or decentralized. This dichotomy is highly constraining, because decentralized systems are typically fully self-organized and therefore difficult to design analytically, whereas centralized systems have single points of failure and limited scalability. To address this dichotomy, w… ▽ More The system architecture controlling a group of robots is generally set before deployment and can be either centralized or decentralized. This dichotomy is highly constraining, because decentralized systems are typically fully self-organized and therefore difficult to design analytically, whereas centralized systems have single points of failure and limited scalability. To address this dichotomy, we present the Self-organizing Nervous System (SoNS), a novel robot swarm architecture based on self-organized hierarchy. The SoNS approach enables robots to autonomously establish, maintain, and reconfigure dynamic multi-level system architectures. For example, a robot swarm consisting of $n$ independent robots could transform into a single $n$-robot SoNS and then into several independent smaller SoNSs, where each SoNS uses a temporary and dynamic hierarchy. Leveraging the SoNS approach, we show that sensing, actuation, and decision-making can be coordinated in a locally centralized way, without sacrificing the benefits of scalability, flexibility, and fault tolerance, for which swarm robotics is usually studied. In several proof-of-concept robot missions -- including binary decision-making and search-and-rescue -- we demonstrate that the capabilities of the SoNS approach greatly advance the state of the art in swarm robotics. The missions are conducted with a real heterogeneous aerial-ground robot swarm, using a custom-developed quadrotor platform. We also demonstrate the scalability of the SoNS approach in swarms of up to 250 robots in a physics-based simulator, and demonstrate several types of system fault tolerance in simulation and reality. △ Less

Submitted 23 January, 2024; originally announced January 2024.

Comments: 135 pages, 62 figues, and 14 embedded videos

Combining Image- and Geometric-based Deep Learning for Shape Regression: A Comparison to Pixel-level Methods for Segmentation in Chest X-Ray

Authors: Ron Keuth, Mattias Heinrich

Abstract: When solving a segmentation task, shaped-base methods can be beneficial compared to pixelwise classification due to geometric understanding of the target object as shape, preventing the generation of anatomical implausible predictions in particular for corrupted data. In this work, we propose a novel hybrid method that combines a lightweight CNN backbone with a geometric neural network (Point Tran… ▽ More When solving a segmentation task, shaped-base methods can be beneficial compared to pixelwise classification due to geometric understanding of the target object as shape, preventing the generation of anatomical implausible predictions in particular for corrupted data. In this work, we propose a novel hybrid method that combines a lightweight CNN backbone with a geometric neural network (Point Transformer) for shape regression. Using the same CNN encoder, the Point Transformer reaches segmentation quality on per with current state-of-the-art convolutional decoders ($4\pm1.9$ vs $3.9\pm2.9$ error in mm and $85\pm13$ vs $88\pm10$ Dice), but crucially, is more stable w.r.t image distortion, starting to outperform them at a corruption level of 30%. Furthermore, we include the nnU-Net as an upper baseline, which has $3.7\times$ more trainable parameters than our proposed method. △ Less

Submitted 15 January, 2024; originally announced January 2024.

Comments: Submitted to German Conference on Medical Image Computing 2024

Self-supervised Learning of Dense Hierarchical Representations for Medical Image Segmentation

Authors: Eytan Kats, Jochen G. Hirsch, Mattias P. Heinrich

Abstract: This paper demonstrates a self-supervised framework for learning voxel-wise coarse-to-fine representations tailored for dense downstream tasks. Our approach stems from the observation that existing methods for hierarchical representation learning tend to prioritize global features over local features due to inherent architectural bias. To address this challenge, we devise a training strategy that… ▽ More This paper demonstrates a self-supervised framework for learning voxel-wise coarse-to-fine representations tailored for dense downstream tasks. Our approach stems from the observation that existing methods for hierarchical representation learning tend to prioritize global features over local features due to inherent architectural bias. To address this challenge, we devise a training strategy that balances the contributions of features from multiple scales, ensuring that the learned representations capture both coarse and fine-grained details. Our strategy incorporates 3-fold improvements: (1) local data augmentations, (2) a hierarchically balanced architecture, and (3) a hybrid contrastive-restorative loss function. We evaluate our method on CT and MRI data and demonstrate that our new approach particularly beneficial for fine-tuning with limited annotated data and consistently outperforms the baseline counterpart in linear evaluation settings. △ Less

Submitted 26 May, 2024; v1 submitted 12 January, 2024; originally announced January 2024.

Comments: Accepted for International Symposium on Biomedical Imaging 2024 (ISBI 2024)

Non-adiabatic holonomies as photonic quantum gates

Authors: Vera Neef, Julien Pinske, Tom A. W. Wolterink, Karo Becker, Matthias Heinrich, Stefan Scheel, Alexander Szameit

Abstract: One of the most promising nascent technologies, quantum computation faces a major challenge: The need for stable computational building blocks. We present the quantum-optical realization of non-adiabatic holonomies that can be used as single-qubit quantum gates. The hallmark topological protection of non-Abelian geometric phases reduces the need for quantum error correction on a fundamental physic… ▽ More One of the most promising nascent technologies, quantum computation faces a major challenge: The need for stable computational building blocks. We present the quantum-optical realization of non-adiabatic holonomies that can be used as single-qubit quantum gates. The hallmark topological protection of non-Abelian geometric phases reduces the need for quantum error correction on a fundamental physical level, while the inherent non-adiabaticity of the structures paves the way for unprecedented miniaturization. To demonstrate their versatility, we realize the Hadamard and Pauli-X gates, experimentally show their non-Abelian nature, and combine them into a single-qubit quantum algorithm, the PQ penny flipover. The planar geometry of such designs enables them to be substituted for the conventional directional coupler meshes currently in wide-spread use in photonic quantum architectures across all platforms. △ Less

Submitted 8 January, 2024; originally announced January 2024.

DG-TTA: Out-of-domain medical image segmentation through Domain Generalization and Test-Time Adaptation

Authors: Christian Weihsbach, Christian N. Kruse, Alexander Bigalke, Mattias P. Heinrich

Abstract: Applying pre-trained medical segmentation models on out-of-domain images often yields predictions of insufficient quality. Several strategies have been proposed to maintain model performance, such as finetuning or unsupervised- and source-free domain adaptation. These strategies set restrictive requirements for data availability. In this study, we propose to combine domain generalization and test-… ▽ More Applying pre-trained medical segmentation models on out-of-domain images often yields predictions of insufficient quality. Several strategies have been proposed to maintain model performance, such as finetuning or unsupervised- and source-free domain adaptation. These strategies set restrictive requirements for data availability. In this study, we propose to combine domain generalization and test-time adaptation to create a highly effective approach for reusing pre-trained models in unseen target domains. Domain-generalized pre-training on source data is used to obtain the best initial performance in the target domain. We introduce the MIND descriptor previously used in image registration tasks as a further technique to achieve generalization and present superior performance for small-scale datasets compared to existing approaches. At test-time, high-quality segmentation for every single unseen scan is ensured by optimizing the model weights for consistency given different image augmentations. That way, our method enables separate use of source and target data and thus removes current data availability barriers. Moreover, the presented method is highly modular as it does not require specific model architectures or prior knowledge of involved domains and labels. We demonstrate this by integrating it into the nnUNet, which is currently the most popular and accurate framework for medical image segmentation. We employ multiple datasets covering abdominal, cardiac, and lumbar spine scans and compose several out-of-domain scenarios in this study. We demonstrate that our method, combined with pre-trained whole-body CT models, can effectively segment MR images with high accuracy in all of the aforementioned scenarios. Open-source code can be found here: https://github.com/multimodallearning/DG-TTA △ Less

Submitted 10 April, 2024; v1 submitted 11 December, 2023; originally announced December 2023.

MSC Class: 92C55 (Primary); 68T07 (Secondary) ACM Class: I.2.6; I.4.6

Shape Matters: Detecting Vertebral Fractures Using Differentiable Point-Based Shape Decoding

Authors: Hellena Hempe, Alexander Bigalke, Mattias P. Heinrich

Abstract: Degenerative spinal pathologies are highly prevalent among the elderly population. Timely diagnosis of osteoporotic fractures and other degenerative deformities facilitates proactive measures to mitigate the risk of severe back pain and disability. In this study, we specifically explore the use of shape auto-encoders for vertebrae, taking advantage of advancements in automated multi-label segmenta… ▽ More Degenerative spinal pathologies are highly prevalent among the elderly population. Timely diagnosis of osteoporotic fractures and other degenerative deformities facilitates proactive measures to mitigate the risk of severe back pain and disability. In this study, we specifically explore the use of shape auto-encoders for vertebrae, taking advantage of advancements in automated multi-label segmentation and the availability of large datasets for unsupervised learning. Our shape auto-encoders are trained on a large set of vertebrae surface patches, leveraging the vast amount of available data for vertebra segmentation. This addresses the label scarcity problem faced when learning shape information of vertebrae from image intensities. Based on the learned shape features we train an MLP to detect vertebral body fractures. Using segmentation masks that were automatically generated using the TotalSegmentator, our proposed method achieves an AUC of 0.901 on the VerSe19 testset. This outperforms image-based and surface-based end-to-end trained models. Additionally, our results demonstrate that pre-training the models in an unsupervised manner enhances geometric methods like PointNet and DGCNN. Our findings emphasise the advantages of explicitly learning shape features for diagnosing osteoporotic vertebrae fractures. This approach improves the reliability of classification results and reduces the need for annotated labels. This study provides novel insights into the effectiveness of various encoder-decoder models for shape analysis of vertebrae and proposes a new decoder architecture: the point-based shape decoder. △ Less

Submitted 8 December, 2023; originally announced December 2023.

Stability of classical shadows under gate-dependent noise

Authors: Raphael Brieger, Markus Heinrich, Ingo Roth, Martin Kliesch

Abstract: Expectation values of observables are routinely estimated using so-called classical shadows$\unicode{x2014}$the outcomes of randomized bases measurements on a repeatedly prepared quantum state. In order to trust the accuracy of shadow estimation in practice, it is crucial to understand the behavior of the estimators under realistic noise. In this work, we prove that any shadow estimation protocol… ▽ More Expectation values of observables are routinely estimated using so-called classical shadows$\unicode{x2014}$the outcomes of randomized bases measurements on a repeatedly prepared quantum state. In order to trust the accuracy of shadow estimation in practice, it is crucial to understand the behavior of the estimators under realistic noise. In this work, we prove that any shadow estimation protocol involving Clifford unitaries is stable under gate-dependent noise for observables with bounded stabilizer norm$\unicode{x2014}$originally introduced in the context of simulating Clifford circuits. For these observables, we also show that the protocol's sample complexity is essentially identical to the noiseless case. In contrast, we demonstrate that estimation of `magic' observables can suffer from a bias that scales exponentially in the system size. We further find that so-called robust shadows, aiming at mitigating noise, can introduce a large bias in the presence of gate-dependent noise compared to unmitigated classical shadows. Nevertheless, we guarantee the functioning of robust shadows for a more general noise setting than in previous works. On a technical level, we identify average noise channels that affect shadow estimators and allow for a more fine-grained control of noise-induced biases. △ Less

Submitted 13 December, 2023; v1 submitted 30 October, 2023; originally announced October 2023.

Comments: 26 pages, 1 figure; v2: Improved presentation of results in the main text

Risk Assessment Graphs: Utilizing Attack Graphs for Risk Assessment

Authors: Simon Unger, Ektor Arzoglou, Markus Heinrich, Dirk Scheuermann, Stefan Katzenbeisser

Abstract: Risk assessment plays a crucial role in ensuring the security and resilience of modern computer systems. Existing methods for conducting risk assessments often suffer from tedious and time-consuming processes, making it challenging to maintain a comprehensive overview of potential security issues. In this paper, we propose a novel approach that leverages attack graphs to enhance the efficiency and… ▽ More Risk assessment plays a crucial role in ensuring the security and resilience of modern computer systems. Existing methods for conducting risk assessments often suffer from tedious and time-consuming processes, making it challenging to maintain a comprehensive overview of potential security issues. In this paper, we propose a novel approach that leverages attack graphs to enhance the efficiency and effectiveness of risk assessment. Attack graphs visually represent the various attack paths that adversaries can exploit within a system, enabling a systematic exploration of potential vulnerabilities. By extending attack graphs with capabilities to include countermeasures and consequences, they can be leveraged to constitute the complete risk assessment process. Our method offers a more streamlined and comprehensive analysis of system vulnerabilities, where system changes, or environment changes can easily be adapted and the issues exposing the highest risk can easily be identified. We demonstrate the effectiveness of our approach through a case study, as well as the applicability by combining existing risk assessment standards with our method. Our work aims to bridge the gap between risk assessment practices and evolving threat landscapes, offering an improved methodology for managing and mitigating risks in modern computer systems. △ Less

Submitted 26 July, 2023; originally announced July 2023.

Time-optimal multi-qubit gates: Complexity, efficient heuristic and gate-time bounds

Authors: Pascal Baßler, Markus Heinrich, Martin Kliesch

Abstract: Multi-qubit entangling interactions arise naturally in several quantum computing platforms and promise advantages over traditional two-qubit gates. In particular, a fixed multi-qubit Ising-type interaction together with single-qubit X-gates can be used to synthesize global ZZ-gates (GZZ gates). In this work, we first show that the synthesis of such quantum gates that are time-optimal is NP-hard. S… ▽ More Multi-qubit entangling interactions arise naturally in several quantum computing platforms and promise advantages over traditional two-qubit gates. In particular, a fixed multi-qubit Ising-type interaction together with single-qubit X-gates can be used to synthesize global ZZ-gates (GZZ gates). In this work, we first show that the synthesis of such quantum gates that are time-optimal is NP-hard. Second, we provide explicit constructions of special time-optimal multi-qubit gates. They have constant gate times and can be implemented with linearly many X-gate layers. Third, we develop a heuristic algorithm with polynomial runtime for synthesizing fast multi-qubit gates. Fourth, we derive lower and upper bounds on the optimal GZZ gate-time. Based on explicit constructions of GZZ gates and numerical studies, we conjecture that any GZZ gate can be executed in a time O(n) for n qubits. Our heuristic synthesis algorithm leads to GZZ gate-times with a similar scaling, which is optimal in this sense. We expect that our efficient synthesis of fast multi-qubit gates allows for faster and, hence, also more error-robust execution of quantum algorithms. △ Less

Submitted 5 March, 2024; v1 submitted 20 July, 2023; originally announced July 2023.

Comments: 19+4 pages, 2 figures

Journal ref: Quantum 8, 1279 (2024)

Airway Label Prediction in Video Bronchoscopy: Capturing Temporal Dependencies Utilizing Anatomical Knowledge

Authors: Ron Keuth, Mattias Heinrich, Martin Eichenlaub, Marian Himstedt

Abstract: Purpose: Navigation guidance is a key requirement for a multitude of lung interventions using video bronchoscopy. State-of-the-art solutions focus on lung biopsies using electromagnetic tracking and intraoperative image registration w.r.t. preoperative CT scans for guidance. The requirement of patient-specific CT scans hampers the utilisation of navigation guidance for other applications such as i… ▽ More Purpose: Navigation guidance is a key requirement for a multitude of lung interventions using video bronchoscopy. State-of-the-art solutions focus on lung biopsies using electromagnetic tracking and intraoperative image registration w.r.t. preoperative CT scans for guidance. The requirement of patient-specific CT scans hampers the utilisation of navigation guidance for other applications such as intensive care units. Methods: This paper addresses navigation guidance solely incorporating bronchosopy video data. In contrast to state-of-the-art approaches we entirely omit the use of electromagnetic tracking and patient-specific CT scans. Guidance is enabled by means of topological bronchoscope localization w.r.t. an interpatient airway model. Particularly, we take maximally advantage of anatomical constraints of airway trees being sequentially traversed. This is realized by incorporating sequences of CNN-based airway likelihoods into a Hidden Markov Model. Results: Our approach is evaluated based on multiple experiments inside a lung phantom model. With the consideration of temporal context and use of anatomical knowledge for regularization, we are able to improve the accuracy up to to 0.98 compared to 0.81 (weighted F1: 0.98 compared to 0.81) for a classification based on individual frames. Conclusion: We combine CNN-based single image classification of airway segments with anatomical constraints and temporal HMM-based inference for the first time. Our approach renders vision-only guidance for bronchoscopy interventions in the absence of electromagnetic tracking and patient-specific CT scans possible. △ Less

Submitted 17 July, 2023; originally announced July 2023.

Comments: Submitted to International Journal of Computer Assisted Radiology and Surgery

Journal ref: International Journal of Computer Assisted Radiology and Surgery 2024

Unsupervised 3D registration through optimization-guided cyclical self-training

Authors: Alexander Bigalke, Lasse Hansen, Tony C. W. Mok, Mattias P. Heinrich

Abstract: State-of-the-art deep learning-based registration methods employ three different learning strategies: supervised learning, which requires costly manual annotations, unsupervised learning, which heavily relies on hand-crafted similarity metrics designed by domain experts, or learning from synthetic data, which introduces a domain shift. To overcome the limitations of these strategies, we propose a… ▽ More State-of-the-art deep learning-based registration methods employ three different learning strategies: supervised learning, which requires costly manual annotations, unsupervised learning, which heavily relies on hand-crafted similarity metrics designed by domain experts, or learning from synthetic data, which introduces a domain shift. To overcome the limitations of these strategies, we propose a novel self-supervised learning paradigm for unsupervised registration, relying on self-training. Our idea is based on two key insights. Feature-based differentiable optimizers 1) perform reasonable registration even from random features and 2) stabilize the training of the preceding feature extraction network on noisy labels. Consequently, we propose cyclical self-training, where pseudo labels are initialized as the displacement fields inferred from random features and cyclically updated based on more and more expressive features from the learning feature extractor, yielding a self-reinforcement effect. We evaluate the method for abdomen and lung registration, consistently surpassing metric-based supervision and outperforming diverse state-of-the-art competitors. Source code is available at https://github.com/multimodallearning/reg-cyclical-self-train. △ Less

Submitted 20 July, 2023; v1 submitted 29 June, 2023; originally announced June 2023.

Comments: accepted at MICCAI 2023

A denoised Mean Teacher for domain adaptive point cloud registration

Authors: Alexander Bigalke, Mattias P. Heinrich

Abstract: Point cloud-based medical registration promises increased computational efficiency, robustness to intensity shifts, and anonymity preservation but is limited by the inefficacy of unsupervised learning with similarity metrics. Supervised training on synthetic deformations is an alternative but, in turn, suffers from the domain gap to the real domain. In this work, we aim to tackle this gap through… ▽ More Point cloud-based medical registration promises increased computational efficiency, robustness to intensity shifts, and anonymity preservation but is limited by the inefficacy of unsupervised learning with similarity metrics. Supervised training on synthetic deformations is an alternative but, in turn, suffers from the domain gap to the real domain. In this work, we aim to tackle this gap through domain adaptation. Self-training with the Mean Teacher is an established approach to this problem but is impaired by the inherent noise of the pseudo labels from the teacher. As a remedy, we present a denoised teacher-student paradigm for point cloud registration, comprising two complementary denoising strategies. First, we propose to filter pseudo labels based on the Chamfer distances of teacher and student registrations, thus preventing detrimental supervision by the teacher. Second, we make the teacher dynamically synthesize novel training pairs with noise-free labels by war** its moving inputs with the predicted deformations. Evaluation is performed for inhale-to-exhale registration of lung vessel trees on the public PVT dataset under two domain shifts. Our method surpasses the baseline Mean Teacher by 13.5/62.8%, consistently outperforms diverse competitors, and sets a new state-of-the-art accuracy (TRE=2.31mm). Code is available at https://github.com/multimodallearning/denoised_mt_pcd_reg. △ Less

Submitted 4 July, 2023; v1 submitted 26 June, 2023; originally announced June 2023.

Comments: early accepted at MICCAI 2023; corrected confused reference

Why is the winner the best?

Authors: Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu Dietlinde Tizabi, Fabian Isensee, Tim J. Adler, Sharib Ali, Vincent Andrearczyk, Marc Aubreville, Ujjwal Baid, Spyridon Bakas, Niranjan Balu, Sophia Bano, Jorge Bernal, Sebastian Bodenstedt, Alessandro Casella, Veronika Cheplygina, Marie Daum, Marleen de Bruijne, Adrien Depeursinge, Reuben Dorent, Jan Egger, David G. Ellis, Sandy Engelhardt, Melanie Ganz , et al. (100 additional authors not shown)

Abstract: International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To addre… ▽ More International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multi-center study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on comprehensive descriptions of the submitted algorithms linked to their rank as well as the underlying participation strategies revealed common characteristics of winning solutions. These typically include the use of multi-task learning (63%) and/or multi-stage pipelines (61%), and a focus on augmentation (100%), image preprocessing (97%), data curation (79%), and postprocessing (66%). The "typical" lead of a winning team is a computer scientist with a doctoral degree, five years of experience in biomedical image analysis, and four years of experience in deep learning. Two core general development strategies stood out for highly-ranked teams: the reflection of the metrics in the method design and the focus on analyzing and handling failure cases. According to the organizers, 43% of the winning algorithms exceeded the state of the art but only 11% completely solved the respective domain problem. The insights of our study could help researchers (1) improve algorithm development strategies when approaching new problems, and (2) focus on open research questions revealed by this work. △ Less

Submitted 30 March, 2023; originally announced March 2023.

Comments: accepted to CVPR 2023

Order-invariant two-photon quantum correlations in PT-symmetric interferometers

Authors: Tom A. W. Wolterink, Matthias Heinrich, Stefan Scheel, Alexander Szameit

Abstract: Multiphoton correlations in linear photonic quantum networks are governed by matrix permanents. Yet, surprisingly few systematic properties of these crucial algebraic objects are known, while their calculation is a computationally hard task. As such, predicting the overall multiphoton behavior of a network from its individual building blocks typically defies intuition. In this work we identify seq… ▽ More Multiphoton correlations in linear photonic quantum networks are governed by matrix permanents. Yet, surprisingly few systematic properties of these crucial algebraic objects are known, while their calculation is a computationally hard task. As such, predicting the overall multiphoton behavior of a network from its individual building blocks typically defies intuition. In this work we identify sequences of concatenated two-mode linear optical transformations whose two-photon behavior is invariant under reversal of the order. We experimentally verify this systematic behavior in parity-time-symmetric complex interferometer arrangements of varying composition. Our results underline new ways in which quantum correlations may be preserved in counterintuitive ways even in small-scale non-Hermitian networks. △ Less

Submitted 23 February, 2023; originally announced February 2023.

Comments: 7 pages, 4 figures

The Touché23-ValueEval Dataset for Identifying Human Values behind Arguments

Authors: Nailia Mirzakhmedova, Johannes Kiesel, Milad Alshomary, Maximilian Heinrich, Nicolas Handke, Xiaoni Cai, Barriere Valentin, Doratossadat Dastgheib, Omid Ghahroodi, Mohammad Ali Sadraei, Ehsaneddin Asgari, Lea Kawaletz, Henning Wachsmuth, Benno Stein

Abstract: We present the Touché23-ValueEval Dataset for Identifying Human Values behind Arguments. To investigate approaches for the automated detection of human values behind arguments, we collected 9324 arguments from 6 diverse sources, covering religious texts, political discussions, free-text arguments, newspaper editorials, and online democracy platforms. Each argument was annotated by 3 crowdworkers f… ▽ More We present the Touché23-ValueEval Dataset for Identifying Human Values behind Arguments. To investigate approaches for the automated detection of human values behind arguments, we collected 9324 arguments from 6 diverse sources, covering religious texts, political discussions, free-text arguments, newspaper editorials, and online democracy platforms. Each argument was annotated by 3 crowdworkers for 54 values. The Touché23-ValueEval dataset extends the Webis-ArgValues-22. In comparison to the previous dataset, the effectiveness of a 1-Baseline decreases, but that of an out-of-the-box BERT model increases. Therefore, though the classification difficulty increased as per the label distribution, the larger dataset allows for training better models. △ Less

Submitted 31 January, 2023; originally announced January 2023.

Biomedical image analysis competitions: The state of current participation practice

Authors: Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu Dietlinde Tizabi, Fabian Isensee, Tim J. Adler, Patrick Godau, Veronika Cheplygina, Michal Kozubek, Sharib Ali, Anubha Gupta, Jan Kybic, Alison Noble, Carlos Ortiz de Solórzano, Samiksha Pachade, Caroline Petitjean, Daniel Sage, Donglai Wei, Elizabeth Wilden, Deepak Alapatt, Vincent Andrearczyk, Ujjwal Baid, Spyridon Bakas, Niranjan Balu, Sophia Bano , et al. (331 additional authors not shown)

Abstract: The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis,… ▽ More The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis, we designed an international survey that was issued to all participants of challenges conducted in conjunction with the IEEE ISBI 2021 and MICCAI 2021 conferences (80 competitions in total). The survey covered participants' expertise and working environments, their chosen strategies, as well as algorithm characteristics. A median of 72% challenge participants took part in the survey. According to our results, knowledge exchange was the primary incentive (70%) for participation, while the reception of prize money played only a minor role (16%). While a median of 80 working hours was spent on method development, a large portion of participants stated that they did not have enough time for method development (32%). 25% perceived the infrastructure to be a bottleneck. Overall, 94% of all solutions were deep learning-based. Of these, 84% were based on standard architectures. 43% of the respondents reported that the data samples (e.g., images) were too large to be processed at once. This was most commonly addressed by patch-based training (69%), downsampling (37%), and solving 3D analysis tasks as a series of 2D tasks. K-fold cross-validation on the training set was performed by only 37% of the participants and only 50% of the participants performed ensembling based on multiple identical models (61%) or heterogeneous models (39%). 48% of the respondents applied postprocessing steps. △ Less

Submitted 12 September, 2023; v1 submitted 16 December, 2022; originally announced December 2022.

Randomized benchmarking with random quantum circuits

Authors: Markus Heinrich, Martin Kliesch, Ingo Roth

Abstract: In its many variants, randomized benchmarking (RB) is a broadly used technique for assessing the quality of gate implementations on quantum computers. A detailed theoretical understanding and general guarantees exist for the functioning and interpretation of RB protocols if the gates under scrutiny are drawn uniformly at random from a compact group. In contrast, many practically attractive and sca… ▽ More In its many variants, randomized benchmarking (RB) is a broadly used technique for assessing the quality of gate implementations on quantum computers. A detailed theoretical understanding and general guarantees exist for the functioning and interpretation of RB protocols if the gates under scrutiny are drawn uniformly at random from a compact group. In contrast, many practically attractive and scalable RB protocols implement random quantum circuits with local gates randomly drawn from some gate-set. Despite their abundance in practice, for those non-uniform RB protocols, general guarantees for gates from arbitrary compact groups under experimentally plausible assumptions are missing. In this work, we derive such guarantees for a large class of RB protocols for random circuits that we refer to as filtered RB. Prominent examples include linear cross-entropy benchmarking, character benchmarking, Pauli-noise tomography and variants of simultaneous RB. Building upon recent results for random circuits, we show that many relevant filtered RB schemes can be realized with random quantum circuits in linear depth, and we provide explicit small constants for common instances. We further derive general sample complexity bounds for filtered RB. We show filtered RB to be sample-efficient for several relevant groups, including protocols addressing higher-order cross-talk. Our theory for non-uniform filtered RB is, in principle, flexible enough to design new protocols for non-universal and analog quantum simulators. △ Less

Submitted 27 June, 2023; v1 submitted 12 December, 2022; originally announced December 2022.

Comments: 59 pages, 5 figures. Accepted for a talk at QIP 2023. v3: more accessible overview of results and high-level discussion; improved structure and readability

Anatomy-guided domain adaptation for 3D in-bed human pose estimation

Authors: Alexander Bigalke, Lasse Hansen, Jasper Diesel, Carlotta Hennigs, Philipp Rostalski, Mattias P. Heinrich

Abstract: 3D human pose estimation is a key component of clinical monitoring systems. The clinical applicability of deep pose estimation models, however, is limited by their poor generalization under domain shifts along with their need for sufficient labeled training data. As a remedy, we present a novel domain adaptation method, adapting a model from a labeled source to a shifted unlabeled target domain. O… ▽ More 3D human pose estimation is a key component of clinical monitoring systems. The clinical applicability of deep pose estimation models, however, is limited by their poor generalization under domain shifts along with their need for sufficient labeled training data. As a remedy, we present a novel domain adaptation method, adapting a model from a labeled source to a shifted unlabeled target domain. Our method comprises two complementary adaptation strategies based on prior knowledge about human anatomy. First, we guide the learning process in the target domain by constraining predictions to the space of anatomically plausible poses. To this end, we embed the prior knowledge into an anatomical loss function that penalizes asymmetric limb lengths, implausible bone lengths, and implausible joint angles. Second, we propose to filter pseudo labels for self-training according to their anatomical plausibility and incorporate the concept into the Mean Teacher paradigm. We unify both strategies in a point cloud-based framework applicable to unsupervised and source-free domain adaptation. Evaluation is performed for in-bed pose estimation under two adaptation scenarios, using the public SLP dataset and a newly created dataset. Our method consistently outperforms various state-of-the-art domain adaptation methods, surpasses the baseline model by 31%/66%, and reduces the domain gap by 65%/82%. Source code is available at https://github.com/multimodallearning/da-3dhpe-anatomy. △ Less

Submitted 4 July, 2023; v1 submitted 22 November, 2022; originally announced November 2022.

Comments: accepted at Medical Image Analysis

Journal ref: Medical Image Analysis 89, 2023, 102887

Closed-form analytic expressions for shadow estimation with brickwork circuits

Authors: Mirko Arienzo, Markus Heinrich, Ingo Roth, Martin Kliesch

Abstract: Properties of quantum systems can be estimated using classical shadows, which implement measurements based on random ensembles of unitaries. Originally derived for global Clifford unitaries and products of single-qubit Clifford gates, practical implementations are limited to the latter scheme for moderate numbers of qubits. Beyond local gates, the accurate implementation of very short random circu… ▽ More Properties of quantum systems can be estimated using classical shadows, which implement measurements based on random ensembles of unitaries. Originally derived for global Clifford unitaries and products of single-qubit Clifford gates, practical implementations are limited to the latter scheme for moderate numbers of qubits. Beyond local gates, the accurate implementation of very short random circuits with two-local gates is still experimentally feasible and, therefore, interesting for implementing measurements in near-term applications. In this work, we derive closed-form analytical expressions for shadow estimation using brickwork circuits with two layers of parallel two-local Haar-random (or Clifford) unitaries. Besides the construction of the classical shadow, our results give rise to sample-complexity guarantees for estimating Pauli observables. We then compare the performance of shadow estimation with brickwork circuits to the established approach using local Clifford unitaries and find improved sample complexity in the estimation of observables supported on sufficiently many qubits. △ Less

Submitted 22 September, 2023; v1 submitted 17 November, 2022; originally announced November 2022.

Comments: 15+12 pages, several figures; v2: small improvements and new examples. Close to published version

Journal ref: QIC Vol.23 No.11&12 (2023) pp961-993

Supersymmetric resha** and higher-dimensional rearrangement of photonic lattices

Authors: Tom A. W. Wolterink, Matthias Heinrich, Alexander Szameit

Abstract: Integrated Jx photonic lattices, inspired by the quantum harmonic oscillator and due to their equidistant eigenvalue spectrum, have been proven extremely useful for various applications, such as perfect imaging and coherent transfer of quantum states. However, to date their large-scale implementation remains challenging. We apply concepts from supersymmetry to construct two-dimensional (2D) system… ▽ More Integrated Jx photonic lattices, inspired by the quantum harmonic oscillator and due to their equidistant eigenvalue spectrum, have been proven extremely useful for various applications, such as perfect imaging and coherent transfer of quantum states. However, to date their large-scale implementation remains challenging. We apply concepts from supersymmetry to construct two-dimensional (2D) systems with spectra identical to that of one-dimensional (1D) Jx lattices. While exhibiting different dynamics, these 2D systems retain the key imaging and state transfer properties of the 1D Jx lattice. Our method extends to other systems with separable spectra, facilitates experimental fabrication, and may increase robustness to fabrication imperfections in large-scale photonic circuits. △ Less

Submitted 26 September, 2022; originally announced September 2022.

Comments: 5 pages, 4 figures

Weakly Supervised Airway Orifice Segmentation in Video Bronchoscopy

Authors: Ron Keuth, Mattias Heinrich, Martin Eichenlaub, Marian Himstedt

Abstract: Video bronchoscopy is routinely conducted for biopsies of lung tissue suspected for cancer, monitoring of COPD patients and clarification of acute respiratory problems at intensive care units. The navigation within complex bronchial trees is particularly challenging and physically demanding, requiring long-term experiences of physicians. This paper addresses the automatic segmentation of bronchial… ▽ More Video bronchoscopy is routinely conducted for biopsies of lung tissue suspected for cancer, monitoring of COPD patients and clarification of acute respiratory problems at intensive care units. The navigation within complex bronchial trees is particularly challenging and physically demanding, requiring long-term experiences of physicians. This paper addresses the automatic segmentation of bronchial orifices in bronchoscopy videos. Deep learning-based approaches to this task are currently hampered due to the lack of readily-available ground truth segmentation data. Thus, we present a data-driven pipeline consisting of a k-means followed by a compact marker-based watershed algorithm which enables to generate airway instance segmentation maps from given depth images. In this way, these traditional algorithms serve as weak supervision for training a shallow CNN directly on RGB images solely based on a phantom dataset. We evaluate generalization capabilities of this model on two in-vivo datasets covering 250 frames on 21 different bronchoscopies. We demonstrate that its performance is comparable to those models being directly trained on in-vivo data, reaching an average error of 11 vs 5 pixels for the detected centers of the airway segmentation by an image resolution of 128x128. Our quantitative and qualitative results indicate that in the context of video bronchoscopy, phantom data and weak supervision using non-learning-based approaches enable to gain a semantic understanding of airway structures. △ Less

Submitted 24 August, 2022; originally announced August 2022.

Comments: 5 Pages, 2 figures, only supplemental file, submitted to SPIE MI

Journal ref: SPIE Medical Imaging 2023: Image Processing

Learn2Trust: A video and streamlit-based educational programme for AI-based medical image analysis targeted towards medical students

Authors: Hanna Siebert, Marian Himstedt, Mattias Heinrich

Abstract: In order to be able to use artificial intelligence (AI) in medicine without scepticism and to recognise and assess its growing potential, a basic understanding of this topic is necessary among current and future medical staff. Under the premise of "trust through understanding", we developed an innovative online course as a learning opportunity within the framework of the German KI Campus (AI campu… ▽ More In order to be able to use artificial intelligence (AI) in medicine without scepticism and to recognise and assess its growing potential, a basic understanding of this topic is necessary among current and future medical staff. Under the premise of "trust through understanding", we developed an innovative online course as a learning opportunity within the framework of the German KI Campus (AI campus) project, which is a self-guided course that teaches the basics of AI for the analysis of medical image data. The main goal is to provide a learning environment for a sufficient understanding of AI in medical image analysis so that further interest in this topic is stimulated and inhibitions towards its use can be overcome by means of positive application experience. The focus was on medical applications and the fundamentals of machine learning. The online course was divided into consecutive lessons, which include theory in the form of explanatory videos, practical exercises in the form of Streamlit and practical exercises and/or quizzes to check learning progress. A survey among the participating medical students in the first run of the course was used to analyse our research hypotheses quantitatively. △ Less

Submitted 15 August, 2022; originally announced August 2022.

Comments: 5 pages

Adapting the Mean Teacher for keypoint-based lung registration under geometric domain shifts

Authors: Alexander Bigalke, Lasse Hansen, Mattias P. Heinrich

Abstract: Recent deep learning-based methods for medical image registration achieve results that are competitive with conventional optimization algorithms at reduced run times. However, deep neural networks generally require plenty of labeled training data and are vulnerable to domain shifts between training and test data. While typical intensity shifts can be mitigated by keypoint-based registration, these… ▽ More Recent deep learning-based methods for medical image registration achieve results that are competitive with conventional optimization algorithms at reduced run times. However, deep neural networks generally require plenty of labeled training data and are vulnerable to domain shifts between training and test data. While typical intensity shifts can be mitigated by keypoint-based registration, these methods still suffer from geometric domain shifts, for instance, due to different fields of view. As a remedy, in this work, we present a novel approach to geometric domain adaptation for image registration, adapting a model from a labeled source to an unlabeled target domain. We build on a keypoint-based registration model, combining graph convolutions for geometric feature learning with loopy belief optimization, and propose to reduce the domain shift through self-ensembling. To this end, we embed the model into the Mean Teacher paradigm. We extend the Mean Teacher to this context by 1) adapting the stochastic augmentation scheme and 2) combining learned feature extraction with differentiable optimization. This enables us to guide the learning process in the unlabeled target domain by enforcing consistent predictions of the learning student and the temporally averaged teacher model. We evaluate the method for exhale-to-inhale lung CT registration under two challenging adaptation scenarios (DIR-Lab 4D CT to COPD, COPD to Learn2Reg). Our method consistently improves on the baseline model by 50%/47% while even matching the accuracy of models trained on target data. Source code is available at https://github.com/multimodallearning/registration-da-mean-teacher. △ Less

Submitted 1 July, 2022; originally announced July 2022.

Comments: 11 pages, accepted at MICCAI 2022

Synthesis of and compilation with time-optimal multi-qubit gates

Authors: Pascal Baßler, Matthias Zipper, Christopher Cedzich, Markus Heinrich, Patrick H. Huber, Michael Johanning, Martin Kliesch

Abstract: We develop a method to synthesize a class of entangling multi-qubit gates for a quantum computing platform with fixed Ising-type interaction with all-to-all connectivity. The only requirement on the flexibility of the interaction is that it can be switched on and off for individual qubits. Our method yields a time-optimal implementation of the multi-qubit gates. We numerically demonstrate that the… ▽ More We develop a method to synthesize a class of entangling multi-qubit gates for a quantum computing platform with fixed Ising-type interaction with all-to-all connectivity. The only requirement on the flexibility of the interaction is that it can be switched on and off for individual qubits. Our method yields a time-optimal implementation of the multi-qubit gates. We numerically demonstrate that the total multi-qubit gate time scales approximately linear in the number of qubits. Using this gate synthesis as a subroutine, we provide compilation strategies for important use cases: (i) we show that any Clifford circuit on $n$ qubits can be implemented using at most $2n$ multi-qubit gates without requiring ancilla qubits, (ii) we decompose the quantum Fourier transform in a similar fashion, (iii) we compile a simulation of molecular dynamics, and (iv) we propose a method for the compilation of diagonal unitaries with time-optimal multi-qubit gates, as a step towards general unitaries. As motivation, we provide a detailed discussion on a microwave controlled ion trap architecture with magnetic gradient induced coupling (MAGIC) for the generation of the Ising-type interactions. △ Less

Submitted 14 April, 2023; v1 submitted 13 June, 2022; originally announced June 2022.

Comments: 35 pages, 7 figures, v2: improved section 3.2.3 + new example

Journal ref: Quantum 7, 984 (2023)

Automatic Generation of Synthetic Colonoscopy Videos for Domain Randomization

Authors: Abhishek Dinkar Jagtap, Mattias Heinrich, Marian Himstedt

Abstract: An increasing number of colonoscopic guidance and assistance systems rely on machine learning algorithms which require a large amount of high-quality training data. In order to ensure high performance, the latter has to resemble a substantial portion of possible configurations. This particularly addresses varying anatomy, mucosa appearance and image sensor characteristics which are likely deterior… ▽ More An increasing number of colonoscopic guidance and assistance systems rely on machine learning algorithms which require a large amount of high-quality training data. In order to ensure high performance, the latter has to resemble a substantial portion of possible configurations. This particularly addresses varying anatomy, mucosa appearance and image sensor characteristics which are likely deteriorated by motion blur and inadequate illumination. The limited amount of readily available training data hampers to account for all of these possible configurations which results in reduced generalization capabilities of machine learning models. We propose an exemplary solution for synthesizing colonoscopy videos with substantial appearance and anatomical variations which enables to learn discriminative domain-randomized representations of the interior colon while mimicking real-world settings. △ Less

Submitted 20 May, 2022; originally announced May 2022.

Comments: 4 pages, 5 figures

An Application of Scenario Exploration to Find New Scenarios for the Development and Testing of Automated Driving Systems in Urban Scenarios

Authors: Barbara Schütt, Marc Heinrich, Sonja Marahrens, J. Marius Zöllner, Eric Sax

Abstract: Verification and validation are major challenges for develo** automated driving systems. A concept that gets more and more recognized for testing in automated driving is scenario-based testing. However, it introduces the problem of what scenarios are relevant for testing and which are not. This work aims to find relevant, interesting, or critical parameter sets within logical scenarios by utiliz… ▽ More Verification and validation are major challenges for develo** automated driving systems. A concept that gets more and more recognized for testing in automated driving is scenario-based testing. However, it introduces the problem of what scenarios are relevant for testing and which are not. This work aims to find relevant, interesting, or critical parameter sets within logical scenarios by utilizing Bayes optimization and Gaussian processes. The parameter optimization is done by comparing and evaluating six different metrics in two urban intersection scenarios. Finally, a list of ideas this work leads to and should be investigated further is presented. △ Less

Submitted 17 May, 2022; originally announced May 2022.

Comments: Proceedings of the 8th International Conference on Vehicle Technology and Intelligent Transport Systems (VEHITS 2022)

Three-dimensional photonic topological insulator induced by lattice dislocations

Authors: Eran Lustig, Lukas J. Maczewsky, Julius Beck, Tobias Biesenthal, Matthias Heinrich, Zhaoju Yang, Yonatan Plotnik, Alexander Szameit, Mordechai Segev

Abstract: The hallmark of topological insulators is the scatter-free propagation of waves in topologically protected edge channels. This transport is strictly chiral on the outer edge of the medium, and therefore capable of bypassing sharp corners and imperfections, even in the presence of substantial disorder. In photonics, two-dimensional topological edge states have been demonstrated on several different… ▽ More The hallmark of topological insulators is the scatter-free propagation of waves in topologically protected edge channels. This transport is strictly chiral on the outer edge of the medium, and therefore capable of bypassing sharp corners and imperfections, even in the presence of substantial disorder. In photonics, two-dimensional topological edge states have been demonstrated on several different platforms, and are emerging as a promising tool for robust lasers, quantum devices, and other applications. However, three-dimensional photonic topological insulators, specifically those supporting topologically protected edge states in all 3D, have thus far remained out of experimental reach. Here, we demonstrate a three-dimensional photonic topological insulator with protected topological edge states. The topological protection is enabled by a screw dislocation. For this purpose, we utilize the concept of synthetic dimensions in a 2D photonic waveguide array by introducing an additional modal dimension to transform the system into a 3D photonic topological insulator. The lattice dislocation endows the system with edge states propagating along three-dimensional trajectories, with topological protection akin to strong photonic topological insulators. Our work paves the way for utilizing three-dimensional topology in photonic science and technology. △ Less

Submitted 28 April, 2022; originally announced April 2022.

Persistent Memory Objects: Fast and Easy Crash Consistency for Persistent Memory

Authors: Derrick Greenspan, Naveed Ul Mustafa, Zoran Kolega, Mark Heinrich, Yan Solihin

Abstract: DIMM-compatible persistent memory unites memory and storage. Prior works utilize persistent memory either by combining the filesystem with direct access on memory mapped files or by managing it as a collection of objects while abolishing the POSIX abstraction. In contrast, we propose retaining the POSIX abstraction and extending it to provide support for persistent memory, using Persistent Memory… ▽ More DIMM-compatible persistent memory unites memory and storage. Prior works utilize persistent memory either by combining the filesystem with direct access on memory mapped files or by managing it as a collection of objects while abolishing the POSIX abstraction. In contrast, we propose retaining the POSIX abstraction and extending it to provide support for persistent memory, using Persistent Memory Objects (PMOs). In this work, we design and implement PMOs, a crash-consistent abstraction for managing persistent memory. We introduce psync, a single system call, that a programmer can use to specify crash consistency points in their code, without needing to orchestrate durability explicitly. When rendering data crash consistent, our design incurs a overhead of $\approx 25\%$ and $\approx 21\%$ for parallel workloads and FileBench, respectively, compared to a system without crash consistency. Compared to NOVA-Fortis, our design provides a speedup of $\approx 1.67\times$ and $\approx 3\times$ for the two set of benchmarks, respectively. △ Less

Submitted 7 April, 2022; originally announced April 2022.

Comments: 12 pages, 15 figures

Short and local transformations between ($Δ+1$)-colorings

Authors: Nicolas Bousquet, Laurent Feuilloley, Marc Heinrich, Mikaël Rabie

Abstract: Recoloring a graph is about finding a sequence of proper colorings of this graph from an initial coloring $σ$ to a target coloring $η$. Adding the constraint that each pair of consecutive colorings must differ on exactly one vertex, one asks: Is there a sequence of colorings from $σ$ to $η$? If yes, how short can it be? In this paper, we focus on $(Δ+1)$-colorings of graphs of maximum degree… ▽ More Recoloring a graph is about finding a sequence of proper colorings of this graph from an initial coloring $σ$ to a target coloring $η$. Adding the constraint that each pair of consecutive colorings must differ on exactly one vertex, one asks: Is there a sequence of colorings from $σ$ to $η$? If yes, how short can it be? In this paper, we focus on $(Δ+1)$-colorings of graphs of maximum degree $Δ$. Feghali, Johnson and Paulusma proved that, if both colorings are non-frozen (i.e. we can change the color of a least one vertex), then a quadratic recoloring sequence always exists. We improve their result by proving that there actually exists a linear transformation (assuming that $Δ$ is a constant). In addition, we prove that the core of our algorithm can be performed locally. Informally, this means that after some preprocessing, the color changes that a given node has to perform only depend on the colors of the vertices in a constant size neighborhood. We make this precise by designing of an efficient recoloring algorithm in the LOCAL model of distributed computing. △ Less

Submitted 26 September, 2023; v1 submitted 16 March, 2022; originally announced March 2022.

Comments: Second version. Section 1 has been rewritten

Voxelmorph++ Going beyond the cranial vault with keypoint supervision and multi-channel instance optimisation

Authors: Mattias P. Heinrich, Lasse Hansen

Abstract: The majority of current research in deep learning based image registration addresses inter-patient brain registration with moderate deformation magnitudes. The recent Learn2Reg medical registration benchmark has demonstrated that single-scale U-Net architectures, such as VoxelMorph that directly employ a spatial transformer loss, often do not generalise well beyond the cranial vault and fall short… ▽ More The majority of current research in deep learning based image registration addresses inter-patient brain registration with moderate deformation magnitudes. The recent Learn2Reg medical registration benchmark has demonstrated that single-scale U-Net architectures, such as VoxelMorph that directly employ a spatial transformer loss, often do not generalise well beyond the cranial vault and fall short of state-of-the-art performance for abdominal or intra-patient lung registration. Here, we propose two straightforward steps that greatly reduce this gap in accuracy. First, we employ keypoint self-supervision with a novel network head that predicts a discretised heatmap and robustly reduces large deformations for better robustness. Second, we replace multiple learned fine-tuning steps by a single instance optimisation with hand-crafted features and the Adam optimiser. Different to other related work, including FlowNet or PDD-Net, our approach does not require a fully discretised architecture with correlation layer. Our ablation study demonstrates the importance of keypoints in both self-supervised and unsupervised (using only a MIND metric) settings. On a multi-centric inspiration-exhale lung CT dataset, including very challenging COPD scans, our method outperforms VoxelMorph by improving nonlinear alignment by 77% compared to 19% - reaching target registration errors of 2 mm that outperform all but one learning methods published to date. Extending the method to semantic features sets new stat-of-the-art performance on inter-subject abdominal CT registration. △ Less

Submitted 28 February, 2022; originally announced March 2022.

Comments: 10 pages, accepted at WBIR 2022

Bimorphic Floquet Topological Insulators

Authors: Georgios G. Pyrialakos, Julius Beck, Matthias Heinrich, Lukas J. Maczewsky, Nikolaos V. Kantartzis, Mercedeh Khajavikhan, Alexander Szameit, Demetrios N. Christodoulides

Abstract: Topological theories have established a new set of rules that govern the transport properties in a wide variety of wave-mechanical settings. In a marked departure from the established approaches that induce Floquet topological phases by specifically tailored discrete coupling protocols or helical lattice motions, we introduce a new class of bimorphic Floquet topological insulators that leverage co… ▽ More Topological theories have established a new set of rules that govern the transport properties in a wide variety of wave-mechanical settings. In a marked departure from the established approaches that induce Floquet topological phases by specifically tailored discrete coupling protocols or helical lattice motions, we introduce a new class of bimorphic Floquet topological insulators that leverage connective chains with periodically modulated on-site potentials to unlock new topological features in the system. In exploring a 'chain-driven' generalization of the archetypical Floquet honeycomb lattice, we identify a rich phase structure that can host multiple non-trivial topological phases associated simultaneously with both Chern-type and anomalous chiral states. Experiments carried out in photonic waveguide lattices reveal a unique and strongly confined helical edge state that, owing to its origin in bulk flat bands, can be set into motion in a topologically protected fashion, or halted at will, without compromising its adherence to individual lattice sites. △ Less

Submitted 8 May, 2022; v1 submitted 16 February, 2022; originally announced February 2022.

Comments: 17 pages, 7 figures

Populating and probing protected edge states through topology-entailed trivial states

Authors: Francesco S. Piccioli, Mark Kremer, Max Ehrhardt, Lukas J. Maczewsky, Nora Schmitt, Matthias Heinrich, Iacopo Carusotto, Alexander Szameit

Abstract: Topological insulators enable non-reciprocal light propagation that is insensitive to disorder and imperfections. Yet, despite considerable attention from the photonics community and beyond, the very feature that has inspired numerous proposals for applications of topological transport also turns out to be one of the main stumbling blocks for practical implementations: Accessing topologically prot… ▽ More Topological insulators enable non-reciprocal light propagation that is insensitive to disorder and imperfections. Yet, despite considerable attention from the photonics community and beyond, the very feature that has inspired numerous proposals for applications of topological transport also turns out to be one of the main stumbling blocks for practical implementations: Accessing topologically protected states is generally assumed to require their protection to be lifted. We overcome this limitation by topology-entailed trivial (TET) states that arise from the hybridization of counter-propagating interface states. We demonstrate selective injection and extraction of light into topological states as well as long-range coherent light exchange between spatially separated topological channels. Our results highlight the potential of TET states as protection-preserving paradigm to manipulate the flow of light in topological platforms. △ Less

Submitted 7 February, 2022; originally announced February 2022.

Comments: Main text: 14 pages, 4 figures Supplementary Informations: 8 pages, 4 figures

Roadmap on Topological Photonics

Authors: Hannah Price, Yidong Chong, Alexander Khanikaev, Henning Schomerus, Lukas J. Maczewsky, Mark Kremer, Matthias Heinrich, Alexander Szameit, Oded Zilberberg, Yihao Yang, Baile Zhang, Andrea Alù, Ronny Thomale, Iacopo Carusotto, Philippe St-Jean, Alberto Amo, Avik Dutt, Luqi Yuan, Shanhui Fan, Xuefan Yin, Chao Peng, Tomoki Ozawa, Andrea Blanco-Redondo

Abstract: Topological photonics seeks to control the behaviour of the light through the design of protected topological modes in photonic structures. While this approach originated from studying the behaviour of electrons in solid-state materials, it has since blossomed into a field that is at the very forefront of the search for new topological types of matter. This can have real implications for future te… ▽ More Topological photonics seeks to control the behaviour of the light through the design of protected topological modes in photonic structures. While this approach originated from studying the behaviour of electrons in solid-state materials, it has since blossomed into a field that is at the very forefront of the search for new topological types of matter. This can have real implications for future technologies by harnessing the robustness of topological photonics for applications in photonics devices. This Roadmap surveys some of the main emerging areas of research within topological photonics, with a special attention to questions in fundamental science, which photonics is in an ideal position to address. Each section provides an overview of the current and future challenges within a part of the field, highlighting the most exciting opportunities for future research and developments. △ Less

Submitted 17 January, 2022; originally announced January 2022.

Comments: Invited Roadmap submission to Journal of Physics: Photonics

CrossMoDA 2021 challenge: Benchmark of Cross-Modality Domain Adaptation techniques for Vestibular Schwannoma and Cochlea Segmentation

Authors: Reuben Dorent, Aaron Kujawa, Marina Ivory, Spyridon Bakas, Nicola Rieke, Samuel Joutard, Ben Glocker, Jorge Cardoso, Marc Modat, Kayhan Batmanghelich, Arseniy Belkov, Maria Baldeon Calisto, Jae Won Choi, Benoit M. Dawant, Hexin Dong, Sergio Escalera, Yubo Fan, Lasse Hansen, Mattias P. Heinrich, Smriti Joshi, Victoriya Kashtanova, Hyeon Gyu Kim, Satoshi Kondo, Christian N. Kruse, Susana K. Lai-Yuen , et al. (15 additional authors not shown)

Abstract: Domain Adaptation (DA) has recently raised strong interests in the medical imaging community. While a large variety of DA techniques has been proposed for image segmentation, most of these techniques have been validated either on private datasets or on small publicly available datasets. Moreover, these datasets mostly addressed single-class problems. To tackle these limitations, the Cross-Modality… ▽ More Domain Adaptation (DA) has recently raised strong interests in the medical imaging community. While a large variety of DA techniques has been proposed for image segmentation, most of these techniques have been validated either on private datasets or on small publicly available datasets. Moreover, these datasets mostly addressed single-class problems. To tackle these limitations, the Cross-Modality Domain Adaptation (crossMoDA) challenge was organised in conjunction with the 24th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2021). CrossMoDA is the first large and multi-class benchmark for unsupervised cross-modality DA. The challenge's goal is to segment two key brain structures involved in the follow-up and treatment planning of vestibular schwannoma (VS): the VS and the cochleas. Currently, the diagnosis and surveillance in patients with VS are performed using contrast-enhanced T1 (ceT1) MRI. However, there is growing interest in using non-contrast sequences such as high-resolution T2 (hrT2) MRI. Therefore, we created an unsupervised cross-modality segmentation benchmark. The training set provides annotated ceT1 (N=105) and unpaired non-annotated hrT2 (N=105). The aim was to automatically perform unilateral VS and bilateral cochlea segmentation on hrT2 as provided in the testing set (N=137). A total of 16 teams submitted their algorithm for the evaluation phase. The level of performance reached by the top-performing teams is strikingly high (best median Dice - VS:88.4%; Cochleas:85.7%) and close to full supervision (median Dice - VS:92.5%; Cochleas:87.7%). All top-performing methods made use of an image-to-image translation approach to transform the source-domain images into pseudo-target-domain images. A segmentation network was then trained using these generated images and the manual annotations provided for the source image. △ Less

Submitted 14 December, 2022; v1 submitted 8 January, 2022; originally announced January 2022.

Comments: In Medical Image Analysis

The Brain Tumor Sequence Registration (BraTS-Reg) Challenge: Establishing Correspondence Between Pre-Operative and Follow-up MRI Scans of Diffuse Glioma Patients

Authors: Bhakti Baheti, Satrajit Chakrabarty, Hamed Akbari, Michel Bilello, Benedikt Wiestler, Julian Schwarting, Evan Calabrese, Jeffrey Rudie, Syed Abidi, Mina Mousa, Javier Villanueva-Meyer, Brandon K. K. Fields, Florian Kofler, Russell Takeshi Shinohara, Juan Eugenio Iglesias, Tony C. W. Mok, Albert C. S. Chung, Marek Wodzinski, Artur Jurgas, Niccolo Marini, Manfredo Atzori, Henning Muller, Christoph Grobroehmer, Hanna Siebert, Lasse Hansen , et al. (48 additional authors not shown)

Abstract: Registration of longitudinal brain MRI scans containing pathologies is challenging due to dramatic changes in tissue appearance. Although there has been progress in develo** general-purpose medical image registration techniques, they have not yet attained the requisite precision and reliability for this task, highlighting its inherent complexity. Here we describe the Brain Tumor Sequence Registr… ▽ More Registration of longitudinal brain MRI scans containing pathologies is challenging due to dramatic changes in tissue appearance. Although there has been progress in develo** general-purpose medical image registration techniques, they have not yet attained the requisite precision and reliability for this task, highlighting its inherent complexity. Here we describe the Brain Tumor Sequence Registration (BraTS-Reg) challenge, as the first public benchmark environment for deformable registration algorithms focusing on estimating correspondences between pre-operative and follow-up scans of the same patient diagnosed with a diffuse brain glioma. The BraTS-Reg data comprise de-identified multi-institutional multi-parametric MRI (mpMRI) scans, curated for size and resolution according to a canonical anatomical template, and divided into training, validation, and testing sets. Clinical experts annotated ground truth (GT) landmark points of anatomical locations distinct across the temporal domain. Quantitative evaluation and ranking were based on the Median Euclidean Error (MEE), Robustness, and the determinant of the Jacobian of the displacement field. The top-ranked methodologies yielded similar performance across all evaluation metrics and shared several methodological commonalities, including pre-alignment, deep neural networks, inverse consistency analysis, and test-time instance optimization per-case basis as a post-processing step. The top-ranked method attained the MEE at or below that of the inter-rater variability for approximately 60% of the evaluated landmarks, underscoring the scope for further accuracy and robustness improvements, especially relative to human experts. The aim of BraTS-Reg is to continue to serve as an active resource for research, with the data and online evaluation tools accessible at https://bratsreg.github.io/. △ Less

Submitted 17 April, 2024; v1 submitted 13 December, 2021; originally announced December 2021.

Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learning

Authors: Alessa Hering, Lasse Hansen, Tony C. W. Mok, Albert C. S. Chung, Hanna Siebert, Stephanie Häger, Annkristin Lange, Sven Kuckertz, Stefan Heldmann, Wei Shao, Sulaiman Vesal, Mirabela Rusu, Geoffrey Sonn, Théo Estienne, Maria Vakalopoulou, Luyi Han, Yunzhi Huang, Pew-Thian Yap, Mikael Brudfors, Yaël Balbastre, Samuel Joutard, Marc Modat, Gal Lifshitz, Dan Raviv, **xin Lv , et al. (28 additional authors not shown)

Abstract: Image registration is a fundamental medical image analysis task, and a wide variety of approaches have been proposed. However, only a few studies have comprehensively compared medical image registration approaches on a wide range of clinically relevant tasks. This limits the development of registration methods, the adoption of research advances into practice, and a fair benchmark across competing… ▽ More Image registration is a fundamental medical image analysis task, and a wide variety of approaches have been proposed. However, only a few studies have comprehensively compared medical image registration approaches on a wide range of clinically relevant tasks. This limits the development of registration methods, the adoption of research advances into practice, and a fair benchmark across competing approaches. The Learn2Reg challenge addresses these limitations by providing a multi-task medical image registration data set for comprehensive characterisation of deformable registration algorithms. A continuous evaluation will be possible at https://learn2reg.grand-challenge.org. Learn2Reg covers a wide range of anatomies (brain, abdomen, and thorax), modalities (ultrasound, CT, MR), availability of annotations, as well as intra- and inter-patient registration evaluation. We established an easily accessible framework for training and validation of 3D registration methods, which enabled the compilation of results of over 65 individual method submissions from more than 20 unique teams. We used a complementary set of metrics, including robustness, accuracy, plausibility, and runtime, enabling unique insight into the current state-of-the-art of medical image registration. This paper describes datasets, tasks, evaluation methods and results of the challenge, as well as results of further analysis of transferability to new datasets, the importance of label supervision, and resulting bias. While no single approach worked best across all tasks, many methodological aspects could be identified that push the performance of medical image registration to new state-of-the-art performance. Furthermore, we demystified the common belief that conventional registration methods have to be much slower than deep-learning-based methods. △ Less

Submitted 7 October, 2022; v1 submitted 8 December, 2021; originally announced December 2021.

Fast 3D registration with accurate optimisation and little learning for Learn2Reg 2021

Authors: Hanna Siebert, Lasse Hansen, Mattias P. Heinrich

Abstract: Current approaches for deformable medical image registration often struggle to fulfill all of the following criteria: versatile applicability, small computation or training times, and the being able to estimate large deformations. Furthermore, end-to-end networks for supervised training of registration often become overly complex and difficult to train. For the Learn2Reg2021 challenge, we aim to a… ▽ More Current approaches for deformable medical image registration often struggle to fulfill all of the following criteria: versatile applicability, small computation or training times, and the being able to estimate large deformations. Furthermore, end-to-end networks for supervised training of registration often become overly complex and difficult to train. For the Learn2Reg2021 challenge, we aim to address these issues by decoupling feature learning and geometric alignment. First, we introduce a new very fast and accurate optimisation method. By using discretised displacements and a coupled convex optimisation procedure, we are able to robustly cope with large deformations. With the help of an Adam-based instance optimisation, we achieve very accurate registration performances and by using regularisation, we obtain smooth and plausible deformation fields. Second, to be versatile for different registration tasks, we extract hand-crafted features that are modality and contrast invariant and complement them with semantic features from a task-specific segmentation U-Net. With our results we were able to achieve the overall Learn2Reg2021 challenge's second place, winning Task 1 and being second and third in the other two tasks. △ Less

Submitted 6 December, 2021; originally announced December 2021.

Recolouring planar graphs of girth at least five

Authors: Valentin Bartier, Nicolas Bousquet, Carl Feghali, Marc Heinrich, Benjamin Moore, Théo Pierron

Abstract: For a positive integer $k$, the $k$-recolouring graph of a graph $G$ has as vertex set all proper $k$-colourings of $G$ with two $k$-colourings being adjacent if they differ by the colour of exactly one vertex. A result of Dyer et al. regarding graphs of bounded degeneracy implies that the $7$-recolouring graphs of planar graphs, the $5$-recolouring graphs of triangle-free planar graphs and the… ▽ More For a positive integer $k$, the $k$-recolouring graph of a graph $G$ has as vertex set all proper $k$-colourings of $G$ with two $k$-colourings being adjacent if they differ by the colour of exactly one vertex. A result of Dyer et al. regarding graphs of bounded degeneracy implies that the $7$-recolouring graphs of planar graphs, the $5$-recolouring graphs of triangle-free planar graphs and the $4$-recolouring graphs planar graphs of girth at least six are connected. On the other hand, there are planar graphs whose $6$-recolouring graph is disconnected, triangle-free planar graphs whose $4$-recolouring graph is disconnected and planar graphs of any given girth whose $3$-recolouring graph is disconnected. The main result of this paper consists in showing, via a novel application of the discharging method, that the $4$-recolouring graph of every planar graph of girth five is connected. This completes the classification of the connectedness of the recolouring graph for planar graphs of given girth. We also prove some theorems regarding the diameter of the recolouring graph of planar graphs. △ Less

Submitted 1 December, 2021; originally announced December 2021.

Comments: 21 pages

MSC Class: 05C15

The MatrixX Solver For Argumentation Frameworks

Authors: Maximilian Heinrich

Abstract: MatrixX is a solver for Abstract Argumentation Frameworks. Offensive and defensive properties of an Argumentation Framework are notated in a matrix style. Rows and columns of this matrix are systematically reduced by the solver. This procedure is implemented through the use of hash maps in order to accelerate calculation time. MatrixX works for stable and complete semantics and was designed for th… ▽ More MatrixX is a solver for Abstract Argumentation Frameworks. Offensive and defensive properties of an Argumentation Framework are notated in a matrix style. Rows and columns of this matrix are systematically reduced by the solver. This procedure is implemented through the use of hash maps in order to accelerate calculation time. MatrixX works for stable and complete semantics and was designed for the ICCMA 2021 competition. △ Less

Submitted 29 September, 2021; originally announced September 2021.

Comments: Part of ICCMA 2021 proceedings

Distributed recoloring of interval and chordal graphs

Authors: Nicolas Bousquet, Laurent Feuilloley, Marc Heinrich, Mikaël Rabie

Abstract: One of the fundamental and most-studied algorithmic problems in distributed computing on networks is graph coloring, both in bounded-degree and in general graphs. Recently, the study of this problem has been extended in two directions. First, the problem of recoloring, that is computing an efficient transformation between two given colorings (instead of computing a new coloring), has been consider… ▽ More One of the fundamental and most-studied algorithmic problems in distributed computing on networks is graph coloring, both in bounded-degree and in general graphs. Recently, the study of this problem has been extended in two directions. First, the problem of recoloring, that is computing an efficient transformation between two given colorings (instead of computing a new coloring), has been considered, both to model radio network updates, and as a useful subroutine for coloring. Second, as it appears that general graphs and bounded-degree graphs do not model real networks very well (with, respectively, pathological worst-case topologies and too strong assumptions), coloring has been studied in more specific graph classes. In this paper, we study the intersection of these two directions: distributed recoloring in two relevant graph classes, interval and chordal graphs. △ Less

Submitted 13 September, 2021; originally announced September 2021.

Certifying Multilevel Coherence in the Motional State of a Trapped Ion

Authors: Ollie Corfield, Jake Lishman, Chungsun Lee, Jacopo Mosca Toba, George Porter, Johannes M. Heinrich, Simon C. Webster, Florian Mintert, Richard C. Thompson

Abstract: Quantum coherence is one of the clearest departures from classical physics, exhibited when a system is in a superposition of different basis states. Here the coherent superposition of three motional Fock states of a single trapped ion is experimentally certified, with a procedure provably robust against imperfect operation. As the motional state cannot be directly interrogated, our scheme uses an… ▽ More Quantum coherence is one of the clearest departures from classical physics, exhibited when a system is in a superposition of different basis states. Here the coherent superposition of three motional Fock states of a single trapped ion is experimentally certified, with a procedure provably robust against imperfect operation. As the motional state cannot be directly interrogated, our scheme uses an interference pattern generated by projective measurement of the coupled qubit state. The minimum number of coherently superposed states is inferred from a series of threshold values based on analysis of the interference pattern. This demonstrates that high-level coherence can be verified and investigated with simple, nonideal control methods well-suited to noisy intermediate-scale quantum devices. △ Less

Submitted 10 November, 2021; v1 submitted 24 June, 2021; originally announced June 2021.

Journal ref: PRX Quantum 2, 040359 (2021)

Observation-dependent suppression and enhancement of two-photon coincidences by tailored losses

Authors: Max Ehrhardt, Matthias Heinrich, Alexander Szameit

Abstract: The uncanny ability of multiple particles to interfere with one another is one of the core principles of quantum mechanics, and serves as foundation for quantum information processing. In particular, the interplay of constructive and destructive interference with the characteristic exchange statistics of indistinguishable particles give rise to the Hong-Ou-Mandel (HOM) effect, where the bunching o… ▽ More The uncanny ability of multiple particles to interfere with one another is one of the core principles of quantum mechanics, and serves as foundation for quantum information processing. In particular, the interplay of constructive and destructive interference with the characteristic exchange statistics of indistinguishable particles give rise to the Hong-Ou-Mandel (HOM) effect, where the bunching of bosons can lead to a perfect suppression of two-particle coincidences between the output ports of a balanced beam splitter. Conversely, in the case of two fermions, anti-bunching can systematically enhance these coincidences up to twice the baseline value of distinguishable particles. As such, the respective emergence of dips or peaks in the HOM experiment may at first glance appear to be indicative of the bosonic/fermionic nature of the incident particles. In this work, we demonstrate experimentally that the two-particle coincidence statistics of two bosons can instead be seamlessly tuned from the expected case of suppression to substantial enhancement by an appropriate choice of the observation basis. To this end, our photonic setting leverages birefringent polarization couplers to selectively introduce dissipation in the photons polarization degree of freedom. Notably, the mechanism underpinning this this highly unusual behaviour does not act on the individual phases accumulated by pairs of particles along specific paths, but instead allows them to jointly evade losses, while indistinguishable photons are prevented from being simultaneously detected in orthogonal modes. Our findings reveal a new approach to harnessing non-Hermitian settings for the manipulation of multi-particle quantum states and as functional elements in quantum simulation and information processing. △ Less

Submitted 12 May, 2021; originally announced May 2021.