-
Embarrassingly Simple Scribble Supervision for 3D Medical Segmentation
Authors:
Karol Gotkowski,
Carsten Lüth,
Paul F. Jäger,
Sebastian Ziegler,
Lars Krämer,
Stefan Denner,
Shuhan Xiao,
Nico Disch,
Klaus H. Maier-Hein,
Fabian Isensee
Abstract:
Traditionally, segmentation algorithms require dense annotations for training, demanding significant annotation efforts, particularly within the 3D medical imaging field. Scribble-supervised learning emerges as a possible solution to this challenge, promising a reduction in annotation efforts when creating large-scale datasets. Recently, a plethora of methods for optimized learning from scribbles…
▽ More
Traditionally, segmentation algorithms require dense annotations for training, demanding significant annotation efforts, particularly within the 3D medical imaging field. Scribble-supervised learning emerges as a possible solution to this challenge, promising a reduction in annotation efforts when creating large-scale datasets. Recently, a plethora of methods for optimized learning from scribbles have been proposed, but have so far failed to position scribble annotation as a beneficial alternative. We relate this shortcoming to two major issues: 1) the complex nature of many methods which deeply ties them to the underlying segmentation model, thus preventing a migration to more powerful state-of-the-art models as the field progresses and 2) the lack of a systematic evaluation to validate consistent performance across the broader medical domain, resulting in a lack of trust when applying these methods to new segmentation problems. To address these issues, we propose a comprehensive scribble supervision benchmark consisting of seven datasets covering a diverse set of anatomies and pathologies imaged with varying modalities. We furthermore propose the systematic use of partial losses, i.e. losses that are only computed on annotated voxels. Contrary to most existing methods, these losses can be seamlessly integrated into state-of-the-art segmentation methods, enabling them to learn from scribble annotations while preserving their original loss formulations. Our evaluation using nnU-Net reveals that while most existing methods suffer from a lack of generalization, the proposed approach consistently delivers state-of-the-art performance. Thanks to its simplicity, our approach presents an embarrassingly simple yet effective solution to the challenges of scribble supervision. Source code as well as our extensive scribble benchmarking suite will be made publicly available upon publication.
△ Less
Submitted 19 March, 2024;
originally announced March 2024.
-
Metachronal coordination at the mesoscale
Authors:
Sebastian Ziegler,
Megan Delens,
Ylona Collard,
Maxime Hubert,
Nicolas Vandewalle,
Ana-Sunčana Smith
Abstract:
In nature, metachronal coordination is an efficient strategy for fluid pum** and self-propulsion. Yet, mimetic systems for this type of organization are scarce. Recently, metachronal motion was observed in a bead-based magnetocapillary mesoswimmer, but the mechanism of such device's behavior remained unclear. Here, we combine theory and experiments to explain two swimming regimes that we identif…
▽ More
In nature, metachronal coordination is an efficient strategy for fluid pum** and self-propulsion. Yet, mimetic systems for this type of organization are scarce. Recently, metachronal motion was observed in a bead-based magnetocapillary mesoswimmer, but the mechanism of such device's behavior remained unclear. Here, we combine theory and experiments to explain two swimming regimes that we identify by modulation of the driving frequency. In the linear, low-frequency regime, the swimmer motion originates from individual bead rotations. However, the high-frequency, metachronal regime is dominated by deformations of the device near a mechanical resonance, which highlights the role of bead inertia for optimized self-propulsion.
△ Less
Submitted 6 November, 2023;
originally announced November 2023.
-
Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads
Authors:
René Caspart,
Sebastian Ziegler,
Arvid Weyrauch,
Holger Obermaier,
Simon Raffeiner,
Leon Pascal Schuhmacher,
Jan Scholtyssek,
Darya Trofimova,
Marco Nolden,
Ines Reinartz,
Fabian Isensee,
Markus Götz,
Charlotte Debus
Abstract:
With the rise of AI in recent years and the increase in complexity of the models, the growing demand in computational resources is starting to pose a significant challenge. The need for higher compute power is being met with increasingly more potent accelerators and the use of large compute clusters. However, the gain in prediction accuracy from large models trained on distributed and accelerated…
▽ More
With the rise of AI in recent years and the increase in complexity of the models, the growing demand in computational resources is starting to pose a significant challenge. The need for higher compute power is being met with increasingly more potent accelerators and the use of large compute clusters. However, the gain in prediction accuracy from large models trained on distributed and accelerated systems comes at the price of a substantial increase in energy demand, and researchers have started questioning the environmental friendliness of such AI methods at scale. Consequently, energy efficiency plays an important role for AI model developers and infrastructure operators alike. The energy consumption of AI workloads depends on the model implementation and the utilized hardware. Therefore, accurate measurements of the power draw of AI workflows on different types of compute nodes is key to algorithmic improvements and the design of future compute clusters and hardware. To this end, we present measurements of the energy consumption of two typical applications of deep learning models on different types of compute nodes. Our results indicate that 1. deriving energy consumption directly from runtime is not accurate, but the consumption of the compute node needs to be considered regarding its composition; 2. neglecting accelerator hardware on mixed nodes results in overproportional inefficiency regarding energy consumption; 3. energy consumption of model training and inference should be considered separately - while training on GPUs outperforms all other node types regarding both runtime and energy consumption, inference on CPU nodes can be comparably efficient. One advantage of our approach is that the information on energy consumption is available to all users of the supercomputer, enabling an easy transfer to other workloads alongside a raise in user-awareness of energy consumption.
△ Less
Submitted 3 December, 2022;
originally announced December 2022.
-
Lattice Boltzmann simulations of two linear microswimmers using the immersed boundary method
Authors:
D. Geyer,
S. Ziegler,
A. Sukhov,
M. Hubert,
A. -S. Smith,
O. Aouane,
P. Malgaretti,
J. Harting
Abstract:
The performance of a single or the collection of microswimmers strongly depends on the hydrodynamic coupling among their constituents and themselves. We present a numerical study for a single and a pair of microswimmers based on lattice Boltzmann method (LBM) simulations. Our numerical algorithm consists of two separable parts. Lagrange polynomials provide a discretization of the microswimmers and…
▽ More
The performance of a single or the collection of microswimmers strongly depends on the hydrodynamic coupling among their constituents and themselves. We present a numerical study for a single and a pair of microswimmers based on lattice Boltzmann method (LBM) simulations. Our numerical algorithm consists of two separable parts. Lagrange polynomials provide a discretization of the microswimmers and the lattice Boltzmann method captures the dynamics of the surrounding fluid. The two components couple via an immersed boundary method. We present data for a single swimmer system and our data also show the onset of collective effects and, in particular, an overall velocity increment of clusters of swimmers.
△ Less
Submitted 14 March, 2023; v1 submitted 24 February, 2022;
originally announced February 2022.
-
Hydrodynamic particle interactions in linear and radial viscosity gradients
Authors:
Sebastian Ziegler,
Ana-Sunčana Smith
Abstract:
We present a versatile perturbative calculation scheme to determine the mobility matrix for two and more particles in a low Reynolds number fluid with spatially variant viscosity. Assuming an asymptotic non-constant viscosity perturbation superimposed on a constant viscosity background, we exploit the Lorentz reciprocal theorem and a reflection method to obtain the leading order correction to the…
▽ More
We present a versatile perturbative calculation scheme to determine the mobility matrix for two and more particles in a low Reynolds number fluid with spatially variant viscosity. Assuming an asymptotic non-constant viscosity perturbation superimposed on a constant viscosity background, we exploit the Lorentz reciprocal theorem and a reflection method to obtain the leading order correction to the mobility matrix. We apply our approach firstly to an interface-like linear viscosity gradient with an extension much larger than the length scale of the particle separation. We find that the viscosity gradient gives rise to additional long-range flow fields, for both particle translation and rotation, which decay by one order slower than their constant-viscosity counterparts. Also, we reveal that the relative positioning of two interacting particles in finite-size gradients, a natural precondition to avoid pathological negative viscosity, affects the mobilities of and interaction between both particles. Secondly, we apply our result to two interacting particles with temperatures different from that of the surrounding fluid, which alters both the fluid temperature and viscosity field. We find that both, the self-mobilities of the particles as well as their interactions, increase for hot particles and decrease for cold particles.
△ Less
Submitted 22 December, 2021;
originally announced December 2021.
-
Optimizing Edge Detection for Image Segmentation with Multicut Penalties
Authors:
Steffen Jung,
Sebastian Ziegler,
Amirhossein Kardoost,
Margret Keuper
Abstract:
The Minimum Cost Multicut Problem (MP) is a popular way for obtaining a graph decomposition by optimizing binary edge labels over edge costs. While the formulation of a MP from independently estimated costs per edge is highly flexible and intuitive, solving the MP is NP-hard and time-expensive. As a remedy, recent work proposed to predict edge probabilities with awareness to potential conflicts by…
▽ More
The Minimum Cost Multicut Problem (MP) is a popular way for obtaining a graph decomposition by optimizing binary edge labels over edge costs. While the formulation of a MP from independently estimated costs per edge is highly flexible and intuitive, solving the MP is NP-hard and time-expensive. As a remedy, recent work proposed to predict edge probabilities with awareness to potential conflicts by incorporating cycle constraints in the prediction process. We argue that such formulation, while providing a first step towards end-to-end learnable edge weights, is suboptimal, since it is built upon a loose relaxation of the MP. We therefore propose an adaptive CRF that allows to progressively consider more violated constraints and, in consequence, to issue solutions with higher validity. Experiments on the BSDS500 benchmark for natural image segmentation as well as on electron microscopic recordings show that our approach yields more precise edge detection and image segmentation.
△ Less
Submitted 10 December, 2021;
originally announced December 2021.
-
Theoretical framework for pairwise microswimmer interactions
Authors:
Sebastian Ziegler,
Thomas Scheel,
Maxime Hubert,
Jens Harting,
Ana-Sunčana Smith
Abstract:
Hydrodynamic interactions are crucial for determining the cooperative behavior of microswimmers at low Reynolds numbers. Here we provide a comprehensive analysis of the scaling and strength of the interactions in the case of a pair of three-sphere swimmers with intrinsic elasticity. Both stroke-based and force-based microswimmers are analyzed using an analytic perturbative approach. Following a de…
▽ More
Hydrodynamic interactions are crucial for determining the cooperative behavior of microswimmers at low Reynolds numbers. Here we provide a comprehensive analysis of the scaling and strength of the interactions in the case of a pair of three-sphere swimmers with intrinsic elasticity. Both stroke-based and force-based microswimmers are analyzed using an analytic perturbative approach. Following a detailed analysis of the passive interactions, as well as active translations and rotations, we find that the map** between the stroke-based and force-based swimmers is only possible in a low driving frequency regime where the characteristic time scale is smaller than the viscous one. Furthermore, we find that for swimmers separated by up to hundreds of swimmer lengths, swimming in pairs speeds up the self propulsion, due to the dominant quadrupolar hydrodynamic interactions. Finally, we find that the long term behavior of the swimmers, while sensitive to initial relative positioning, does not depend on the pusher or puller nature of the swimmer.
△ Less
Submitted 10 February, 2021;
originally announced February 2021.
-
Regimes of motion of magnetocapillary swimmers
Authors:
Alexander Sukhov,
Maxime Hubert,
Galien Grosjean,
Oleg Trosman,
Sebastian Ziegler,
Ylona Collard,
Nicolas Vandewalle,
Ana-Suncana Smith,
Jens Harting
Abstract:
The dynamics of a triangular magnetocapillary swimmer is studied using the lattice Boltzmann method. Performing extensive numerical simulations taking into account the coupled dynamics of the fluid-fluid interface and of magnetic particles floating on it and driven by external magnetic fields we identify several regimes of the swimmer motion. In the regime of high frequencies the swimmer's maximum…
▽ More
The dynamics of a triangular magnetocapillary swimmer is studied using the lattice Boltzmann method. Performing extensive numerical simulations taking into account the coupled dynamics of the fluid-fluid interface and of magnetic particles floating on it and driven by external magnetic fields we identify several regimes of the swimmer motion. In the regime of high frequencies the swimmer's maximum velocity is centered around the particle's inverse coasting time. Modifying the ratio of surface tension and magnetic forces allows to study the swimmer propagation in the regime of significantly lower frequencies mainly defined by the strength of the magnetocapillary potential. Finally, introducing a constant magnetic contribution in each of the particles in addition to their magnetic moment induced by external fields leads to another regime characterised by strong in-plane swimmer reorientations that resemble experimental observations.
△ Less
Submitted 9 November, 2020;
originally announced November 2020.
-
Re-examining rates of lithium-ion battery technology improvement and cost decline
Authors:
Micah S. Ziegler,
Jessika E. Trancik
Abstract:
Lithium-ion technologies are increasingly employed to electrify transportation and provide stationary energy storage for electrical grids, and as such their development has garnered much attention. However, their deployment is still relatively limited, and their broader adoption will depend on their potential for cost reduction and performance improvement. Understanding this potential can inform c…
▽ More
Lithium-ion technologies are increasingly employed to electrify transportation and provide stationary energy storage for electrical grids, and as such their development has garnered much attention. However, their deployment is still relatively limited, and their broader adoption will depend on their potential for cost reduction and performance improvement. Understanding this potential can inform critical climate change mitigation strategies, including public policies and technology development efforts. However, many existing models of past cost decline, which often serve as starting points for forecasting models, rely on limited data series and measures of technological progress. Here we systematically collect, harmonize, and combine various data series of price, market size, research and development, and performance of lithium-ion technologies. We then develop representative series for these measures and employ performance curve models to estimate improvement rates. We also develop a method to incorporate additional performance characteristics into these models, including energy density and specific energy performance metrics. When energy density is incorporated into the definition of service provided by a lithium-ion cell, estimated technological improvement rates increase considerably, suggesting that previously reported improvement rates might underestimate the rate of lithium-ion technologies' change. Moreover, our estimates suggest the degree to which lithium-ion technologies' price decline might have been limited by performance requirements other than cost per energy capacity. These rates also suggest that battery technologies developed for stationary applications, where restrictions on volume and mass are relaxed, might achieve faster cost declines, though engineering-based mechanistic cost modeling is required to further characterize this potential.
△ Less
Submitted 19 August, 2020; v1 submitted 27 July, 2020;
originally announced July 2020.
-
Optimal Tree Decompositions Revisited: A Simpler Linear-Time FPT Algorithm
Authors:
Ernst Althaus,
Sarah Ziegler
Abstract:
In 1996, Bodlaender showed the celebrated result that an optimal tree decomposition of a graph of bounded treewidth can be found in linear time. The algorithm is based on an algorithm of Bodlaender and Kloks that computes an optimal tree decomposition given a non-optimal tree decomposition of bounded width. Both algorithms, in particular the second, are hardly accessible. In our review, we present…
▽ More
In 1996, Bodlaender showed the celebrated result that an optimal tree decomposition of a graph of bounded treewidth can be found in linear time. The algorithm is based on an algorithm of Bodlaender and Kloks that computes an optimal tree decomposition given a non-optimal tree decomposition of bounded width. Both algorithms, in particular the second, are hardly accessible. In our review, we present them in a much simpler way than the original presentations. In our description of the second algorithm, we start by explaining how all tree decompositions of subtrees defined by the nodes of the given tree decomposition can be enumerated. We group tree decompositions into equivalence classes depending on the current node of the given tree decomposition, such that it suffices to enumerate one tree decomposition per equivalence class and, for each node of the given tree decomposition, there are only a constant number of classes which can be represented in constant space. Our description of the first algorithm further simplifies Perkovic and Reed's simplification.
△ Less
Submitted 18 March, 2020; v1 submitted 19 December, 2019;
originally announced December 2019.
-
A general perturbative approach for bead-based microswimmers reveals rich self-propulsion phenomena
Authors:
Sebastian Ziegler,
Maxime Hubert,
Nicolas Vandewalle,
Jens Harting,
Ana-Sunčana-Smith
Abstract:
Studies of model microswimmers have significantly contributed to the understanding of the principles of self-propulsion we have today. However, only a small number of microswimmer types have been amenable to analytic modeling, and further development of such approaches is necessary to identify the key features of these active systems. Here we present a general perturbative calculation scheme for s…
▽ More
Studies of model microswimmers have significantly contributed to the understanding of the principles of self-propulsion we have today. However, only a small number of microswimmer types have been amenable to analytic modeling, and further development of such approaches is necessary to identify the key features of these active systems. Here we present a general perturbative calculation scheme for swimmers composed of beads interacting by harmonic potentials, driven by an arbitrary force protocol. The hydrodynamic interactions are treated using the Oseen and Rotne-Pragner approximations. We validate our approach by using 3 bead assemblies and comparing the results with the numerically obtained full-solutions of the governing equations of motion, as well as with the existing analytic models for a linear and a triangular swimmer geometries. While recovering the relation between the force and swimming velocity, our detailed analysis and the controlled level of approximation allow us to find qualitative differences already in the far field flow of the devices. Consequently, we are able to identify a behavior of the swimmer that is richer than predicted in previous models. Given its generality, the framework can be applied to any swimmer geometry, driving protocol and beads interactions, as well as in many swimmers problems.
△ Less
Submitted 23 July, 2019;
originally announced July 2019.
-
Optimal motion of triangular magnetocapillary swimmers
Authors:
Alexander Sukhov,
Sebastian Ziegler,
Qingguang Xie,
Oleg Trosman,
Jayant Pande,
Galien Grosjean,
Maxime Hubert,
Nicolas Vandewalle,
Ana-Suncana Smith,
Jens Harting
Abstract:
A system of ferromagnetic particles trapped at a liquid-liquid interface and subjected to a set of magnetic fields (magnetocapillary swimmers) is studied numerically using a hybrid method combining the pseudopotential lattice Boltzmann method and the discrete element method. After investigating the equilibrium properties of a single, two and three particles at the interface, we demonstrate a contr…
▽ More
A system of ferromagnetic particles trapped at a liquid-liquid interface and subjected to a set of magnetic fields (magnetocapillary swimmers) is studied numerically using a hybrid method combining the pseudopotential lattice Boltzmann method and the discrete element method. After investigating the equilibrium properties of a single, two and three particles at the interface, we demonstrate a controlled motion of the swimmer formed by three particles. It shows a sharp dependence of the average center-of-mass speed on the frequency of the time-dependent external magnetic field. Inspired by experiments on magnetocapillary microswimmers, we interpret the obtained maxima of the swimmer speed by the optimal frequency centered around the characteristic relaxation time of a spherical particle. It is also shown that the frequency corresponding to the maximum speed grows and the maximum average speed decreases with increasing inter-particle distances at moderate swimmer sizes. The findings of our lattice Boltzmann simulations are supported by bead-spring model calculations.
△ Less
Submitted 28 June, 2019; v1 submitted 8 January, 2019;
originally announced January 2019.