-
Data-driven approaches for electrical impedance tomography image segmentation from partial boundary data
Authors:
Alexander Denker,
Zeljko Kereta,
Imraj Singh,
Tom Freudenberg,
Tobias Kluth,
Peter Maass,
Simon Arridge
Abstract:
Electrical impedance tomography (EIT) plays a crucial role in non-invasive imaging, with both medical and industrial applications. In this paper, we present three data-driven reconstruction methods for EIT imaging. These three approaches were originally submitted to the Kuopio tomography challenge 2023 (KTC2023). First, we introduce a post-processing approach, which achieved first place at KTC2023…
▽ More
Electrical impedance tomography (EIT) plays a crucial role in non-invasive imaging, with both medical and industrial applications. In this paper, we present three data-driven reconstruction methods for EIT imaging. These three approaches were originally submitted to the Kuopio tomography challenge 2023 (KTC2023). First, we introduce a post-processing approach, which achieved first place at KTC2023. Further, we present a fully learned and a conditional diffusion approach. All three methods are based on a similar neural network as a backbone and were trained using a synthetically generated data set, providing with an opportunity for a fair comparison of these different data-driven reconstruction methods.
△ Less
Submitted 6 May, 2024;
originally announced July 2024.
-
Equilibrium Model with Anisotropy for Model-Based Reconstruction in Magnetic Particle Imaging
Authors:
Marco Maass,
Tobias Kluth,
Christine Droigk,
Hannes Albers,
Konrad Scheffler,
Alfred Mertins,
Tobias Knopp
Abstract:
Magnetic particle imaging is a tracer-based tomographic imaging technique that allows the concentration of magnetic nanoparticles to be determined with high spatio-temporal resolution. To reconstruct an image of the tracer concentration, the magnetization dynamics of the particles must be accurately modeled. A popular ensemble model is based on solving the Fokker-Plank equation, taking into accoun…
▽ More
Magnetic particle imaging is a tracer-based tomographic imaging technique that allows the concentration of magnetic nanoparticles to be determined with high spatio-temporal resolution. To reconstruct an image of the tracer concentration, the magnetization dynamics of the particles must be accurately modeled. A popular ensemble model is based on solving the Fokker-Plank equation, taking into account either Brownian or Néel dynamics. The disadvantage of this model is that it is computationally expensive due to an underlying stiff differential equation. A simplified model is the equilibrium model, which can be evaluated directly but in most relevant cases it suffers from a non-negligible modeling error. In the present work, we investigate an extended version of the equilibrium model that can account for particle anisotropy. We show that this model can be expressed as a series of Bessel functions, which can be truncated based on a predefined accuracy, leading to very short computation times, which are about three orders of magnitude lower than equivalent Fokker-Planck computation times. We investigate the accuracy of the model for 2D Lissajous MPI sequences and show that the difference between the Fokker-Planck and the equilibrium model with anisotropy is sufficiently small so that the latter model can be used for image reconstruction on experimental data with only marginal loss of image quality, even compared to a system matrix-based reconstruction.
△ Less
Submitted 1 March, 2024;
originally announced March 2024.
-
Learning-based approaches for reconstructions with inexact operators in nanoCT applications
Authors:
Tom Lütjen,
Fabian Schönfeld,
Alice Oberacker,
Johannes Leuschner,
Maximilian Schmidt,
Anne Wald,
Tobias Kluth
Abstract:
Imaging problems such as the one in nanoCT require the solution of an inverse problem, where it is often taken for granted that the forward operator, i.e., the underlying physical model, is properly known. In the present work we address the problem where the forward model is inexact due to stochastic or deterministic deviations during the measurement process. We particularly investigate the perfor…
▽ More
Imaging problems such as the one in nanoCT require the solution of an inverse problem, where it is often taken for granted that the forward operator, i.e., the underlying physical model, is properly known. In the present work we address the problem where the forward model is inexact due to stochastic or deterministic deviations during the measurement process. We particularly investigate the performance of non-learned iterative reconstruction methods dealing with inexactness and learned reconstruction schemes, which are based on U-Nets and conditional invertible neural networks. The latter also provide the opportunity for uncertainty quantification. A synthetic large data set in line with a typical nanoCT setting is provided and extensive numerical experiments are conducted evaluating the proposed methods.
△ Less
Submitted 1 September, 2023; v1 submitted 19 July, 2023;
originally announced July 2023.
-
Bayesian view on the training of invertible residual networks for solving linear inverse problems
Authors:
Clemens Arndt,
Sören Dittmer,
Nick Heilenkötter,
Meira Iske,
Tobias Kluth,
Judith Nickel
Abstract:
Learning-based methods for inverse problems, adapting to the data's inherent structure, have become ubiquitous in the last decade. Besides empirical investigations of their often remarkable performance, an increasing number of works addresses the issue of theoretical guarantees. Recently, [3] exploited invertible residual networks (iResNets) to learn provably convergent regularizations given reaso…
▽ More
Learning-based methods for inverse problems, adapting to the data's inherent structure, have become ubiquitous in the last decade. Besides empirical investigations of their often remarkable performance, an increasing number of works addresses the issue of theoretical guarantees. Recently, [3] exploited invertible residual networks (iResNets) to learn provably convergent regularizations given reasonable assumptions. They enforced these guarantees by approximating the linear forward operator with an iResNet. Supervised training on relevant samples introduces data dependency into the approach. An open question in this context is to which extent the data's inherent structure influences the training outcome, i.e., the learned reconstruction scheme. Here we address this delicate interplay of training design and data dependency from a Bayesian perspective and shed light on opportunities and limitations. We resolve these limitations by analyzing reconstruction-based training of the inverses of iResNets, where we show that this optimization strategy introduces a level of data-dependency that cannot be achieved by approximation training. We further provide and discuss a series of numerical experiments underpinning and extending the theoretical findings.
△ Less
Submitted 19 July, 2023;
originally announced July 2023.
-
Time-dependent parameter identification in a Fokker-Planck equation based magnetization model of large ensembles of nanoparticles
Authors:
Hannes Albers,
Tobias Kluth
Abstract:
In this article, we consider a model motivated by large ensembles of nanoparticles' magnetization dynamics using the Fokker-Planck equation and analyze the underlying parabolic PDE being defined on a smooth, compact manifold without boundary with respect to time-dependent parameter identification using regularization schemes. In the context of magnetic particle imaging, possible fields of applicat…
▽ More
In this article, we consider a model motivated by large ensembles of nanoparticles' magnetization dynamics using the Fokker-Planck equation and analyze the underlying parabolic PDE being defined on a smooth, compact manifold without boundary with respect to time-dependent parameter identification using regularization schemes. In the context of magnetic particle imaging, possible fields of application can be found including calibration procedures improved by time-dependent particle parameters and dynamic tracking of nanoparticle orientation. This results in reconstructing different parameters of interest, such as the applied magnetic field and the particles' easy axis. These problems are in particular addressed in the accompanied numerical study.
△ Less
Submitted 7 July, 2023;
originally announced July 2023.
-
Dynamic image reconstruction with motion priors in application to 3D magnetic particle imaging
Authors:
Christina Brandt,
Tobias Kluth,
Tobias Knopp,
Lena Westen
Abstract:
Various imaging modalities allow for time-dependent image reconstructions from measurements where its acquisition also has a time-dependent nature. Magnetic particle imaging (MPI) falls into this class of imaging modalities and it thus also provides a dynamic inverse problem. Without proper consideration of the dynamic behavior, motion artifacts in the reconstruction become an issue. More sophisti…
▽ More
Various imaging modalities allow for time-dependent image reconstructions from measurements where its acquisition also has a time-dependent nature. Magnetic particle imaging (MPI) falls into this class of imaging modalities and it thus also provides a dynamic inverse problem. Without proper consideration of the dynamic behavior, motion artifacts in the reconstruction become an issue. More sophisticated methods need to be developed and applied to the reconstruction of the time-dependent sequences of images. In this context, we investigate the incorporation of motion priors in terms of certain flow-parameter-dependent PDEs in the reconstruction process of time-dependent 3D images in magnetic particle imaging. The present work comprises the method development for a general 3D+time setting for time-dependent linear forward operators, analytical investigation of necessary properties in the MPI forward operator, modeling aspects in dynamic MPI, and extensive numerical experiments on 3D+time imaging including simulated data as well as measurements from a rotation phantom and in-vivo data from a mouse.
△ Less
Submitted 20 June, 2023;
originally announced June 2023.
-
Invertible residual networks in the context of regularization theory for linear inverse problems
Authors:
Clemens Arndt,
Alexander Denker,
Sören Dittmer,
Nick Heilenkötter,
Meira Iske,
Tobias Kluth,
Peter Maass,
Judith Nickel
Abstract:
Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based reconstruction scheme via a dataset. Second, one applies the scheme to new measurements to obtain reconstructions. We follow these steps but parameterize the reconstr…
▽ More
Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based reconstruction scheme via a dataset. Second, one applies the scheme to new measurements to obtain reconstructions. We follow these steps but parameterize the reconstruction scheme with invertible residual networks (iResNets). We demonstrate that the invertibility enables investigating the influence of the training and architecture choices on the resulting reconstruction scheme. For example, assuming local approximation properties of the network, we show that these schemes become convergent regularizations. In addition, the investigations reveal a formal link to the linear regularization theory of linear inverse problems and provide a nonlinear spectral regularization for particular architecture classes. On the numerical side, we investigate the local approximation property of selected trained architectures and present a series of experiments on the MNIST dataset that underpin and extend our theoretical findings.
△ Less
Submitted 20 December, 2023; v1 submitted 2 June, 2023;
originally announced June 2023.
-
Modeling the Magnetization Dynamics for Large Ensembles of Immobilized Magnetic Nanoparticles in Multi-dimensional Magnetic Particle Imaging
Authors:
Hannes Albers,
Tobias Knopp,
Martin Möddel,
Marija Boberg,
Tobias Kluth
Abstract:
Magnetic nanoparticles (MNPs) play an important role in biomedical applications including imaging modalities such as MRI and magnetic particle imaging (MPI). The latter one exploits the non-linear magnetization response of a large ensemble of magnetic nanoparticles to magnetic fields which allows determining the spatial distribution of the MNP concentration from measured voltage signals. Currently…
▽ More
Magnetic nanoparticles (MNPs) play an important role in biomedical applications including imaging modalities such as MRI and magnetic particle imaging (MPI). The latter one exploits the non-linear magnetization response of a large ensemble of magnetic nanoparticles to magnetic fields which allows determining the spatial distribution of the MNP concentration from measured voltage signals. Currently, modeling the voltage signals of large ensembles of MNPs in an MPI environment is not yet accurately possible, especially for liquid tracers in multi-dimensional magnetic excitation fields. Thus, the voltage-to-image map** is still obtained in a time consuming calibration procedure. While the ferrofluidic case can be seen as the typical setting, more recently immobilized and potentially oriented MNPs have received considerable attention. By aligning the particles during immobilization, one can encode the angle of the easy axis into the magnetization response providing a sophisticated benchmark system for model-based approaches. In this work, we address the modeling problem for immobilized, oriented MNPs in the context of MPI. We investigate a model-based approach where the magnetization response is simulated by a Néel rotation model for the particle's magnetic moments and the ensemble magnetization is obtained by solving a Fokker-Planck equation approach. Since the parameters of the model are a-priori unknown, we investigate different methods for performing a parameter identification and discuss two models: One where a single function vector is used from the space spanned by the model parameters and another where a superposition of function vectors is considered. We show that our model can much more accurately reproduce the orientation dependent signal response when compared to the equilibrium model, which marks the current state-of-the-art for model-based system matrix simulations in MPI.
△ Less
Submitted 15 June, 2021;
originally announced June 2021.
-
A simulation framework for particle magnetization dynamics of large ensembles of single domain particles: Numerical treatment of Brown/Néel dynamics and parameter identification problems in magnetic particle imaging
Authors:
Hannes Albers,
Tobias Kluth,
Tobias Knopp
Abstract:
Magnetic nanoparticles and their magnetization dynamics play an important role in many applications. We focus on magnetization dynamics in large ensembles of single domain nanoparticles being characterized by either Brownian or Néel rotation mechanisms. Simulations of the respective behavior are obtained by solving advection-diffusion equations on the sphere, for which a unified computational fram…
▽ More
Magnetic nanoparticles and their magnetization dynamics play an important role in many applications. We focus on magnetization dynamics in large ensembles of single domain nanoparticles being characterized by either Brownian or Néel rotation mechanisms. Simulations of the respective behavior are obtained by solving advection-diffusion equations on the sphere, for which a unified computational framework is developed and investigated. This builds the basis for solving two parameter identification problems, which are formulated in the context of the chosen application, magnetic particle imaging. The functionality of the computational framework is illustrated by numerical results in the parameter identification problems either compared quantitatively or qualitatively to measured data.
△ Less
Submitted 13 October, 2020;
originally announced October 2020.
-
Deep image prior for 3D magnetic particle imaging: A quantitative comparison of regularization techniques on Open MPI dataset
Authors:
Sören Dittmer,
Tobias Kluth,
Mads Thorstein Roar Henriksen,
Peter Maass
Abstract:
Magnetic particle imaging (MPI) is an imaging modality exploiting the nonlinear magnetization behavior of (super-)paramagnetic nanoparticles to obtain a space- and often also time-dependent concentration of a tracer consisting of these nanoparticles. MPI has a continuously increasing number of potential medical applications. One prerequisite for successful performance in these applications is a pr…
▽ More
Magnetic particle imaging (MPI) is an imaging modality exploiting the nonlinear magnetization behavior of (super-)paramagnetic nanoparticles to obtain a space- and often also time-dependent concentration of a tracer consisting of these nanoparticles. MPI has a continuously increasing number of potential medical applications. One prerequisite for successful performance in these applications is a proper solution to the image reconstruction problem. More classical methods from inverse problems theory, as well as novel approaches from the field of machine learning, have the potential to deliver high-quality reconstructions in MPI. We investigate a novel reconstruction approach based on a deep image prior, which builds on representing the solution by a deep neural network. Novel approaches, as well as variational and iterative regularization techniques, are compared quantitatively in terms of peak signal-to-noise ratios and structural similarity indices on the publicly available Open MPI dataset.
△ Less
Submitted 3 July, 2020;
originally announced July 2020.
-
Joint super-resolution image reconstruction and parameter identification in imaging operator: Analysis of bilinear operator equations, numerical solution, and application to magnetic particle imaging
Authors:
Tobias Kluth,
Christine Bathke,
Ming Jiang,
Peter Maass
Abstract:
One important property of imaging modalities and related applications is the resolution of image reconstructions which relies on various factors such as instrumentation or data processing. Restrictions in resolution can have manifold origins, e.g., limited resolution of available data, noise level in the data, and/or inexact model operators. In this work we investigate a novel data processing appr…
▽ More
One important property of imaging modalities and related applications is the resolution of image reconstructions which relies on various factors such as instrumentation or data processing. Restrictions in resolution can have manifold origins, e.g., limited resolution of available data, noise level in the data, and/or inexact model operators. In this work we investigate a novel data processing approach suited for inexact model operators. Here, two different information sources, high-dimensional model information and high-quality measurement on a lower resolution, are comprised in a hybrid approach. The joint reconstruction of a high resolution image and parameters of the imaging operator are obtained by minimizing a Tikhonov-type functional. The hybrid approach is analyzed for bilinear operator equations with respect to stability, convergence, and convergence rates. We further derive an algorithmic solution exploiting an algebraic reconstruction technique. The study is complemented by numerical results ranging from an academic test case to image reconstruction in magnetic particle imaging.
△ Less
Submitted 27 April, 2020;
originally announced April 2020.
-
L1 data fitting for robust reconstruction in magnetic particle imaging: quantitative evaluation on Open MPI dataset
Authors:
Tobias Kluth,
Bangti **
Abstract:
Magnetic particle imaging is an emerging quantitative imaging modality, exploiting the unique nonlinear magnetization phenomenon of superparamagnetic iron oxide nanoparticles for recovering the concentration. Traditionally the reconstruction is formulated into a penalized least-squares problem with nonnegativity constraint, and then solved using a variant of Kaczmarz method which is often stopped…
▽ More
Magnetic particle imaging is an emerging quantitative imaging modality, exploiting the unique nonlinear magnetization phenomenon of superparamagnetic iron oxide nanoparticles for recovering the concentration. Traditionally the reconstruction is formulated into a penalized least-squares problem with nonnegativity constraint, and then solved using a variant of Kaczmarz method which is often stopped early after a small number of iterations. Besides the phantom signal, measurements additionally include a background signal and a noise signal. In order to obtain good reconstructions, a preprocessing step of frequency selection to remove the deleterious influences of the noise is often adopted. In this work, we propose a complementary pure variational approach to noise treatment, by viewing highly noisy measurements as outliers, and employing the l1 data fitting, one popular approach from robust statistics. When compared with the standard approach, it is easy to implement with a comparable computational complexity. Experiments with a public domain dataset, i.e., Open MPI dataset, show that it can give accurate reconstructions, and is less prone to noisy measurements, which is illustrated by quantitative (PSNR / SSIM) and qualitative comparisons with the Kaczmarz method. We also investigate the performance of the Kaczmarz method for small iteration numbers quantitatively.
△ Less
Submitted 6 June, 2020; v1 submitted 16 January, 2020;
originally announced January 2020.
-
Towards Accurate Modeling of the Multidimensional Magnetic Particle Imaging Physics
Authors:
Tobias Kluth,
Patryk Szwargulski,
Tobias Knopp
Abstract:
The image reconstruction problem of the tomographic imaging technique magnetic particle imaging (MPI) requires the solution of a linear inverse problem. One prerequisite for this task is that the imaging operator that describes the map** between the tomographic image and the measured signal is accurately known. For 2D and 3D excitation patterns, it is common to measure the system matrix in a cal…
▽ More
The image reconstruction problem of the tomographic imaging technique magnetic particle imaging (MPI) requires the solution of a linear inverse problem. One prerequisite for this task is that the imaging operator that describes the map** between the tomographic image and the measured signal is accurately known. For 2D and 3D excitation patterns, it is common to measure the system matrix in a calibration procedure, that is both, very time consuming and adds noise to the operator. The need for measuring the system matrix is due to the lack of an accurate physical model that is capable of describing the nanoparticles' magnetization behavior. Within this work we introduce a physical model that is based on Néel rotation for large particle ensembles and we find model parameters that describe measured 2D MPI data with much higher precision than state of the art MPI models. With phantom experiments we show that the simulated system matrix can be used for image reconstruction and reduces artifacts due to model-mismatch considerably.
△ Less
Submitted 9 July, 2019;
originally announced July 2019.
-
Numerical Reconstruction in Magnetic Particle Imaging
Authors:
Tobias Kluth,
Bangti **
Abstract:
Magnetic particle imaging (MPI) is a medical imaging modality of recent origin, and it exploits the nonlinear magnetization phenomenon to recover the spatially dependent concentration of the nanoparticles. Currently, image reconstruction in MPI is frequently carried out by standard Tikhonov regularization with nonnegativity constraint, which is then minimized by a Kaczmarz type method. In this wor…
▽ More
Magnetic particle imaging (MPI) is a medical imaging modality of recent origin, and it exploits the nonlinear magnetization phenomenon to recover the spatially dependent concentration of the nanoparticles. Currently, image reconstruction in MPI is frequently carried out by standard Tikhonov regularization with nonnegativity constraint, which is then minimized by a Kaczmarz type method. In this work, we revisit several issues in the numerical reconstruction in MPI from the perspective of modern inverse theory, i.e., the choice of data fidelity, and choosing a suitable regularization parameter and accelerating Kaczmarz iteration via randomized singular value decomposition. These algorithmic tricks are straightforward to implement and easy to incorporate in existing reconstruction algorithms. Their significant potentials are illustrated by extensive numerical experiments on a publicly available dataset.
△ Less
Submitted 29 January, 2019;
originally announced February 2019.
-
Regularization by architecture: A deep prior approach for inverse problems
Authors:
Sören Dittmer,
Tobias Kluth,
Peter Maass,
Daniel Otero Baguer
Abstract:
The present paper studies so-called deep image prior (DIP) techniques in the context of ill-posed inverse problems. DIP networks have been recently introduced for applications in image processing; also first experimental results for applying DIP to inverse problems have been reported. This paper aims at discussing different interpretations of DIP and to obtain analytic results for specific network…
▽ More
The present paper studies so-called deep image prior (DIP) techniques in the context of ill-posed inverse problems. DIP networks have been recently introduced for applications in image processing; also first experimental results for applying DIP to inverse problems have been reported. This paper aims at discussing different interpretations of DIP and to obtain analytic results for specific network designs and linear operators. The main contribution is to introduce the idea of viewing these approaches as the optimization of Tikhonov functionals rather than optimizing networks. Besides theoretical results, we present numerical verifications.
△ Less
Submitted 18 March, 2020; v1 submitted 10 December, 2018;
originally announced December 2018.
-
Mathematical models for magnetic particle imaging
Authors:
Tobias Kluth
Abstract:
Magnetic particle imaging (MPI) is a relatively new imaging modality. The nonlinear magnetization behavior of nanoparticles in an applied magnetic field is employed to reconstruct an image of the concentration of nanoparticles. Finding a sufficiently accurate model for the particle behavior is still an open problem. For this reason the reconstruction is still computed using a measured forward oper…
▽ More
Magnetic particle imaging (MPI) is a relatively new imaging modality. The nonlinear magnetization behavior of nanoparticles in an applied magnetic field is employed to reconstruct an image of the concentration of nanoparticles. Finding a sufficiently accurate model for the particle behavior is still an open problem. For this reason the reconstruction is still computed using a measured forward operator which is obtained in a time-consuming calibration process. The state of the art model used for the imaging methodology and first model-based reconstructions relies on strong model simplifications which turned out to cause too large modeling errors. Neglecting particle-particle interactions, the forward operator can be expressed by a Fredholm integral operator of the first kind describing the inverse problem. In this article we give an overview of relevant mathematical models which have not been investigated theoretically in the context of inverse problems yet. We consider deterministic models which are based on the physical behavior including relaxation mechanisms affecting the particle magnetization. The behavior of the models is illustrated with numerical simulations for monodisperse as well as polydisperse tracer. We further motivate linear and nonlinear problems beyond the solely concentration reconstruction related to applications. This model survey complements a recent topical review on MPI [30] and builds the basis for upcoming theoretical as well as empirical investigations.
△ Less
Submitted 5 March, 2018;
originally announced March 2018.
-
On the Degree of Ill-Posedness of Multi-Dimensional Magnetic Particle Imaging
Authors:
Tobias Kluth,
Bangti **,
Guanglian Li
Abstract:
Magnetic particle imaging is an imaging modality of relatively recent origin, and it exploits the nonlinear magnetization response for reconstructing the concentration of nanoparticles. Since first invented in 2005, it has received much interest in the literature. In this work, we study one prototypical mathematical model in multi-dimension, i.e., the equilibrium model, which formulates the proble…
▽ More
Magnetic particle imaging is an imaging modality of relatively recent origin, and it exploits the nonlinear magnetization response for reconstructing the concentration of nanoparticles. Since first invented in 2005, it has received much interest in the literature. In this work, we study one prototypical mathematical model in multi-dimension, i.e., the equilibrium model, which formulates the problem as a linear Fredholm integral equation of the first kind. We analyze the degree of ill-posedness of the associated linear integral operator by means of the singular value decay estimate for Sobolev smooth bivariate functions, and discuss the influence of various experimental parameters. In particular, applied magnetic fields with a field free point and a field free line are distinguished. The study is complemented with extensive numerical experiments.
△ Less
Submitted 26 May, 2018; v1 submitted 15 December, 2017;
originally announced December 2017.