-
Stochastic Optimisation Framework using the Core Imaging Library and Synergistic Image Reconstruction Framework for PET Reconstruction
Authors:
Evangelos Papoutsellis,
Casper da Costa-Luis,
Daniel Deidda,
Claire Delplancke,
Margaret Duff,
Gemma Fardell,
Ashley Gillman,
Jakob S. Jørgensen,
Zeljko Kereta,
Evgueni Ovtchinnikov,
Edoardo Pasca,
Georg Schramm,
Kris Thielemans
Abstract:
We introduce a stochastic framework into the open--source Core Imaging Library (CIL) which enables easy development of stochastic algorithms. Five such algorithms from the literature are developed, Stochastic Gradient Descent, Stochastic Average Gradient (-Amélioré), (Loopless) Stochastic Variance Reduced Gradient. We showcase the functionality of the framework with a comparative study against a d…
▽ More
We introduce a stochastic framework into the open--source Core Imaging Library (CIL) which enables easy development of stochastic algorithms. Five such algorithms from the literature are developed, Stochastic Gradient Descent, Stochastic Average Gradient (-Amélioré), (Loopless) Stochastic Variance Reduced Gradient. We showcase the functionality of the framework with a comparative study against a deterministic algorithm on a simulated 2D PET dataset, with the use of the open-source Synergistic Image Reconstruction Framework. We observe that stochastic optimisation methods can converge in fewer passes of the data than a standard deterministic algorithm.
△ Less
Submitted 21 June, 2024;
originally announced June 2024.
-
A directional regularization method for the limited-angle Helsinki Tomography Challenge using the Core Imaging Library (CIL)
Authors:
Jakob Sauer Jørgensen,
Evangelos Papoutsellis,
Laura Murgatroyd,
Gemma Fardell,
Edoardo Pasca
Abstract:
This article presents the algorithms developed by the Core Imaging Library (CIL) developer team for the Helsinki Tomography Challenge 2022. The challenge focused on reconstructing 2D phantom shapes from limited-angle computed tomography (CT) data. The CIL team designed and implemented five reconstruction methods using CIL (https://ccpi.ac.uk/cil/), an open-source Python package for tomographic ima…
▽ More
This article presents the algorithms developed by the Core Imaging Library (CIL) developer team for the Helsinki Tomography Challenge 2022. The challenge focused on reconstructing 2D phantom shapes from limited-angle computed tomography (CT) data. The CIL team designed and implemented five reconstruction methods using CIL (https://ccpi.ac.uk/cil/), an open-source Python package for tomographic imaging. The CIL team adopted a model-based reconstruction strategy, unique to this challenge with all other teams relying on deep-learning techniques. The CIL algorithms showcased exceptional performance, with one algorithm securing the third place in the competition. The best-performing algorithm employed careful CT data pre-processing and an optimization problem with single-sided directional total variation regularization combined with isotropic total variation and tailored lower and upper bounds. The reconstructions and segmentations achieved high quality for data with angular ranges down to 50 degrees, and in some cases acceptable performance even at 40 and 30 degrees. This study highlights the effectiveness of model-based approaches in limited-angle tomography and emphasizes the importance of proper algorithmic design leveraging on available prior knowledge to overcome data limitations. Finally, this study highlights the flexibility of CIL for prototy** and comparison of different optimization methods.
△ Less
Submitted 2 October, 2023;
originally announced October 2023.
-
CUQIpy: II. Computational uncertainty quantification for PDE-based inverse problems in Python
Authors:
Amal M A Alghamdi,
Nicolai A B Riis,
Babak M Afkham,
Felipe Uribe,
Silja L Christensen,
Per Christian Hansen,
Jakob S Jørgensen
Abstract:
Inverse problems, particularly those governed by Partial Differential Equations (PDEs), are prevalent in various scientific and engineering applications, and uncertainty quantification (UQ) of solutions to these problems is essential for informed decision-making. This second part of a two-paper series builds upon the foundation set by the first part, which introduced CUQIpy, a Python software pack…
▽ More
Inverse problems, particularly those governed by Partial Differential Equations (PDEs), are prevalent in various scientific and engineering applications, and uncertainty quantification (UQ) of solutions to these problems is essential for informed decision-making. This second part of a two-paper series builds upon the foundation set by the first part, which introduced CUQIpy, a Python software package for computational UQ in inverse problems using a Bayesian framework. In this paper, we extend CUQIpy's capabilities to solve PDE-based Bayesian inverse problems through a general framework that allows the integration of PDEs in CUQIpy, whether expressed natively or using third-party libraries such as FEniCS. CUQIpy offers concise syntax that closely matches mathematical expressions, streamlining the modeling process and enhancing the user experience. The versatility and applicability of CUQIpy to PDE-based Bayesian inverse problems are demonstrated on examples covering parabolic, elliptic and hyperbolic PDEs. This includes problems involving the heat and Poisson equations and application case studies in electrical impedance tomography and photo-acoustic tomography, showcasing the software's efficiency, consistency, and intuitive interface. This comprehensive approach to UQ in PDE-based inverse problems provides accessibility for non-experts and advanced features for experts.
△ Less
Submitted 21 March, 2024; v1 submitted 26 May, 2023;
originally announced May 2023.
-
CUQIpy: I. Computational uncertainty quantification for inverse problems in Python
Authors:
Nicolai A B Riis,
Amal M A Alghamdi,
Felipe Uribe,
Silja L Christensen,
Babak M Afkham,
Per Christian Hansen,
Jakob S Jørgensen
Abstract:
This paper introduces CUQIpy, a versatile open-source Python package for computational uncertainty quantification (UQ) in inverse problems, presented as Part I of a two-part series. CUQIpy employs a Bayesian framework, integrating prior knowledge with observed data to produce posterior probability distributions that characterize the uncertainty in computed solutions to inverse problems. The packag…
▽ More
This paper introduces CUQIpy, a versatile open-source Python package for computational uncertainty quantification (UQ) in inverse problems, presented as Part I of a two-part series. CUQIpy employs a Bayesian framework, integrating prior knowledge with observed data to produce posterior probability distributions that characterize the uncertainty in computed solutions to inverse problems. The package offers a high-level modeling framework with concise syntax, allowing users to easily specify their inverse problems, prior information, and statistical assumptions. CUQIpy supports a range of efficient sampling strategies and is designed to handle large-scale problems. Notably, the automatic sampler selection feature analyzes the problem structure and chooses a suitable sampler without user intervention, streamlining the process. With a selection of probability distributions, test problems, computational methods, and visualization tools, CUQIpy serves as a powerful, flexible, and adaptable tool for UQ in a wide selection of inverse problems. Part II of the series focuses on the use of CUQIpy for UQ in inverse problems with partial differential equations (PDEs).
△ Less
Submitted 21 March, 2024; v1 submitted 26 May, 2023;
originally announced May 2023.
-
Low-rank flat-field correction for artifact reduction in spectral computed tomography
Authors:
Katrine O Bangsgaard,
Genoveva Burca,
Evelina Ametova,
Martin S Andersen,
Jakob S Jørgensen
Abstract:
Spectral computed tomography has received considerable interest in recent years since spectral measurements contain much richer information about the object of interest. In spectral computed tomography, we are interested in the energy channel-wise reconstructions of the object. However, such reconstructions suffer from low signal-to-noise ratio and share the challenges of conventional low-dose com…
▽ More
Spectral computed tomography has received considerable interest in recent years since spectral measurements contain much richer information about the object of interest. In spectral computed tomography, we are interested in the energy channel-wise reconstructions of the object. However, such reconstructions suffer from low signal-to-noise ratio and share the challenges of conventional low-dose computed tomography such as ring artifacts. Ring artifacts arise from errors in the flat-field correction and can significantly degrade the quality of the reconstruction. We propose an extended flat-field model that exploits high correlation in the spectral flat-fields to reduce ring artifacts in the channel-wise reconstructions. The extended model relies on the assumption that the spectral flat-fields can be well-approximated by a low-rank matrix. Our proposed model works directly on the spectral flat-fields and can be combined with any existing reconstruction model, e.g., filtered back projection and iterative methods. The proposed model is validated on a neutron data set. The results show that our method successfully diminishes ring artifacts and improves the quality of the reconstructions. Moreover, the results indicate that our method is robust; it only needs a single spectral flat-field image, whereas existing methods need multiple spectral flat-field images to reach a similar level of ring reduction.
△ Less
Submitted 3 March, 2022;
originally announced March 2022.
-
A Bayesian Approach to CT Reconstruction with Uncertain Geometry
Authors:
Frederik H. Pedersen,
Jakob S. Jørgensen,
Martin S. Andersen
Abstract:
Computed tomography is a method for synthesizing volumetric or cross-sectional images of an object from a collection of projections. Popular reconstruction methods for computed tomography are based on idealized models and assumptions that may not be valid in practice. One such assumption is that the exact projection geometry is known. The projection geometry describes the relative location of the…
▽ More
Computed tomography is a method for synthesizing volumetric or cross-sectional images of an object from a collection of projections. Popular reconstruction methods for computed tomography are based on idealized models and assumptions that may not be valid in practice. One such assumption is that the exact projection geometry is known. The projection geometry describes the relative location of the radiation source, object, and detector for each projection. However, in practice, the geometric parameters used to describe the position and orientation of the radiation source, object, and detector are estimated quantities with uncertainty. A failure to accurately estimate the geometry may lead to reconstructions with severe misalignment artifacts that significantly decrease their scientific or diagnostic value. We propose a novel reconstruction method that jointly estimates the reconstruction and the projection geometry. The reconstruction method is based on a Bayesian approach that yields a point estimate for the reconstruction and geometric parameters and, in addition, provides valuable information regarding their uncertainty. This is achieved by approximately sampling from the joint posterior distribution of the reconstruction and projection geometry using a hierarchical Gibbs sampler. Using real tomographic data, we demonstrate that the proposed reconstruction method significantly reduces misalignment artifacts. Compared with two commonly used alignment methods, our proposed method achieves comparable or better results under challenging conditions.
△ Less
Submitted 2 March, 2022;
originally announced March 2022.
-
Structural Gaussian Priors for Bayesian CT reconstruction of Subsea Pipes
Authors:
Silja L. Christensen,
Nicolai A. B. Riis,
Felipe Uribe,
Jakob S. Jørgensen
Abstract:
A non-destructive testing (NDT) application of X-ray computed tomography (CT) is inspection of subsea pipes in operation via 2D cross-sectional scans. Data acquisition is time-consuming and costly due to the challenging subsea environment. Reducing the number of projections in a scan can yield time and cost savings, but compromises the reconstruction quality, if conventional reconstruction methods…
▽ More
A non-destructive testing (NDT) application of X-ray computed tomography (CT) is inspection of subsea pipes in operation via 2D cross-sectional scans. Data acquisition is time-consuming and costly due to the challenging subsea environment. Reducing the number of projections in a scan can yield time and cost savings, but compromises the reconstruction quality, if conventional reconstruction methods are used. In this work we take a Bayesian approach to CT reconstruction and focus on designing an effective prior to make use of available structural information about the pipe geometry. We propose a new class of structural Gaussian priors to enforce expected material properties in different regions of the reconstructed image based on independent Gaussian priors in combination with global regularity through a Gaussian Markov Random Field (GMRF) prior. Numerical experiments with synthetic and real data show that the proposed structural Gaussian prior can reduce artifacts and enhance contrast in the reconstruction compared to using only a global GMRF prior or no prior at all. We show how the resulting posterior distribution can be efficiently sampled even for large-scale images, which is essential for practical NDT applications.
△ Less
Submitted 21 September, 2022; v1 submitted 2 March, 2022;
originally announced March 2022.
-
Stop** Rules for Algebraic Iterative Reconstruction Methods in Computed Tomography
Authors:
Per Christian Hansen,
Jakob Sauer Jørgensen,
Peter Winkel Rasmussen
Abstract:
Algebraic models for the reconstruction problem in X-ray computed tomography (CT) provide a flexible framework that applies to many measurement geometries. For large-scale problems we need to use iterative solvers, and we need stop** rules for these methods that terminate the iterations when we have computed a satisfactory reconstruction that balances the reconstruction error and the influence o…
▽ More
Algebraic models for the reconstruction problem in X-ray computed tomography (CT) provide a flexible framework that applies to many measurement geometries. For large-scale problems we need to use iterative solvers, and we need stop** rules for these methods that terminate the iterations when we have computed a satisfactory reconstruction that balances the reconstruction error and the influence of noise from the measurements. Many such stop** rules are developed in the inverse problems communities, but they have not attained much attention in the CT world. The goal of this paper is to describe and illustrate four stop** rules that are relevant for CT reconstructions.
△ Less
Submitted 18 June, 2021;
originally announced June 2021.
-
Crystalline phase discriminating neutron tomography using advanced reconstruction methods
Authors:
Evelina Ametova,
Genoveva Burca,
Suren Chilingaryan,
Gemma Fardell,
Jakob S. Jørgensen,
Evangelos Papoutsellis,
Edoardo Pasca,
Ryan Warr,
Martin Turner,
William R. B. Lionheart,
Philip J. Withers
Abstract:
Time-of-flight neutron imaging offers complementary attenuation contrast to X-ray computed tomography (CT), coupled with the ability to extract additional information from the variation in attenuation as a function of neutron energy (time of flight) at every point (voxel) in the image. In particular Bragg edge positions provide crystallographic information and therefore enable the identification o…
▽ More
Time-of-flight neutron imaging offers complementary attenuation contrast to X-ray computed tomography (CT), coupled with the ability to extract additional information from the variation in attenuation as a function of neutron energy (time of flight) at every point (voxel) in the image. In particular Bragg edge positions provide crystallographic information and therefore enable the identification of crystalline phases directly. Here we demonstrate Bragg edge tomography with high spatial and spectral resolution. We propose a new iterative tomographic reconstruction method with a tailored regularisation term to achieve high quality reconstruction from low-count data, where conventional filtered back-projection (FBP) fails. The regularisation acts in a separated mode for spatial and spectral dimensions and favours characteristic piece-wise constant and piece-wise smooth behaviour in the respective dimensions. The proposed method is compared against FBP and a state-of-the-art regulariser for multi-channel tomography on a multi-material phantom. The proposed new regulariser which accommodates specific image properties outperforms both conventional and state-of-the-art methods and therefore facilitates Bragg edge fitting at the voxel level. The proposed method requires significantly shorter exposure to retrieve features of interest. This in turn facilitates more efficient usage of expensive neutron beamline time and enables the full utilisation of state-of-the-art high resolution detectors.
△ Less
Submitted 12 February, 2021;
originally announced February 2021.
-
Core Imaging Library -- Part II: Multichannel reconstruction for dynamic and spectral tomography
Authors:
Evangelos Papoutsellis,
Evelina Ametova,
Claire Delplancke,
Gemma Fardell,
Jakob S. Jørgensen,
Edoardo Pasca,
Martin Turner,
Ryan Warr,
William R. B. Lionheart,
Philip J. Withers
Abstract:
The newly developed Core Imaging Library (CIL) is a flexible plug and play library for tomographic imaging with a specific focus on iterative reconstruction. CIL provides building blocks for tailored regularised reconstruction algorithms and explicitly supports multichannel tomographic data. In the first part of this two-part publication, we introduced the fundamentals of CIL. This paper focuses o…
▽ More
The newly developed Core Imaging Library (CIL) is a flexible plug and play library for tomographic imaging with a specific focus on iterative reconstruction. CIL provides building blocks for tailored regularised reconstruction algorithms and explicitly supports multichannel tomographic data. In the first part of this two-part publication, we introduced the fundamentals of CIL. This paper focuses on applications of CIL for multichannel data, e.g., dynamic and spectral. We formalise different optimisation problems for colour processing, dynamic and hyperspectral tomography and demonstrate CIL's capabilities for designing state of the art reconstruction methods through case studies and code snapshots.
△ Less
Submitted 28 May, 2021; v1 submitted 10 February, 2021;
originally announced February 2021.
-
Core Imaging Library -- Part I: a versatile Python framework for tomographic imaging
Authors:
Jakob S. Jørgensen,
Evelina Ametova,
Genoveva Burca,
Gemma Fardell,
Evangelos Papoutsellis,
Edoardo Pasca,
Kris Thielemans,
Martin Turner,
Ryan Warr,
William R. B. Lionheart,
Philip J. Withers
Abstract:
We present the Core Imaging Library (CIL), an open-source Python framework for tomographic imaging with particular emphasis on reconstruction of challenging datasets. Conventional filtered back-projection reconstruction tends to be insufficient for highly noisy, incomplete, non-standard or multi-channel data arising for example in dynamic, spectral and in situ tomography. CIL provides an extensive…
▽ More
We present the Core Imaging Library (CIL), an open-source Python framework for tomographic imaging with particular emphasis on reconstruction of challenging datasets. Conventional filtered back-projection reconstruction tends to be insufficient for highly noisy, incomplete, non-standard or multi-channel data arising for example in dynamic, spectral and in situ tomography. CIL provides an extensive modular optimisation framework for prototy** reconstruction methods including sparsity and total variation regularisation, as well as tools for loading, preprocessing and visualising tomographic data. The capabilities of CIL are demonstrated on a synchrotron example dataset and three challenging cases spanning golden-ratio neutron tomography, cone-beam X-ray laminography and positron emission tomography.
△ Less
Submitted 27 May, 2021; v1 submitted 8 February, 2021;
originally announced February 2021.
-
Analyzing Reconstruction Artifacts from Arbitrary Incomplete X-ray CT Data
Authors:
Leise Borg,
Jurgen Frikel,
Jakob Sauer Jorgensen,
Eric Todd Quinto
Abstract:
This article provides a mathematical analysis of singular (nonsmooth) artifacts added to reconstructions by filtered backprojection (FBP) type algorithms for X-ray CT with arbitrary incomplete data. We prove that these singular artifacts arise from points at the boundary of the data set. Our results show that, depending on the geometry of this boundary, two types of artifacts can arise: object-dep…
▽ More
This article provides a mathematical analysis of singular (nonsmooth) artifacts added to reconstructions by filtered backprojection (FBP) type algorithms for X-ray CT with arbitrary incomplete data. We prove that these singular artifacts arise from points at the boundary of the data set. Our results show that, depending on the geometry of this boundary, two types of artifacts can arise: object-dependent and object-independent artifacts. Object-dependent artifacts are generated by singularities of the object being scanned and these artifacts can extend along lines. They generalize the streak artifacts observed in limited-angle tomography. Object-independent artifacts, on the other hand, are essentially independent of the object and take one of two forms: streaks on lines if the boundary of the data set is not smooth at a point and curved artifacts if the boundary is smooth locally. We prove that these streak and curve artifacts are the only singular artifacts that can occur for FBP in the continuous case. In addition to the geometric description of artifacts, the article provides characterizations of their strength in Sobolev scale in certain cases. The results of this article apply to the well-known incomplete data problems, including limited-angle and region-of-interest tomography, as well as to unconventional X-ray CT imaging setups that arise in new practical applications. Reconstructions from simulated and real data are analyzed to illustrate our theorems, including the reconstruction that motivated this work---a synchrotron data set in which artifacts appear on lines that have no relation to the object.
△ Less
Submitted 28 September, 2018; v1 submitted 4 July, 2017;
originally announced July 2017.
-
Noise Robustness of a Combined Phase Retrieval and Reconstruction Method for Phase-Contrast Tomography
Authors:
Rasmus Dalgas Kongskov,
Jakob Sauer Jørgensen,
Henning Friis Poulsen,
Per Christian Hansen
Abstract:
Classical reconstruction methods for phase-contrast tomography consist of two stages: phase retrieval and tomographic reconstruction. A novel algebraic method combining the two was suggested by Kostenko et al. (Opt. Express, 21, 12185, 2013) and preliminary results demonstrating improved reconstruction compared to a two-stage method given. Using simulated free-space propagation experiments with a…
▽ More
Classical reconstruction methods for phase-contrast tomography consist of two stages: phase retrieval and tomographic reconstruction. A novel algebraic method combining the two was suggested by Kostenko et al. (Opt. Express, 21, 12185, 2013) and preliminary results demonstrating improved reconstruction compared to a two-stage method given. Using simulated free-space propagation experiments with a single sample-detector distance, we thoroughly compare the novel method with the two-stage method to address limitations of the preliminary results. We demonstrate that the novel method is substantially more robust towards noise; our simulations point to a possible reduction in counting times by an order of magnitude.
△ Less
Submitted 7 September, 2015; v1 submitted 11 May, 2015;
originally announced May 2015.
-
How little data is enough? Phase-diagram analysis of sparsity-regularized X-ray CT
Authors:
Jakob S. Jørgensen,
Emil Y. Sidky
Abstract:
We introduce phase-diagram analysis, a standard tool in compressed sensing, to the X-ray CT community as a systematic method for determining how few projections suffice for accurate sparsity-regularized reconstruction. In compressed sensing a phase diagram is a convenient way to study and express certain theoretical relations between sparsity and sufficient sampling. We adapt phase-diagram analysi…
▽ More
We introduce phase-diagram analysis, a standard tool in compressed sensing, to the X-ray CT community as a systematic method for determining how few projections suffice for accurate sparsity-regularized reconstruction. In compressed sensing a phase diagram is a convenient way to study and express certain theoretical relations between sparsity and sufficient sampling. We adapt phase-diagram analysis for empirical use in X-ray CT for which the same theoretical results do not hold. We demonstrate in three case studies the potential of phase-diagram analysis for providing quantitative answers to questions of undersampling: First we demonstrate that there are cases where X-ray CT empirically performs comparable with an optimal compressed sensing strategy, namely taking measurements with Gaussian sensing matrices. Second, we show that, in contrast to what might have been anticipated, taking randomized CT measurements does not lead to improved performance compared to standard structured sampling patterns. Finally, we show preliminary results of how well phase-diagram analysis can predict the sufficient number of projections for accurately reconstructing a large-scale image of a given sparsity by means of total-variation regularization.
△ Less
Submitted 21 December, 2014;
originally announced December 2014.
-
Testable uniqueness conditions for empirical assessment of undersampling levels in total variation-regularized x-ray CT
Authors:
Jakob S. Jørgensen,
Christian Kruschel,
Dirk A. Lorenz
Abstract:
We study recoverability in fan-beam computed tomography (CT) with sparsity and total variation priors: how many underdetermined linear measurements suffice for recovering images of given sparsity? Results from compressed sensing (CS) establish such conditions for, e.g., random measurements, but not for CT. Recoverability is typically tested by checking whether a computed solution recovers the orig…
▽ More
We study recoverability in fan-beam computed tomography (CT) with sparsity and total variation priors: how many underdetermined linear measurements suffice for recovering images of given sparsity? Results from compressed sensing (CS) establish such conditions for, e.g., random measurements, but not for CT. Recoverability is typically tested by checking whether a computed solution recovers the original. This approach cannot guarantee solution uniqueness and the recoverability decision therefore depends on the optimization algorithm. We propose new computational methods to test recoverability by verifying solution uniqueness conditions. Using both reconstruction and uniqueness testing we empirically study the number of CT measurements sufficient for recovery on new classes of sparse test images. We demonstrate an average-case relation between sparsity and sufficient sampling and observe a sharp phase transition as known from CS, but never established for CT. In addition to assessing recoverability more reliably, we show that uniqueness tests are often the faster option.
△ Less
Submitted 31 August, 2014;
originally announced September 2014.
-
Empirical average-case relation between undersampling and sparsity in x-ray CT
Authors:
Jakob S. Jørgensen,
Emil Y. Sidky,
Per Christian Hansen,
Xiaochuan Pan
Abstract:
In x-ray computed tomography (CT) it is generally acknowledged that reconstruction methods exploiting image sparsity allow reconstruction from a significantly reduced number of projections. The use of such reconstruction methods is motivated by recent progress in compressed sensing (CS). However, the CS framework provides neither guarantees of accurate CT reconstruction, nor any relation between s…
▽ More
In x-ray computed tomography (CT) it is generally acknowledged that reconstruction methods exploiting image sparsity allow reconstruction from a significantly reduced number of projections. The use of such reconstruction methods is motivated by recent progress in compressed sensing (CS). However, the CS framework provides neither guarantees of accurate CT reconstruction, nor any relation between sparsity and a sufficient number of measurements for recovery, i.e., perfect reconstruction from noise-free data. We consider reconstruction through 1-norm minimization, as proposed in CS, from data obtained using a standard CT fan-beam sampling pattern. In empirical simulation studies we establish quantitatively a relation between the image sparsity and the sufficient number of measurements for recovery within image classes motivated by tomographic applications. We show empirically that the specific relation depends on the image class and in many cases exhibits a sharp phase transition as seen in CS, i.e. same-sparsity image require the same number of projections for recovery. Finally we demonstrate that the relation holds independently of image size and is robust to small amounts of additive Gaussian noise.
△ Less
Submitted 4 August, 2014; v1 submitted 24 November, 2012;
originally announced November 2012.
