-
CConnect: Synergistic Convolutional Regularization for Cartesian T2* Map**
Authors:
Juan Molina,
Alexandre Bousse,
Tabita Catalán,
Zhihan Wang,
Mircea Petrache,
Francisco Sahli,
Claudia Prieto,
Matìas Courdurier
Abstract:
Magnetic resonance imaging (MRI) is fundamental for the assessment of many diseases, due to its excellent tissue contrast characterization. This is based on quantitative techniques, such as T1 , T2 , and T2* map**. Quantitative MRI requires the acquisition of several contrast-weighed images followed by a fitting to an exponential model or dictionary matching, which results in undesirably long ac…
▽ More
Magnetic resonance imaging (MRI) is fundamental for the assessment of many diseases, due to its excellent tissue contrast characterization. This is based on quantitative techniques, such as T1 , T2 , and T2* map**. Quantitative MRI requires the acquisition of several contrast-weighed images followed by a fitting to an exponential model or dictionary matching, which results in undesirably long acquisition times. Undersampling reconstruction techniques are commonly employed to speed up the scan, with the drawback of introducing aliasing artifacts. However, most undersampling reconstruction techniques require long computational times or do not exploit redundancies across the different contrast-weighted images. This study introduces a new regularization technique to overcome aliasing artifacts, namely CConnect, which uses an innovative regularization term that leverages several trained convolutional neural networks (CNNs) to connect and exploit information across image contrasts in a latent space. We validate our method using in-vivo T2* map** of the brain, with retrospective undersampling factors of 4, 5 and 6, demonstrating its effectiveness in improving reconstruction in comparison to state-of-the-art techniques. Comparisons against joint total variation, nuclear low rank and a deep learning (DL) de-aliasing post-processing method, with respect to structural similarity index measure (SSIM) and peak signal-to-noise ratio (PSNR) metrics are presented.
△ Less
Submitted 28 April, 2024;
originally announced April 2024.
-
Multi-Branch Generative Models for Multichannel Imaging with an Application to PET/CT Joint Reconstruction
Authors:
Noel Jeffrey Pinton,
Alexandre Bousse,
Catherine Cheze-Le-Rest,
Dimitris Visvikis
Abstract:
This paper presents a proof-of-concept approach for learned synergistic reconstruction of medical images using multi-branch generative models. Leveraging variational autoencoders (VAEs) and generative adversarial networks (GANs), our models learn from pairs of images simultaneously, enabling effective denoising and reconstruction. Synergistic image reconstruction is achieved by incorporating the t…
▽ More
This paper presents a proof-of-concept approach for learned synergistic reconstruction of medical images using multi-branch generative models. Leveraging variational autoencoders (VAEs) and generative adversarial networks (GANs), our models learn from pairs of images simultaneously, enabling effective denoising and reconstruction. Synergistic image reconstruction is achieved by incorporating the trained models in a regularizer that evaluates the distance between the images and the model, in a similar fashion to multichannel dictionary learning (DiL). We demonstrate the efficacy of our approach on both Modified National Institute of Standards and Technology (MNIST) and positron emission tomography (PET)/computed tomography (CT) datasets, showcasing improved image quality and information sharing between modalities. Despite challenges such as patch decomposition and model limitations, our results underscore the potential of generative models for enhancing medical imaging reconstruction.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Spectral CT Two-step and One-step Material Decomposition using Diffusion Posterior Sampling
Authors:
Corentin Vazia,
Alexandre Bousse,
Jacques Froment,
Béatrice Vedel,
Franck Vermet,
Zhihan Wang,
Thore Dassow,
Jean-Pierre Tasu,
Dimitris Visvikis
Abstract:
This paper proposes a novel approach to spectral computed tomography (CT) material decomposition that uses the recent advances in generative diffusion models (DMs) for inverse problems. Spectral CT and more particularly photon-counting CT (PCCT) can perform transmission measurements at different energy levels which can be used for material decomposition. It is an ill-posed inverse problem and ther…
▽ More
This paper proposes a novel approach to spectral computed tomography (CT) material decomposition that uses the recent advances in generative diffusion models (DMs) for inverse problems. Spectral CT and more particularly photon-counting CT (PCCT) can perform transmission measurements at different energy levels which can be used for material decomposition. It is an ill-posed inverse problem and therefore requires regularization. DMs are a class of generative model that can be used to solve inverse problems via diffusion posterior sampling (DPS). In this paper we adapt DPS for material decomposition in a PCCT setting. We propose two approaches, namely Two-step Diffusion Posterior Sampling (TDPS) and One-step Diffusion Posterior Sampling (ODPS). Early results from an experiment with simulated low-dose PCCT suggest that DPSs have the potential to outperform state-of-the-art model-based iterative reconstruction (MBIR). Moreover, our results indicate that TDPS produces material images with better peak signal-to-noise ratio (PSNR) than images produced with ODPS with similar structural similarity (SSIM).
△ Less
Submitted 23 June, 2024; v1 submitted 15 March, 2024;
originally announced March 2024.
-
Diffusion Posterior Sampling for Synergistic Reconstruction in Spectral Computed Tomography
Authors:
Corentin Vazia,
Alexandre Bousse,
Béatrice Vedel,
Franck Vermet,
Zhihan Wang,
Thore Dassow,
Jean-Pierre Tasu,
Dimitris Visvikis,
Jacques Froment
Abstract:
Using recent advances in generative artificial intelligence (AI) brought by diffusion models, this paper introduces a new synergistic method for spectral computed tomography (CT) reconstruction. Diffusion models define a neural network to approximate the gradient of the log-density of the training data, which is then used to generate new images similar to the training ones. Following the inverse p…
▽ More
Using recent advances in generative artificial intelligence (AI) brought by diffusion models, this paper introduces a new synergistic method for spectral computed tomography (CT) reconstruction. Diffusion models define a neural network to approximate the gradient of the log-density of the training data, which is then used to generate new images similar to the training ones. Following the inverse problem paradigm, we propose to adapt this generative process to synergistically reconstruct multiple images at different energy bins from multiple measurements. The experiments suggest that using multiple energy bins simultaneously improves the reconstruction by inverse diffusion and outperforms state-of-the-art synergistic reconstruction techniques.
△ Less
Submitted 15 March, 2024; v1 submitted 10 March, 2024;
originally announced March 2024.
-
Fast-Track of F-18 Positron paths simulations using GANs
Authors:
Youness Mellak,
Konstantinos Chatzipapas,
Alexandre Bousse,
Catherine Chez-Le Rest,
Dimitris Visvikis,
Julien Bert
Abstract:
In recent years, the use of Monte Carlo (MC) simulations in the domain of Medical Physics has become a state-of-the-art technology that consumes lots of computational resources for the accurate prediction of particle interactions. The use of generative adversarial network (GAN) has been recently proposed as an alternative to improve the efficiency and extending the applications of computational to…
▽ More
In recent years, the use of Monte Carlo (MC) simulations in the domain of Medical Physics has become a state-of-the-art technology that consumes lots of computational resources for the accurate prediction of particle interactions. The use of generative adversarial network (GAN) has been recently proposed as an alternative to improve the efficiency and extending the applications of computational tools in both medical imaging and therapeutic applications. This study introduces a new approach to simulate positron paths originating from Fluorine 18 (18 F) isotopes through the utilization of GANs. The proposed methodology developed a pure conditional transformer least squares (LS)-GAN model, designed to generate positron paths, and to track their interaction within the surrounding material. Conditioning factors include the pre-determined number of interactions, and the initial momentum of the emitted positrons, as derived from the emission spectrum of 18 F. By leveraging these conditions, the model aims to quickly and accurately simulate electromagnetic interactions of positron paths. Results were compared to the outcome produced with Geant4 Application for Tomography Emission (GATE) MC simulations toolkit. Less than 10 % of difference was observed in the calculation of the mean and maximum length of the path and the 1-D point spread function (PSF) for three different materials (Water, Bone, Lung).
△ Less
Submitted 16 March, 2024; v1 submitted 10 March, 2024;
originally announced March 2024.
-
A Review on Low-Dose Emission Tomography Post-Reconstruction Denoising with Neural Network Approaches
Authors:
Alexandre Bousse,
Venkata Sai Sundar Kandarpa,
Kuangyu Shi,
Kuang Gong,
Jae Sung Lee,
Chi Liu,
Dimitris Visvikis
Abstract:
Low-dose emission tomography (ET) plays a crucial role in medical imaging, enabling the acquisition of functional information for various biological processes while minimizing the patient dose. However, the inherent randomness in the photon counting process is a source of noise which is amplified in low-dose ET. This review article provides an overview of existing post-processing techniques, with…
▽ More
Low-dose emission tomography (ET) plays a crucial role in medical imaging, enabling the acquisition of functional information for various biological processes while minimizing the patient dose. However, the inherent randomness in the photon counting process is a source of noise which is amplified in low-dose ET. This review article provides an overview of existing post-processing techniques, with an emphasis on deep neural network (NN) approaches. Furthermore, we explore future directions in the field of NN-based low-dose ET. This comprehensive examination sheds light on the potential of deep learning in enhancing the quality and resolution of low-dose ET images, ultimately advancing the field of medical imaging.
△ Less
Submitted 15 January, 2024; v1 submitted 30 December, 2023;
originally announced January 2024.
-
Uconnect: Synergistic Spectral CT Reconstruction with U-Nets Connecting the Energy bins
Authors:
Zhihan Wang,
Alexandre Bousse,
Franck Vermet,
Jacques Froment,
Béatrice Vedel,
Alessandro Perelli,
Jean-Pierre Tasu,
Dimitris Visvikis
Abstract:
Spectral computed tomography (CT) offers the possibility to reconstruct attenuation images at different energy levels, which can be then used for material decomposition. However, traditional methods reconstruct each energy bin individually and are vulnerable to noise. In this paper, we propose a novel synergistic method for spectral CT reconstruction, namely Uconnect. It utilizes trained convoluti…
▽ More
Spectral computed tomography (CT) offers the possibility to reconstruct attenuation images at different energy levels, which can be then used for material decomposition. However, traditional methods reconstruct each energy bin individually and are vulnerable to noise. In this paper, we propose a novel synergistic method for spectral CT reconstruction, namely Uconnect. It utilizes trained convolutional neural networks (CNNs) to connect the energy bins to a latent image so that the full binned data is used synergistically. We experiment on two types of low-dose data: simulated and real patient data. Qualitative and quantitative analysis show that our proposed Uconnect outperforms state-of-art model-based iterative reconstruction (MBIR) techniques as well as CNN-based denoising.
△ Less
Submitted 22 November, 2023; v1 submitted 1 November, 2023;
originally announced November 2023.
-
Systematic Review on Learning-based Spectral CT
Authors:
Alexandre Bousse,
Venkata Sai Sundar Kandarpa,
Simon Rit,
Alessandro Perelli,
Mengzhou Li,
Guobao Wang,
Jian Zhou,
Ge Wang
Abstract:
Spectral computed tomography (CT) has recently emerged as an advanced version of medical CT and significantly improves conventional (single-energy) CT. Spectral CT has two main forms: dual-energy computed tomography (DECT) and photon-counting computed tomography (PCCT), which offer image improvement, material decomposition, and feature quantification relative to conventional CT. However, the inher…
▽ More
Spectral computed tomography (CT) has recently emerged as an advanced version of medical CT and significantly improves conventional (single-energy) CT. Spectral CT has two main forms: dual-energy computed tomography (DECT) and photon-counting computed tomography (PCCT), which offer image improvement, material decomposition, and feature quantification relative to conventional CT. However, the inherent challenges of spectral CT, evidenced by data and image artifacts, remain a bottleneck for clinical applications. To address these problems, machine learning techniques have been widely applied to spectral CT. In this review, we present the state-of-the-art data-driven techniques for spectral CT.
△ Less
Submitted 22 January, 2024; v1 submitted 15 April, 2023;
originally announced April 2023.
-
Multi-Channel Convolutional Analysis Operator Learning for Dual-Energy CT Reconstruction
Authors:
Alessandro Perelli,
Suxer Alfonso Garcia,
Alexandre Bousse,
Jean-Pierre Tasu,
Nikolaos Efthimiadis,
Dimitris Visvikis
Abstract:
Objective. Dual-energy computed tomography (DECT) has the potential to improve contrast, reduce artifacts and the ability to perform material decomposition in advanced imaging applications. The increased number or measurements results with a higher radiation dose and it is therefore essential to reduce either number of projections per energy or the source X-ray intensity, but this makes tomographi…
▽ More
Objective. Dual-energy computed tomography (DECT) has the potential to improve contrast, reduce artifacts and the ability to perform material decomposition in advanced imaging applications. The increased number or measurements results with a higher radiation dose and it is therefore essential to reduce either number of projections per energy or the source X-ray intensity, but this makes tomographic reconstruction more ill-posed.
Approach. We developed the multi-channel convolutional analysis operator learning (MCAOL) method to exploit common spatial features within attenuation images at different energies and we propose an optimization method which jointly reconstructs the attenuation images at low and high energies with a mixed norm regularization on the sparse features obtained by pre-trained convolutional filters through the convolutional analysis operator learning (CAOL) algorithm.
Main results. Extensive experiments with simulated and real computed tomography (CT) data were performed to validate the effectiveness of the proposed methods and we reported increased reconstruction accuracy compared to CAOL and iterative methods with single and joint total-variation (TV) regularization.
Significance. Qualitative and quantitative results on sparse-views and low-dose DECT demonstrate that the proposed MCAOL method outperforms both CAOL applied on each energy independently and several existing state-of-the-art model-based iterative reconstruction (MBIR) techniques, thus paving the way for dose reduction.
△ Less
Submitted 10 March, 2022;
originally announced March 2022.
-
DUG-RECON: A Framework for Direct Image Reconstruction using Convolutional Generative Networks
Authors:
V. S. S. Kandarpa,
Alexandre Bousse,
Didier Benoit,
Dimitris Visvikis
Abstract:
This paper explores convolutional generative networks as an alternative to iterative reconstruction algorithms in medical image reconstruction. The task of medical image reconstruction involves map** of projection main data collected from the detector to the image domain. This map** is done typically through iterative reconstruction algorithms which are time consuming and computationally expen…
▽ More
This paper explores convolutional generative networks as an alternative to iterative reconstruction algorithms in medical image reconstruction. The task of medical image reconstruction involves map** of projection main data collected from the detector to the image domain. This map** is done typically through iterative reconstruction algorithms which are time consuming and computationally expensive. Trained deep learning networks provide faster outputs as proven in various tasks across computer vision. In this work we propose a direct reconstruction framework exclusively with deep learning architectures. The proposed framework consists of three segments, namely denoising, reconstruction and super resolution. The denoising and the super resolution segments act as processing steps. The reconstruction segment consists of a novel double U-Net generator (DUG) which learns the sinogram-to-image transformation. This entire network was trained on positron emission tomography (PET) and computed tomography (CT) images. The reconstruction framework approximates two-dimensional (2-D) map** from projection domain to image domain. The architecture proposed in this proof-of-concept work is a novel approach to direct image reconstruction; further improvement is required to implement it in a clinical setting.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Penalized PET/CT Reconstruction Algorithms with Automatic Realignment for Anatomical Priors
Authors:
Yu-Jung Tsai,
Alexandre Bousse,
Simon Arridge,
Charles W. Stearns,
Brian F. Hutton,
Kris Thielemans
Abstract:
Two algorithms for solving misalignment issues in penalized PET/CT reconstruction using anatomical priors are proposed. Both approaches are based on a recently published joint motion estimation and image reconstruction method. The first approach deforms the anatomical image to align it with the functional one while the second approach deforms both images to align them with the measured data. Our c…
▽ More
Two algorithms for solving misalignment issues in penalized PET/CT reconstruction using anatomical priors are proposed. Both approaches are based on a recently published joint motion estimation and image reconstruction method. The first approach deforms the anatomical image to align it with the functional one while the second approach deforms both images to align them with the measured data. Our current implementation alternates between image reconstruction and alignment estimation. To evaluate the potential of these approaches, we have chosen Parallel Level Sets (PLS) as a representative anatomical penalty, incorporating a spatially-variant penalty strength to achieve uniform local contrast. The performance was evaluated using simulated non-TOF data generated with an XCAT phantom in the thorax region. We used the attenuation image in the anatomical prior. The results demonstrated that both methods can estimate the misalignment and deform the anatomical image accordingly. However, the performance of the first approach depends highly on the workflow of the alternating process. The second approach shows a faster convergence rate to the correct alignment and is less sensitive to the workflow. Interestingly, the presence of anatomical information can improve the convergence rate of misalignment estimation for the second approach but slow it down for the first approach.
△ Less
Submitted 7 November, 2020; v1 submitted 18 November, 2019;
originally announced November 2019.
