-
A Hybrid Monte Carlo and Deep Learning Approach for Fast and Generic Photon Beam Dose Calculation
Authors:
Maxime Rousselot,
Chi-Hieu Pham,
Dimitris Visvikis,
Julien Bert
Abstract:
Dosimetry is an essential tool to provide the best and safest radio-therapies to a patient. In this field, Monte-Carlo simulations are considered to be the golden standard for predicting accurately the deposited dose in the body. Such methods are very time-consuming and simpler dose calculation engines, like dose kernel approaches, were created for cases where a fast estimation is necessary. In th…
▽ More
Dosimetry is an essential tool to provide the best and safest radio-therapies to a patient. In this field, Monte-Carlo simulations are considered to be the golden standard for predicting accurately the deposited dose in the body. Such methods are very time-consuming and simpler dose calculation engines, like dose kernel approaches, were created for cases where a fast estimation is necessary. In those approaches, dose distribution maps (or dose kernel) are learned for simple beams geometry, then, a combination of numerous kernels is used to simulate more complex beams. However, those methods often lack personalization and oversimplify the human body, especially for the secondary interactions dose deposition. In this article, we explore the possibility of learning the dose kernel using convolutional neural networks to improve their accuracy towards each different human body. We also highlight the limits of such approaches.
△ Less
Submitted 3 May, 2024;
originally announced May 2024.
-
Multi-Branch Generative Models for Multichannel Imaging with an Application to PET/CT Joint Reconstruction
Authors:
Noel Jeffrey Pinton,
Alexandre Bousse,
Catherine Cheze-Le-Rest,
Dimitris Visvikis
Abstract:
This paper presents a proof-of-concept approach for learned synergistic reconstruction of medical images using multi-branch generative models. Leveraging variational autoencoders (VAEs) and generative adversarial networks (GANs), our models learn from pairs of images simultaneously, enabling effective denoising and reconstruction. Synergistic image reconstruction is achieved by incorporating the t…
▽ More
This paper presents a proof-of-concept approach for learned synergistic reconstruction of medical images using multi-branch generative models. Leveraging variational autoencoders (VAEs) and generative adversarial networks (GANs), our models learn from pairs of images simultaneously, enabling effective denoising and reconstruction. Synergistic image reconstruction is achieved by incorporating the trained models in a regularizer that evaluates the distance between the images and the model, in a similar fashion to multichannel dictionary learning (DiL). We demonstrate the efficacy of our approach on both Modified National Institute of Standards and Technology (MNIST) and positron emission tomography (PET)/computed tomography (CT) datasets, showcasing improved image quality and information sharing between modalities. Despite challenges such as patch decomposition and model limitations, our results underscore the potential of generative models for enhancing medical imaging reconstruction.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Spectral CT Two-step and One-step Material Decomposition using Diffusion Posterior Sampling
Authors:
Corentin Vazia,
Alexandre Bousse,
Jacques Froment,
Béatrice Vedel,
Franck Vermet,
Zhihan Wang,
Thore Dassow,
Jean-Pierre Tasu,
Dimitris Visvikis
Abstract:
This paper proposes a novel approach to spectral computed tomography (CT) material decomposition that uses the recent advances in generative diffusion models (DMs) for inverse problems. Spectral CT and more particularly photon-counting CT (PCCT) can perform transmission measurements at different energy levels which can be used for material decomposition. It is an ill-posed inverse problem and ther…
▽ More
This paper proposes a novel approach to spectral computed tomography (CT) material decomposition that uses the recent advances in generative diffusion models (DMs) for inverse problems. Spectral CT and more particularly photon-counting CT (PCCT) can perform transmission measurements at different energy levels which can be used for material decomposition. It is an ill-posed inverse problem and therefore requires regularization. DMs are a class of generative model that can be used to solve inverse problems via diffusion posterior sampling (DPS). In this paper we adapt DPS for material decomposition in a PCCT setting. We propose two approaches, namely Two-step Diffusion Posterior Sampling (TDPS) and One-step Diffusion Posterior Sampling (ODPS). Early results from an experiment with simulated low-dose PCCT suggest that DPSs have the potential to outperform state-of-the-art model-based iterative reconstruction (MBIR). Moreover, our results indicate that TDPS produces material images with better peak signal-to-noise ratio (PSNR) than images produced with ODPS with similar structural similarity (SSIM).
△ Less
Submitted 23 June, 2024; v1 submitted 15 March, 2024;
originally announced March 2024.
-
Diffusion Posterior Sampling for Synergistic Reconstruction in Spectral Computed Tomography
Authors:
Corentin Vazia,
Alexandre Bousse,
Béatrice Vedel,
Franck Vermet,
Zhihan Wang,
Thore Dassow,
Jean-Pierre Tasu,
Dimitris Visvikis,
Jacques Froment
Abstract:
Using recent advances in generative artificial intelligence (AI) brought by diffusion models, this paper introduces a new synergistic method for spectral computed tomography (CT) reconstruction. Diffusion models define a neural network to approximate the gradient of the log-density of the training data, which is then used to generate new images similar to the training ones. Following the inverse p…
▽ More
Using recent advances in generative artificial intelligence (AI) brought by diffusion models, this paper introduces a new synergistic method for spectral computed tomography (CT) reconstruction. Diffusion models define a neural network to approximate the gradient of the log-density of the training data, which is then used to generate new images similar to the training ones. Following the inverse problem paradigm, we propose to adapt this generative process to synergistically reconstruct multiple images at different energy bins from multiple measurements. The experiments suggest that using multiple energy bins simultaneously improves the reconstruction by inverse diffusion and outperforms state-of-the-art synergistic reconstruction techniques.
△ Less
Submitted 15 March, 2024; v1 submitted 10 March, 2024;
originally announced March 2024.
-
Fast-Track of F-18 Positron paths simulations using GANs
Authors:
Youness Mellak,
Konstantinos Chatzipapas,
Alexandre Bousse,
Catherine Chez-Le Rest,
Dimitris Visvikis,
Julien Bert
Abstract:
In recent years, the use of Monte Carlo (MC) simulations in the domain of Medical Physics has become a state-of-the-art technology that consumes lots of computational resources for the accurate prediction of particle interactions. The use of generative adversarial network (GAN) has been recently proposed as an alternative to improve the efficiency and extending the applications of computational to…
▽ More
In recent years, the use of Monte Carlo (MC) simulations in the domain of Medical Physics has become a state-of-the-art technology that consumes lots of computational resources for the accurate prediction of particle interactions. The use of generative adversarial network (GAN) has been recently proposed as an alternative to improve the efficiency and extending the applications of computational tools in both medical imaging and therapeutic applications. This study introduces a new approach to simulate positron paths originating from Fluorine 18 (18 F) isotopes through the utilization of GANs. The proposed methodology developed a pure conditional transformer least squares (LS)-GAN model, designed to generate positron paths, and to track their interaction within the surrounding material. Conditioning factors include the pre-determined number of interactions, and the initial momentum of the emitted positrons, as derived from the emission spectrum of 18 F. By leveraging these conditions, the model aims to quickly and accurately simulate electromagnetic interactions of positron paths. Results were compared to the outcome produced with Geant4 Application for Tomography Emission (GATE) MC simulations toolkit. Less than 10 % of difference was observed in the calculation of the mean and maximum length of the path and the 1-D point spread function (PSF) for three different materials (Water, Bone, Lung).
△ Less
Submitted 16 March, 2024; v1 submitted 10 March, 2024;
originally announced March 2024.
-
A Review on Low-Dose Emission Tomography Post-Reconstruction Denoising with Neural Network Approaches
Authors:
Alexandre Bousse,
Venkata Sai Sundar Kandarpa,
Kuangyu Shi,
Kuang Gong,
Jae Sung Lee,
Chi Liu,
Dimitris Visvikis
Abstract:
Low-dose emission tomography (ET) plays a crucial role in medical imaging, enabling the acquisition of functional information for various biological processes while minimizing the patient dose. However, the inherent randomness in the photon counting process is a source of noise which is amplified in low-dose ET. This review article provides an overview of existing post-processing techniques, with…
▽ More
Low-dose emission tomography (ET) plays a crucial role in medical imaging, enabling the acquisition of functional information for various biological processes while minimizing the patient dose. However, the inherent randomness in the photon counting process is a source of noise which is amplified in low-dose ET. This review article provides an overview of existing post-processing techniques, with an emphasis on deep neural network (NN) approaches. Furthermore, we explore future directions in the field of NN-based low-dose ET. This comprehensive examination sheds light on the potential of deep learning in enhancing the quality and resolution of low-dose ET images, ultimately advancing the field of medical imaging.
△ Less
Submitted 15 January, 2024; v1 submitted 30 December, 2023;
originally announced January 2024.
-
Uconnect: Synergistic Spectral CT Reconstruction with U-Nets Connecting the Energy bins
Authors:
Zhihan Wang,
Alexandre Bousse,
Franck Vermet,
Jacques Froment,
Béatrice Vedel,
Alessandro Perelli,
Jean-Pierre Tasu,
Dimitris Visvikis
Abstract:
Spectral computed tomography (CT) offers the possibility to reconstruct attenuation images at different energy levels, which can be then used for material decomposition. However, traditional methods reconstruct each energy bin individually and are vulnerable to noise. In this paper, we propose a novel synergistic method for spectral CT reconstruction, namely Uconnect. It utilizes trained convoluti…
▽ More
Spectral computed tomography (CT) offers the possibility to reconstruct attenuation images at different energy levels, which can be then used for material decomposition. However, traditional methods reconstruct each energy bin individually and are vulnerable to noise. In this paper, we propose a novel synergistic method for spectral CT reconstruction, namely Uconnect. It utilizes trained convolutional neural networks (CNNs) to connect the energy bins to a latent image so that the full binned data is used synergistically. We experiment on two types of low-dose data: simulated and real patient data. Qualitative and quantitative analysis show that our proposed Uconnect outperforms state-of-art model-based iterative reconstruction (MBIR) techniques as well as CNN-based denoising.
△ Less
Submitted 22 November, 2023; v1 submitted 1 November, 2023;
originally announced November 2023.
-
On-line Dose Calculation Using Deep Learning for Beams Selection in Non-Coplanar Radiotherapy
Authors:
Fang Guo,
Franklin Okoli,
Ulrike Schick,
Dimitris Visvikis,
Antoine Valeri,
Julien Bert
Abstract:
Non-coplanar Intensity-Modulated Radiation Therapy (IMRT) goes a step further by orienting the gantry carrying the radiation beam and the patient couch in a non-coplanar manner to accurately target the cancer region and better avoid organs-at-risk. The use of a non-coplanar treatment trajectory significantly enhances the degree of freedom and flexibility but increases drastically the complexity of…
▽ More
Non-coplanar Intensity-Modulated Radiation Therapy (IMRT) goes a step further by orienting the gantry carrying the radiation beam and the patient couch in a non-coplanar manner to accurately target the cancer region and better avoid organs-at-risk. The use of a non-coplanar treatment trajectory significantly enhances the degree of freedom and flexibility but increases drastically the complexity of the optimization. In inverse planning optimization the dose contribution for all potential beam directions is usually pre-calculates and pre-loads into the Treatment Planning System (TPS). The size the dose matrix becomes more critical when moving from coplanar IMRT to non-coplanar IMRT since the number of beams increases drastically. A solution would be to calculate "on-the-fly" the dose contribution to each new candidate beam during optimization. This is only possible if a dose calculation engine is fast enough to be used online during optimization iterations, which is not the case in standard method. Therefore, in this work we propose an IMRT optimization scheme using deep learning based dose engine to compute the dose matrix on-line. The proposed deep learning approach will be combined into a simulated-annealing-based optimization method for non-coplanar IMRT. Since the dose engine will compute the dose contribution on-line during the optimization, the final main optimization method requires to keep in memory a very lightweight dose matrix. The proposed method was compared with clinical data showing a good agreement considering dosimetry of the treatment plans. The main advantage of the proposed method was the reduction of the memory storage from 9GB to 10MB during the optimization process.
△ Less
Submitted 15 May, 2023; v1 submitted 12 May, 2023;
originally announced May 2023.
-
Multi-Channel Convolutional Analysis Operator Learning for Dual-Energy CT Reconstruction
Authors:
Alessandro Perelli,
Suxer Alfonso Garcia,
Alexandre Bousse,
Jean-Pierre Tasu,
Nikolaos Efthimiadis,
Dimitris Visvikis
Abstract:
Objective. Dual-energy computed tomography (DECT) has the potential to improve contrast, reduce artifacts and the ability to perform material decomposition in advanced imaging applications. The increased number or measurements results with a higher radiation dose and it is therefore essential to reduce either number of projections per energy or the source X-ray intensity, but this makes tomographi…
▽ More
Objective. Dual-energy computed tomography (DECT) has the potential to improve contrast, reduce artifacts and the ability to perform material decomposition in advanced imaging applications. The increased number or measurements results with a higher radiation dose and it is therefore essential to reduce either number of projections per energy or the source X-ray intensity, but this makes tomographic reconstruction more ill-posed.
Approach. We developed the multi-channel convolutional analysis operator learning (MCAOL) method to exploit common spatial features within attenuation images at different energies and we propose an optimization method which jointly reconstructs the attenuation images at low and high energies with a mixed norm regularization on the sparse features obtained by pre-trained convolutional filters through the convolutional analysis operator learning (CAOL) algorithm.
Main results. Extensive experiments with simulated and real computed tomography (CT) data were performed to validate the effectiveness of the proposed methods and we reported increased reconstruction accuracy compared to CAOL and iterative methods with single and joint total-variation (TV) regularization.
Significance. Qualitative and quantitative results on sparse-views and low-dose DECT demonstrate that the proposed MCAOL method outperforms both CAOL applied on each energy independently and several existing state-of-the-art model-based iterative reconstruction (MBIR) techniques, thus paving the way for dose reduction.
△ Less
Submitted 10 March, 2022;
originally announced March 2022.
-
DUG-RECON: A Framework for Direct Image Reconstruction using Convolutional Generative Networks
Authors:
V. S. S. Kandarpa,
Alexandre Bousse,
Didier Benoit,
Dimitris Visvikis
Abstract:
This paper explores convolutional generative networks as an alternative to iterative reconstruction algorithms in medical image reconstruction. The task of medical image reconstruction involves map** of projection main data collected from the detector to the image domain. This map** is done typically through iterative reconstruction algorithms which are time consuming and computationally expen…
▽ More
This paper explores convolutional generative networks as an alternative to iterative reconstruction algorithms in medical image reconstruction. The task of medical image reconstruction involves map** of projection main data collected from the detector to the image domain. This map** is done typically through iterative reconstruction algorithms which are time consuming and computationally expensive. Trained deep learning networks provide faster outputs as proven in various tasks across computer vision. In this work we propose a direct reconstruction framework exclusively with deep learning architectures. The proposed framework consists of three segments, namely denoising, reconstruction and super resolution. The denoising and the super resolution segments act as processing steps. The reconstruction segment consists of a novel double U-Net generator (DUG) which learns the sinogram-to-image transformation. This entire network was trained on positron emission tomography (PET) and computed tomography (CT) images. The reconstruction framework approximates two-dimensional (2-D) map** from projection domain to image domain. The architecture proposed in this proof-of-concept work is a novel approach to direct image reconstruction; further improvement is required to implement it in a clinical setting.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Reliability of PET/CT shape and heterogeneity features in functional and morphological components of Non-Small Cell Lung Cancer tumors: a repeatability analysis in a prospective multi-center cohort
Authors:
Marie-Charlotte Desseroit,
Florent Tixier,
Wolfgang Weber,
Barry A Siegel,
Catherine Cheze Le Rest,
Dimitris Visvikis,
Mathieu Hatt
Abstract:
Purpose: The main purpose of this study was to assess the reliability of shape and heterogeneity features in both Positron Emission Tomography (PET) and low-dose Computed Tomography (CT) components of PET/CT. A secondary objective was to investigate the impact of image quantization.Material and methods: A Health Insurance Portability and Accountability Act -compliant secondary analysis of deidenti…
▽ More
Purpose: The main purpose of this study was to assess the reliability of shape and heterogeneity features in both Positron Emission Tomography (PET) and low-dose Computed Tomography (CT) components of PET/CT. A secondary objective was to investigate the impact of image quantization.Material and methods: A Health Insurance Portability and Accountability Act -compliant secondary analysis of deidentified prospectively acquired PET/CT test-retest datasets of 74 patients from multi-center Merck and ACRIN trials was performed. Metabolically active volumes were automatically delineated on PET with Fuzzy Locally Adaptive Bayesian algorithm. 3DSlicerTM was used to semi-automatically delineate the anatomical volumes on low-dose CT components. Two quantization methods were considered: a quantization into a set number of bins (quantizationB) and an alternative quantization with bins of fixed width (quantizationW). Four shape descriptors, ten first-order metrics and 26 textural features were computed. Bland-Altman analysis was used to quantify repeatability. Features were subsequently categorized as very reliable, reliable, moderately reliable and poorly reliable with respect to the corresponding volume variability. Results: Repeatability was highly variable amongst features. Numerous metrics were identified as poorly or moderately reliable. Others were (very) reliable in both modalities, and in all categories (shape, 1st-, 2nd- and 3rd-order metrics). Image quantization played a major role in the features repeatability. Features were more reliable in PET with quantizationB, whereas quantizationW showed better results in CT.Conclusion: The test-retest repeatability of shape and heterogeneity features in PET and low-dose CT varied greatly amongst metrics. The level of repeatability also depended strongly on the quantization step, with different optimal choices for each modality. The repeatability of PET and low-dose CT features should be carefully taken into account when selecting metrics to build multiparametric models.
△ Less
Submitted 5 October, 2016;
originally announced October 2016.
-
GATE : a simulation toolkit for PET and SPECT
Authors:
S. Jan,
G. Santin,
D. Strul,
S. Staelens,
K. Assie,
D. Autret,
S. Avner,
R. Barbier,
M. Bardies,
P. M. Bloomfield,
D. Brasse,
V. Breton,
P. Bruyndonckx,
I. Buvat,
A. F. Chatziioannou,
Y. Choi,
Y. H. Chung,
C. Comtat,
D. Donnarieix,
L. Ferrer,
S. J. Glick,
C. J. Groiselle,
D. Guez,
P. -F. Honore,
S. Kerhoas-Cavata
, et al. (28 additional authors not shown)
Abstract:
Monte Carlo simulation is an essential tool in emission tomography that can assist in the design of new medical imaging devices, the optimization of acquisition protocols, and the development or assessment of image reconstruction algorithms and correction techniques. GATE, the Geant4 Application for Tomographic Emission, encapsulates the Geant4 libraries to achieve a modular, versatile, scripted…
▽ More
Monte Carlo simulation is an essential tool in emission tomography that can assist in the design of new medical imaging devices, the optimization of acquisition protocols, and the development or assessment of image reconstruction algorithms and correction techniques. GATE, the Geant4 Application for Tomographic Emission, encapsulates the Geant4 libraries to achieve a modular, versatile, scripted simulation toolkit adapted to the field of nuclear medicine. In particular, GATE allows the description of time-dependent phenomena such as source or detector movement, and source decay kinetics. This feature makes it possible to simulate time curves under realistic acquisition conditions and to test dynamic reconstruction algorithms. A public release of GATE licensed under the GNU Lesser General Public License can be downloaded at the address http://www-lphe.epfl.ch/GATE/.
△ Less
Submitted 24 August, 2004;
originally announced August 2004.
